Jul 08 01:23:17 devstack cinder-volume[75606]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 01:23:17 devstack cinder-volume[75606]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 01:23:17 devstack cinder-volume[75606]: we strongly recommend against using it for new projects. Jul 08 01:23:17 devstack cinder-volume[75606]: If you are already using Eventlet, we recommend migrating to a different Jul 08 01:23:17 devstack cinder-volume[75606]: framework. For more detail see Jul 08 01:23:17 devstack cinder-volume[75606]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 01:23:17 devstack cinder-volume[75606]: import eventlet # noqa Jul 08 01:23:20 devstack cinder-volume[75606]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75606) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 01:23:20 devstack cinder-volume[75606]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75606) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 01:23:20 devstack cinder-volume[75606]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75606) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 01:23:21 devstack cinder-volume[75606]: INFO dbcounter [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] Registered counter for database cinder Jul 08 01:23:21 devstack cinder-volume[75606]: DEBUG oslo_db.sqlalchemy.engines [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75606) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:23:21 devstack cinder-volume[75606]: DEBUG dbcounter [-] [75606] Writer thread running {{(pid=75606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 01:23:21 devstack cinder-volume[75606]: INFO cinder.rpc [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 01:23:21 devstack cinder-volume[75606]: INFO cinder.rpc [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 01:23:21 devstack cinder-volume[75606]: DEBUG oslo_db.sqlalchemy.engines [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75606) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:23:21 devstack cinder-volume[75606]: INFO cinder.volume.manager [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] Determined volume DB was empty at startup. Jul 08 01:23:21 devstack cinder-volume[75606]: DEBUG cinder.volume.manager [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75606) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 01:23:21 devstack cinder-volume[75606]: INFO cinder.volume.manager [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 08 01:23:21 devstack cinder-volume[75606]: WARNING stevedore.named [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 01:23:21 devstack cinder-volume[75606]: WARNING castellan.key_manager [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 01:23:21 devstack cinder-volume[75606]: WARNING cinder.keymgr.conf_key_mgr [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 01:23:21 devstack cinder-volume[75606]: DEBUG cinder.volume.drivers.lvm [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75606) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 08 01:23:21 devstack cinder-volume[75606]: DEBUG oslo_concurrency.processutils [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_concurrency.processutils [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] CMD "cinder-rtstool verify" returned: 0 in 0.510s {{(pid=75606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_db.sqlalchemy.engines [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75606) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:23:22 devstack cinder-volume[75606]: INFO cinder.rpc [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 08 01:23:22 devstack cinder-volume[75606]: INFO cinder.rpc [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 08 01:23:22 devstack cinder-volume[75606]: WARNING stevedore.named [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 01:23:22 devstack cinder-volume[75606]: WARNING castellan.key_manager [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 01:23:22 devstack cinder-volume[75606]: INFO cinder.volume.manager [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_db.sqlalchemy.engines [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75606) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:23:22 devstack cinder-volume[75606]: INFO oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] Starting 1 workers Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] Started child 75769 {{(pid=75606) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] Full set of CONF: {{(pid=75606) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] ******************************************************************************** {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] Configuration options gathered from: {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] ================================================================================ {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] allow_availability_zone_fallback = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] allow_compression_on_image_upload = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] allowed_direct_url_schemes = [] {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75769]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] api_rate_limit = True {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] auth_strategy = keystone {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] az_cache_duration = 3600 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_availability_zone = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_host = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_name = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_stats_polling_interval = 60 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backup_api_class = cinder.backup.api.API {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backup_name_template = backup-%s {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backup_use_same_host = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backup_use_temp_snapshot = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] chap_password = **** {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] chap_username = {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cinder_internal_tenant_project_id = 3f654e14c4744630ad01304f23a5710e {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cinder_internal_tenant_user_id = 58298c47bc0c4b59bcf2b7f51a34919e {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cloned_volume_same_az = True {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cluster = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] compression_format = gzip {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] compute_api_class = cinder.compute.nova.API {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] config_dir = [] {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] config_source = [] {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] control_exchange = openstack {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] debug = True {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] default_availability_zone = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] default_group_type = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] default_volume_type = lvmdriver-1 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] disk_geometry = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] driver_client_cert = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] driver_client_cert_key = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] driver_data_namespace = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] driver_ssl_cert_path = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] driver_ssl_cert_verify = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] driver_use_ssl = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] enable_force_upload = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] enable_new_services = True {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] enable_unsupported_driver = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] enabled_backends = ['lvmdriver-1'] {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] enforce_multipath_for_image_xfer = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] filter_function = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] glance_api_insecure = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] glance_api_servers = ['http://192.168.122.42/image'] {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] glance_api_ssl_compression = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] glance_ca_certificates_file = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] glance_catalog_info = image:glance:publicURL {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] glance_certfile = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] glance_keyfile = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] glance_num_retries = 3 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] glance_request_timeout = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] goodness_function = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] graceful_shutdown_timeout = 5 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] group_api_class = cinder.group.api.API {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] host = devstack {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] image_compress_on_upload = True {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] image_conversion_address_space_limit = 1 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] image_conversion_cpu_limit = 60 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] image_conversion_disable = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] image_upload_use_cinder_backend = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] image_upload_use_internal_tenant = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] image_volume_cache_enabled = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] image_volume_cache_max_count = 0 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] image_volume_cache_max_size_gb = 0 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] init_host_max_objects_retrieval = 0 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] instance_format = [instance: %(uuid)s] {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] iscsi_target_flags = {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] iscsi_write_cache = on {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] iser_helper = tgtadm {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] iser_ip_address = 192.168.122.42 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] iser_port = 3260 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] log_color = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] log_config_append = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] log_dir = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] log_file = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] log_options = True {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] log_rotate_interval = 1 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] log_rotate_interval_type = days {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] log_rotation_type = none {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] max_age = 0 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] max_logfile_count = 30 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] max_logfile_size_mb = 200 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] max_over_subscription_ratio = 20.0 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] message_reap_interval = 86400 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] message_ttl = 2592000 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] migration_create_volume_timeout_secs = 300 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] monkey_patch = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] monkey_patch_modules = [] {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] my_ip = 192.168.122.42 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] no_snapshot_gb_quota = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] num_iser_scan_tries = 3 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] num_shell_tries = 3 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] num_volume_device_scan_tries = 3 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] nvmeof_conn_info_version = 1 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] nvmet_ns_id = 10 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] nvmet_port_id = 1 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] osapi_max_limit = 1000 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] osapi_volume_ext_list = [] {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] osapi_volume_listen = 0.0.0.0 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] osapi_volume_listen_port = 8776 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] osapi_volume_use_ssl = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] osapi_volume_workers = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] per_volume_size_limit = -1 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] periodic_fuzzy_delay = 60 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] periodic_interval = 60 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] project_id_regex = [0-9a-f\-]+ {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] public_endpoint = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] publish_errors = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] quota_backup_gigabytes = 1000 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] quota_backups = 10 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] quota_gigabytes = 1000 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] quota_groups = 10 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] quota_snapshots = 10 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] quota_volumes = 10 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] rate_limit_burst = 0 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] rate_limit_except_level = CRITICAL {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] rate_limit_interval = 0 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] reinit_driver_count = 3 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] replication_device = **** {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] report_discard_supported = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] report_interval = 120 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] reservation_clean_interval = 86400 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] reservation_expire = 86400 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] reserved_image_namespaces = [] {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] reserved_percentage = 0 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] rpc_response_timeout = 120 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] run_external_periodic_tasks = True {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] scst_target_driver = iscsi {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] scst_target_iqn_name = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] service_down_time = 720 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] shell_completion = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] snapshot_name_template = snapshot-%s {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] snapshot_same_host = True {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] split_loggers = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] state_path = /opt/stack/data/cinder {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] storage_availability_zone = nova {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] storage_protocol = iSCSI {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] syslog_log_facility = LOG_USER {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] target_helper = lioadm {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] target_ip_address = 192.168.122.42 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] target_port = 3260 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] target_protocol = iscsi {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] target_secondary_ip_addresses = [] {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] trace_flags = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] transfer_api_class = cinder.transfer.api.API {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] transport_url = **** {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75769]: INFO cinder.volume.manager [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 08 01:23:22 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] until_refresh = 0 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] use_chap_auth = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] use_default_quota_class = True {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] use_journal = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] use_json = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] use_multipath_for_image_xfer = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] use_stderr = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] use_syslog = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] verify_glance_signatures = enabled {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] volume_api_class = cinder.volume.api.API {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] volume_backend_name = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] volume_clear = zero {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] volume_clear_ionice = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] volume_clear_size = 0 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] volume_copy_bps_limit = 0 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] volume_dd_blocksize = 1M {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] volume_name_template = volume-%s {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] volume_service_inithost_offload = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] volume_usage_audit_period = month {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] zoning_mode = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_concurrency.disable_process_locking = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] keystone_authtoken.auth_section = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] keystone_authtoken.auth_type = password {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] keystone_authtoken.auth_version = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] keystone_authtoken.cache = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] keystone_authtoken.certfile = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] keystone_authtoken.delay_auth_decision = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] keystone_authtoken.http_connect_timeout = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] keystone_authtoken.include_service_catalog = True {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] keystone_authtoken.insecure = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] keystone_authtoken.interface = public {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] keystone_authtoken.keyfile = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] keystone_authtoken.memcache_password = {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:22 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] keystone_authtoken.memcache_username = {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] keystone_authtoken.region_name = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] keystone_authtoken.service_token_roles_required = True {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] keystone_authtoken.service_type = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] keystone_authtoken.token_cache_time = 300 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.42/identity {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cache.backend = dogpile.cache.null {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cache.backend_argument = **** {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cache.backend_expiration_time = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cache.config_prefix = cache.oslo {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cache.debug_cache_backend = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cache.enable_retry_client = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cache.enable_socket_keepalive = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cache.enabled = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cache.expiration_time = 600 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cache.hashclient_retry_attempts = 2 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cache.memcache_dead_retry = 300 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cache.memcache_pool_maxsize = 10 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cache.memcache_sasl_enabled = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cache.password = **** {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cache.proxies = [] {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cache.redis_db = 0 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cache.redis_sentinel_service_name = mymaster {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cache.redis_server = localhost:6379 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cache.retry_attempts = 2 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cache.retry_delay = 0.0 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cache.socket_keepalive_count = 1 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cache.socket_keepalive_idle = 1 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cache.socket_keepalive_interval = 1 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cache.socket_timeout = 1.0 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cache.tls_allowed_ciphers = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cache.tls_cafile = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cache.tls_certfile = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cache.tls_enabled = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cache.tls_keyfile = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cache.username = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] coordination.backend_url = **** {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] database.asyncio_connection = **** {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] database.asyncio_slave_connection = **** {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] database.backend = sqlalchemy {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] database.connection = **** {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] database.connection_debug = 0 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] database.connection_parameters = {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] database.connection_recycle_time = 3600 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] database.connection_trace = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] database.db_inc_retry_interval = True {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] database.db_max_retries = 20 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] database.db_max_retry_interval = 10 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] database.db_retry_interval = 1 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] database.max_overflow = 50 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] database.max_pool_size = 5 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] database.max_retries = 10 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] database.mysql_wsrep_sync_wait = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] database.pool_timeout = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.043s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] database.retry_interval = 10 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] database.slave_connection = **** {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] database.sqlite_synchronous = True {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] database.synchronous_reader = True {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] database.use_db_reconnect = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] profiler.connection_string = messaging:// {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] profiler.enabled = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] profiler.es_doc_type = notification {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] profiler.es_scroll_size = 10000 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] profiler.es_scroll_time = 2m {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] profiler.filter_error_trace = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] profiler.hmac_keys = **** {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] profiler.sentinel_service_name = mymaster {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] profiler.socket_timeout = 0.1 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] profiler.trace_requests = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] profiler.trace_sqlalchemy = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] profiler_jaeger.process_tags = {} {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] profiler_jaeger.service_name_prefix = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] profiler_otlp.service_name_prefix = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_policy.enforce_new_defaults = True {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_policy.enforce_scope = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_policy.policy_default_rule = default {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_policy.policy_file = policy.yaml {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_policy.remote_timeout = 60.0 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] privsep_osbrick.group = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] privsep_osbrick.helper_command = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] privsep_osbrick.user = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cinder_sys_admin.group = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cinder_sys_admin.helper_command = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] cinder_sys_admin.user = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] service_user.auth_section = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] service_user.auth_type = password {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] service_user.cafile = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] service_user.certfile = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] service_user.collect_timing = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] service_user.insecure = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] service_user.keyfile = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] service_user.send_service_user_token = True {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] service_user.split_loggers = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] service_user.timeout = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] glance.auth_section = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] glance.auth_type = password {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] glance.certfile = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] glance.collect_timing = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] glance.insecure = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] glance.keyfile = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] glance.region_name = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] glance.split_loggers = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] glance.timeout = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.backend_availability_zone = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.chap_password = **** {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.chap_username = {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.disk_geometry = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.driver_client_cert = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.driver_client_cert_key = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.driver_data_namespace = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.driver_use_ssl = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.enable_unsupported_driver = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.extra_capabilities = {} {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.filter_function = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.goodness_function = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.iscsi_target_flags = {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.iscsi_write_cache = on {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.iser_helper = tgtadm {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.iser_ip_address = 192.168.122.42 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.iser_port = 3260 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.lvm_mirrors = 0 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.lvm_share_target = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.lvm_type = auto {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.num_shell_tries = 3 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.nvmet_port_id = 1 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.replication_device = **** {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.report_discard_supported = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.reserved_percentage = 0 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.scst_target_driver = iscsi {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.scst_target_iqn_name = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.storage_protocol = iSCSI {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.target_helper = tgtadm {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.target_ip_address = 192.168.122.42 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack sudo[75774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.target_port = 3260 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.target_protocol = iscsi {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.trace_flags = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.unique_fqdn_network = True {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack sudo[75774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.use_chap_auth = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.volume_backend_name = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.volume_clear = zero {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.volume_clear_ionice = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.volume_clear_size = 0 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.volume_group = cinder-volumes {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_reports.file_event_handler = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_reports.log_dir = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.backend_availability_zone = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.backend_host = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.chap_password = **** {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.chap_username = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.chiscsi_conf = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.disk_geometry = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.driver_client_cert = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.driver_data_namespace = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.driver_use_ssl = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.extra_capabilities = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.filter_function = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.goodness_function = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.iser_helper = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.iser_ip_address = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.iser_port = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.iser_target_prefix = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.lvm_conf_file = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.lvm_mirrors = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.lvm_share_target = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.lvm_type = auto {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.num_shell_tries = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.nvmet_port_id = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.replication_device = **** {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.report_discard_supported = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.reserved_percentage = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.scst_target_driver = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.storage_protocol = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.target_helper = lioadm {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.target_ip_address = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.target_port = 3260 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.target_protocol = iscsi {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.trace_flags = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.use_chap_auth = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.volume_clear = zero {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.volume_clear_size = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] lvmdriver-1.volumes_dir = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:22 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_rabbit.ssl = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_rabbit.ssl_version = {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_notifications.driver = [] {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_notifications.retry = -1 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] oslo_messaging_notifications.transport_url = **** {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] key_manager.fixed_key = **** {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] barbican.barbican_api_version = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] barbican.barbican_endpoint = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] barbican.barbican_endpoint_type = public {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] barbican.barbican_region_name = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] barbican.cafile = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] barbican.certfile = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] barbican.collect_timing = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] barbican.insecure = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] barbican.keyfile = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] barbican.number_of_retries = 60 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] barbican.retry_delay = 1 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] barbican.send_service_user_token = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] barbican.split_loggers = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] barbican.timeout = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] barbican.verify_ssl = True {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] barbican.verify_ssl_path = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] barbican_service_user.auth_section = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] barbican_service_user.auth_type = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] barbican_service_user.cafile = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] barbican_service_user.certfile = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] barbican_service_user.collect_timing = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] barbican_service_user.insecure = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] barbican_service_user.keyfile = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] barbican_service_user.split_loggers = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] barbican_service_user.timeout = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] vault.approle_role_id = **** {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] vault.approle_secret_id = **** {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] vault.kv_mountpoint = secret {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] vault.kv_path = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] vault.kv_version = 2 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] vault.namespace = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] vault.root_token_id = **** {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] vault.ssl_ca_crt_file = None {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] vault.timeout = 60.0 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] vault.use_ssl = False {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:23:23 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] ******************************************************************************** {{(pid=75606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 01:23:23 devstack sudo[75774]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:23 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.767s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:23 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:23 devstack sudo[75960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 01:23:23 devstack sudo[75960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:24 devstack sudo[75960]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:24 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.765s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:24 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:23:24 devstack cinder-volume[75769]: INFO cinder.brick.local_dev.lvm [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 08 01:23:24 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:24 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:24 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:24 devstack sudo[76222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 01:23:24 devstack sudo[76222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:25 devstack sudo[76222]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:25 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.800s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:25 devstack cinder-volume[75769]: DEBUG cinder.brick.local_dev.lvm [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75769) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 08 01:23:25 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:25 devstack sudo[76352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 01:23:25 devstack sudo[76352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:26 devstack sudo[76352]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:26 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.119s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:26 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:26 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:26 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:26 devstack sudo[76553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 01:23:26 devstack sudo[76553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:27 devstack sudo[76553]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:27 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.724s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:27 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:27 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:27 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:27 devstack sudo[76559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 08 01:23:27 devstack sudo[76559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:27 devstack sudo[76559]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:27 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.844s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:27 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:28 devstack sudo[76562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 01:23:28 devstack sudo[76562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:28 devstack sudo[76562]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:28 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.744s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:28 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:28 devstack sudo[76574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 01:23:28 devstack sudo[76574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:29 devstack sudo[76574]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:29 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.856s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:29 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:29 devstack sudo[76578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:23:29 devstack sudo[76578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:30 devstack sudo[76578]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:30 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.853s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:30 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:30 devstack sudo[76588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 01:23:30 devstack sudo[76588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:31 devstack sudo[76588]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:31 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.696s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:31 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:31 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:31 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:31 devstack sudo[76592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 01:23:31 devstack sudo[76592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:31 devstack sudo[76592]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:31 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.817s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:31 devstack cinder-volume[75769]: INFO cinder.volume.drivers.lvm [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 08 01:23:31 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:32 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:32 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:32 devstack sudo[76681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 01:23:32 devstack sudo[76681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:32 devstack cinder-volume[75606]: DEBUG dbcounter [-] [75606] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:23:32 devstack sudo[76681]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:32 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.742s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:32 devstack cinder-volume[75769]: DEBUG cinder.volume.drivers.lvm [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Updating volume stats {{(pid=75769) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 01:23:32 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:32 devstack sudo[76768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 01:23:32 devstack sudo[76768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:33 devstack sudo[76768]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:33 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.681s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:33 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:33 devstack sudo[76860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:23:33 devstack sudo[76860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:34 devstack sudo[76860]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:34 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.647s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:34 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:34 devstack sudo[76864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 01:23:34 devstack sudo[76864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:34 devstack sudo[76864]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:34 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.669s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:34 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:34 devstack sudo[76867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:23:34 devstack sudo[76867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:35 devstack sudo[76867]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:35 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.781s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:35 devstack cinder-volume[75769]: INFO cinder.volume.driver [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Driver hasn't implemented _init_vendor_properties() Jul 08 01:23:35 devstack cinder-volume[75769]: DEBUG cinder.volume.driver [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75769) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 01:23:35 devstack cinder-volume[75769]: DEBUG oslo_db.sqlalchemy.engines [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75769) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:23:35 devstack cinder-volume[75769]: DEBUG dbcounter [-] [75769] Writer thread running {{(pid=75769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 01:23:35 devstack cinder-volume[75769]: DEBUG cinder.db.api [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Building query based on filter {{(pid=75769) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 01:23:35 devstack cinder-volume[75769]: DEBUG cinder.image.image_utils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75769) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 01:23:35 devstack cinder-volume[75769]: INFO cinder.keymgr.migration [None req-52a0deaa-2e98-4420-b105-57a8daed5754 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 01:23:35 devstack cinder-volume[75769]: DEBUG cinder.volume.drivers.lvm [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Updating volume stats {{(pid=75769) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 01:23:35 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:35 devstack sudo[76875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 01:23:35 devstack sudo[76875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:36 devstack sudo[76875]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:36 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.724s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:36 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:36 devstack sudo[76878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:23:36 devstack sudo[76878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:37 devstack sudo[76878]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:37 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.663s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:37 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:37 devstack sudo[76881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 01:23:37 devstack sudo[76881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:37 devstack sudo[76881]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:37 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.692s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:37 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:37 devstack sudo[76885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:23:37 devstack sudo[76885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:38 devstack sudo[76885]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:38 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.716s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:38 devstack cinder-volume[75769]: DEBUG cinder.manager [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Notifying Schedulers of capabilities ... {{(pid=75769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:23:38 devstack cinder-volume[75769]: INFO cinder.volume.manager [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Driver initialization completed successfully. Jul 08 01:23:38 devstack cinder-volume[75769]: INFO cinder.manager [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Initiating service 2 cleanup Jul 08 01:23:38 devstack cinder-volume[75769]: INFO cinder.manager [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Service 2 cleanup completed. Jul 08 01:23:38 devstack cinder-volume[75769]: DEBUG cinder.service [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Creating RPC server for service cinder-volume {{(pid=75769) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 01:23:38 devstack cinder-volume[75769]: DEBUG cinder.service [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75769) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 01:23:38 devstack cinder-volume[75769]: INFO cinder.volume.manager [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 08 01:23:38 devstack cinder-volume[75769]: DEBUG cinder.volume.drivers.lvm [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Updating volume stats {{(pid=75769) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 01:23:38 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:38 devstack sudo[76889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 01:23:38 devstack sudo[76889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:39 devstack sudo[76889]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:39 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.767s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:39 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:39 devstack sudo[76895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:23:39 devstack sudo[76895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:40 devstack sudo[76895]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:40 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.722s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:40 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:40 devstack sudo[76952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 01:23:40 devstack sudo[76952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:40 devstack sudo[76952]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:40 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.720s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:40 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:40 devstack sudo[76955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:23:40 devstack sudo[76955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:41 devstack sudo[76955]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:41 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.673s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:41 devstack cinder-volume[75769]: INFO cinder.volume.manager [None req-8caf81d6-70a3-4083-b3b3-8e5546df50f0 None None] Driver post RPC initialization completed successfully. Jul 08 01:23:48 devstack cinder-volume[75769]: DEBUG dbcounter [-] [75769] Writing DB stats cinder:SELECT=4 {{(pid=75769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:23:51 devstack cinder-volume[75769]: DEBUG dbcounter [-] [75769] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:24:37 devstack cinder-volume[75769]: DEBUG oslo_service.periodic_task [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:24:37 devstack cinder-volume[75769]: DEBUG cinder.volume.drivers.lvm [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] Updating volume stats {{(pid=75769) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 01:24:37 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:37 devstack sudo[78642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 01:24:37 devstack sudo[78642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:38 devstack sudo[78642]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:38 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.800s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:38 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:38 devstack sudo[78663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:24:38 devstack sudo[78663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:39 devstack sudo[78663]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:39 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.673s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:39 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:39 devstack sudo[78666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 01:24:39 devstack sudo[78666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:39 devstack sudo[78666]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:39 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.647s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:39 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:39 devstack sudo[78669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:24:39 devstack sudo[78669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:40 devstack sudo[78669]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:40 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.669s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:40 devstack cinder-volume[75769]: DEBUG cinder.manager [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] Notifying Schedulers of capabilities ... {{(pid=75769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:24:40 devstack cinder-volume[75769]: DEBUG oslo_service.periodic_task [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] Running periodic task VolumeManager._thread_info {{(pid=75769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:24:40 devstack cinder-volume[75769]: DEBUG cinder.volume.manager [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] thread count: 6 {{(pid=75769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:24:40 devstack cinder-volume[75769]: DEBUG cinder.volume.manager [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] thread info: [<_MainThread(MainThread, started 125747152851072)>, , , , , ] {{(pid=75769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:25:37 devstack cinder-volume[75769]: DEBUG oslo_service.periodic_task [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:25:37 devstack cinder-volume[75769]: DEBUG cinder.volume.drivers.lvm [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] Updating volume stats {{(pid=75769) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 01:25:37 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:37 devstack sudo[82335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 01:25:37 devstack sudo[82335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:38 devstack sudo[82335]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:38 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.665s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:38 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:38 devstack sudo[82340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:25:38 devstack sudo[82340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:38 devstack sudo[82340]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:38 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:38 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:38 devstack sudo[82348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 01:25:38 devstack sudo[82348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:39 devstack sudo[82348]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:39 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.648s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:39 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:39 devstack sudo[82358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:25:39 devstack sudo[82358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:40 devstack sudo[82358]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:40 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.680s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:40 devstack cinder-volume[75769]: DEBUG cinder.manager [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] Notifying Schedulers of capabilities ... {{(pid=75769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:25:51 devstack cinder-volume[75769]: DEBUG dbcounter [-] [75769] Writing DB stats cinder:SELECT=1 {{(pid=75769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:25:51 devstack cinder-volume[75769]: DEBUG dbcounter [-] [75769] Writing DB stats cinder:UPDATE=1 {{(pid=75769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:26:37 devstack cinder-volume[75769]: DEBUG oslo_service.periodic_task [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:26:37 devstack cinder-volume[75769]: DEBUG cinder.volume.drivers.lvm [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] Updating volume stats {{(pid=75769) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 01:26:37 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:37 devstack sudo[84181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 01:26:37 devstack sudo[84181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:38 devstack sudo[84181]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:38 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.694s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:38 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:38 devstack sudo[84194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:26:38 devstack sudo[84194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:38 devstack sudo[84194]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:38 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.672s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:38 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:38 devstack sudo[84226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 01:26:38 devstack sudo[84226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:39 devstack sudo[84226]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:39 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.649s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:39 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:39 devstack sudo[84245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:26:39 devstack sudo[84245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:40 devstack sudo[84245]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:40 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.665s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:40 devstack cinder-volume[75769]: DEBUG cinder.manager [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] Notifying Schedulers of capabilities ... {{(pid=75769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:26:40 devstack cinder-volume[75769]: DEBUG oslo_service.periodic_task [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] Running periodic task VolumeManager._thread_info {{(pid=75769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:26:40 devstack cinder-volume[75769]: DEBUG cinder.volume.manager [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] thread count: 6 {{(pid=75769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:26:40 devstack cinder-volume[75769]: DEBUG cinder.volume.manager [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] thread info: [<_MainThread(MainThread, started 125747152851072)>, , , , , ] {{(pid=75769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:27:37 devstack cinder-volume[75769]: DEBUG oslo_service.periodic_task [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:27:37 devstack cinder-volume[75769]: DEBUG cinder.volume.drivers.lvm [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] Updating volume stats {{(pid=75769) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 01:27:37 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:37 devstack sudo[85501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 01:27:37 devstack sudo[85501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:38 devstack sudo[85501]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:38 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.669s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:38 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:38 devstack sudo[85504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:27:38 devstack sudo[85504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:38 devstack sudo[85504]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:38 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.707s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:38 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:39 devstack sudo[85510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 01:27:39 devstack sudo[85510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:39 devstack sudo[85510]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:39 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.695s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:39 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:39 devstack sudo[85513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:27:39 devstack sudo[85513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:40 devstack sudo[85513]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:40 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.722s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:40 devstack cinder-volume[75769]: DEBUG cinder.manager [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] Notifying Schedulers of capabilities ... {{(pid=75769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:27:40 devstack cinder-volume[75769]: DEBUG oslo_service.periodic_task [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] Running periodic task VolumeManager._thread_info {{(pid=75769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:27:40 devstack cinder-volume[75769]: DEBUG cinder.volume.manager [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] thread count: 6 {{(pid=75769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:27:40 devstack cinder-volume[75769]: DEBUG cinder.volume.manager [None req-3b4839aa-fd35-4fda-9da1-6873cb665879 None None] thread info: [<_MainThread(MainThread, started 125747152851072)>, , , , , ] {{(pid=75769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:27:51 devstack cinder-volume[75769]: DEBUG dbcounter [-] [75769] Writing DB stats cinder:SELECT=1 {{(pid=75769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:27:51 devstack cinder-volume[75769]: DEBUG dbcounter [-] [75769] Writing DB stats cinder:UPDATE=1 {{(pid=75769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:28:09 devstack cinder-volume[75606]: INFO oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] Caught SIGTERM, stopping children Jul 08 01:28:09 devstack cinder-volume[75606]: DEBUG oslo_concurrency.lockutils [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] Acquiring lock "singleton_lock" {{(pid=75606) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 01:28:09 devstack cinder-volume[75606]: DEBUG oslo_concurrency.lockutils [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] Acquired lock "singleton_lock" {{(pid=75606) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 01:28:09 devstack cinder-volume[75606]: DEBUG oslo_concurrency.lockutils [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] Releasing lock "singleton_lock" {{(pid=75606) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 01:28:09 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] Stop services. {{(pid=75606) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 08 01:28:09 devstack cinder-volume[75606]: DEBUG oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] Killing children. {{(pid=75606) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 08 01:28:09 devstack cinder-volume[75606]: INFO oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] Waiting on 1 children to exit Jul 08 01:28:13 devstack cinder-volume[75769]: DEBUG oslo_concurrency.lockutils [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] Acquiring lock "singleton_lock" {{(pid=75769) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 01:28:13 devstack cinder-volume[75769]: DEBUG oslo_concurrency.lockutils [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] Acquired lock "singleton_lock" {{(pid=75769) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 01:28:13 devstack cinder-volume[75769]: DEBUG oslo_concurrency.lockutils [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] Releasing lock "singleton_lock" {{(pid=75769) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 01:28:13 devstack cinder-volume[75769]: WARNING amqp [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 01:28:13 devstack cinder-volume[75769]: WARNING amqp [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 01:28:13 devstack cinder-volume[75606]: INFO oslo_service.backend._eventlet.service [None req-f5de97f4-867c-44ad-952d-0695e44d2fad None None] Child 75769 exited with status 0 Jul 08 01:28:14 devstack cinder-volume[86346]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 01:28:14 devstack cinder-volume[86346]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 01:28:14 devstack cinder-volume[86346]: we strongly recommend against using it for new projects. Jul 08 01:28:14 devstack cinder-volume[86346]: If you are already using Eventlet, we recommend migrating to a different Jul 08 01:28:14 devstack cinder-volume[86346]: framework. For more detail see Jul 08 01:28:14 devstack cinder-volume[86346]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 01:28:14 devstack cinder-volume[86346]: import eventlet # noqa Jul 08 01:28:16 devstack cinder-volume[86346]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86346) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 01:28:16 devstack cinder-volume[86346]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86346) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 01:28:16 devstack cinder-volume[86346]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86346) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 01:28:17 devstack cinder-volume[86346]: INFO dbcounter [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] Registered counter for database cinder Jul 08 01:28:17 devstack cinder-volume[86346]: DEBUG oslo_db.sqlalchemy.engines [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86346) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:28:17 devstack cinder-volume[86346]: DEBUG dbcounter [-] [86346] Writer thread running {{(pid=86346) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 01:28:17 devstack cinder-volume[86346]: INFO cinder.rpc [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 01:28:17 devstack cinder-volume[86346]: INFO cinder.rpc [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 01:28:17 devstack cinder-volume[86346]: DEBUG oslo_db.sqlalchemy.engines [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86346) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:28:17 devstack cinder-volume[86346]: INFO cinder.volume.manager [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] Determined volume DB was empty at startup. Jul 08 01:28:17 devstack cinder-volume[86346]: DEBUG cinder.volume.manager [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86346) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 01:28:17 devstack cinder-volume[86346]: INFO cinder.volume.manager [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 08 01:28:17 devstack cinder-volume[86346]: WARNING stevedore.named [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 01:28:17 devstack cinder-volume[86346]: WARNING castellan.key_manager [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 01:28:17 devstack cinder-volume[86346]: WARNING cinder.keymgr.conf_key_mgr [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 01:28:17 devstack cinder-volume[86346]: INFO cinder.volume.manager [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 08 01:28:17 devstack cinder-volume[86346]: DEBUG oslo_db.sqlalchemy.engines [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86346) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:28:18 devstack cinder-volume[86346]: INFO oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] Starting 1 workers Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] Started child 86663 {{(pid=86346) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] Full set of CONF: {{(pid=86346) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] ******************************************************************************** {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] Configuration options gathered from: {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] ================================================================================ {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] allow_availability_zone_fallback = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] allow_compression_on_image_upload = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] allowed_direct_url_schemes = [] {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] api_rate_limit = True {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] auth_strategy = keystone {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_availability_zone = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_host = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_name = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_stats_polling_interval = 60 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backup_api_class = cinder.backup.api.API {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backup_name_template = backup-%s {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backup_use_same_host = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backup_use_temp_snapshot = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] chap_password = **** {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] chap_username = {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cinder_internal_tenant_project_id = 3f654e14c4744630ad01304f23a5710e {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cinder_internal_tenant_user_id = 58298c47bc0c4b59bcf2b7f51a34919e {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cluster = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] compression_format = gzip {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] compute_api_class = cinder.compute.nova.API {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] config_dir = [] {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] config_source = [] {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] control_exchange = openstack {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] debug = True {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] default_availability_zone = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] default_group_type = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] default_volume_type = QuobyteHD {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] disk_geometry = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] driver_client_cert = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] driver_client_cert_key = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] driver_data_namespace = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] driver_ssl_cert_path = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] driver_ssl_cert_verify = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] driver_use_ssl = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] enable_new_services = True {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] enable_unsupported_driver = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] enabled_backends = ['QuobyteHD'] {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] enforce_multipath_for_image_xfer = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] filter_function = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86663]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] glance_api_insecure = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] glance_api_servers = ['http://192.168.122.42/image'] {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] glance_api_ssl_compression = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] glance_ca_certificates_file = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] glance_catalog_info = image:glance:publicURL {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] glance_certfile = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] glance_keyfile = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] glance_num_retries = 3 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] glance_request_timeout = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] goodness_function = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] graceful_shutdown_timeout = 5 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] group_api_class = cinder.group.api.API {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] host = devstack {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] image_compress_on_upload = True {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] image_conversion_address_space_limit = 1 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] image_conversion_cpu_limit = 60 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] image_conversion_disable = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] image_upload_use_cinder_backend = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] image_upload_use_internal_tenant = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] image_volume_cache_enabled = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] image_volume_cache_max_count = 0 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] image_volume_cache_max_size_gb = 0 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] init_host_max_objects_retrieval = 0 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] instance_format = [instance: %(uuid)s] {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] iscsi_target_flags = {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] iscsi_write_cache = on {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] iser_helper = tgtadm {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] iser_ip_address = 192.168.122.42 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] iser_port = 3260 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] log_color = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] log_config_append = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] log_dir = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] log_file = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] log_options = True {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] log_rotate_interval = 1 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] log_rotate_interval_type = days {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] log_rotation_type = none {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] max_age = 0 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] max_logfile_count = 30 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] max_logfile_size_mb = 200 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] max_over_subscription_ratio = 20.0 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] message_reap_interval = 86400 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] message_ttl = 2592000 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] migration_create_volume_timeout_secs = 300 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] monkey_patch = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] monkey_patch_modules = [] {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] my_ip = 192.168.122.42 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] no_snapshot_gb_quota = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] num_iser_scan_tries = 3 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] num_shell_tries = 3 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] num_volume_device_scan_tries = 3 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] nvmeof_conn_info_version = 1 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] nvmet_ns_id = 10 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] nvmet_port_id = 1 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] osapi_max_limit = 1000 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] osapi_volume_ext_list = [] {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] osapi_volume_listen_port = 8776 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] osapi_volume_use_ssl = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] osapi_volume_workers = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] per_volume_size_limit = -1 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] periodic_fuzzy_delay = 60 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] periodic_interval = 60 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] public_endpoint = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] publish_errors = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] quota_backup_gigabytes = 1000 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] quota_backups = 10 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] quota_gigabytes = 1000 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] quota_groups = 10 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] quota_snapshots = 10 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] quota_volumes = 10 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] rate_limit_burst = 0 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] rate_limit_except_level = CRITICAL {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] rate_limit_interval = 0 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] reinit_driver_count = 3 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] replication_device = **** {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] report_discard_supported = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] report_interval = 120 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] reservation_clean_interval = 86400 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] reservation_expire = 86400 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] reserved_image_namespaces = [] {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] reserved_percentage = 0 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] rpc_response_timeout = 120 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] run_external_periodic_tasks = True {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] scst_target_driver = iscsi {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] scst_target_iqn_name = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86663]: INFO cinder.volume.manager [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] Starting volume driver QuobyteDriver (1.1.14) Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] service_down_time = 720 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86663]: DEBUG cinder.volume.drivers.remotefs [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86663) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] shell_completion = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] snapshot_name_template = snapshot-%s {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] split_loggers = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] state_path = /opt/stack/data/cinder {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] storage_availability_zone = nova {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] storage_protocol = iSCSI {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] syslog_log_facility = LOG_USER {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] target_helper = lioadm {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] target_ip_address = 192.168.122.42 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] target_port = 3260 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] target_protocol = iscsi {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] target_secondary_ip_addresses = [] {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] trace_flags = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] transport_url = **** {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] until_refresh = 0 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] use_chap_auth = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] use_default_quota_class = True {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] use_journal = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] use_json = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] use_multipath_for_image_xfer = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] use_stderr = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] use_syslog = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] verify_glance_signatures = enabled {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] volume_api_class = cinder.volume.api.API {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] volume_backend_name = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] volume_clear = zero {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] volume_clear_ionice = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] volume_clear_size = 0 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] volume_copy_bps_limit = 0 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] volume_dd_blocksize = 1M {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] volume_name_template = volume-%s {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] volume_service_inithost_offload = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] volume_usage_audit_period = month {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] zoning_mode = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_concurrency.disable_process_locking = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] keystone_authtoken.auth_section = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] keystone_authtoken.auth_type = password {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] keystone_authtoken.auth_version = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] keystone_authtoken.cache = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] keystone_authtoken.certfile = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] keystone_authtoken.include_service_catalog = True {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] keystone_authtoken.insecure = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] keystone_authtoken.interface = public {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] keystone_authtoken.keyfile = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] keystone_authtoken.memcache_password = {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] keystone_authtoken.memcache_username = {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] keystone_authtoken.region_name = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] keystone_authtoken.service_type = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.42/identity {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cache.backend = dogpile.cache.null {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cache.backend_argument = **** {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cache.backend_expiration_time = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cache.config_prefix = cache.oslo {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cache.debug_cache_backend = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cache.enable_retry_client = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cache.enable_socket_keepalive = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cache.enabled = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cache.expiration_time = 600 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cache.hashclient_retry_attempts = 2 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cache.memcache_dead_retry = 300 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cache.memcache_pool_maxsize = 10 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cache.memcache_sasl_enabled = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cache.password = **** {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cache.proxies = [] {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cache.redis_db = 0 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cache.redis_server = localhost:6379 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cache.retry_attempts = 2 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cache.retry_delay = 0.0 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cache.socket_keepalive_count = 1 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cache.socket_keepalive_idle = 1 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cache.socket_keepalive_interval = 1 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cache.socket_timeout = 1.0 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cache.tls_allowed_ciphers = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cache.tls_cafile = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cache.tls_certfile = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cache.tls_enabled = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cache.tls_keyfile = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cache.username = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] coordination.backend_url = **** {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] database.asyncio_connection = **** {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] database.asyncio_slave_connection = **** {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] database.backend = sqlalchemy {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] database.connection = **** {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] database.connection_debug = 0 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] database.connection_parameters = {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] database.connection_recycle_time = 3600 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] database.connection_trace = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] database.db_inc_retry_interval = True {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] database.db_max_retries = 20 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] database.db_max_retry_interval = 10 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] database.db_retry_interval = 1 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] database.max_overflow = 50 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] database.max_pool_size = 5 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] database.max_retries = 10 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] database.mysql_wsrep_sync_wait = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] database.pool_timeout = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] database.retry_interval = 10 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86663]: DEBUG cinder.volume.drivers.quobyte [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86663) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] database.slave_connection = **** {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86663]: WARNING cinder.volume.drivers.quobyte [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] database.sqlite_synchronous = True {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] database.synchronous_reader = True {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] database.use_db_reconnect = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86663]: WARNING cinder.volume.drivers.quobyte [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86663]: DEBUG oslo_concurrency.processutils [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] Running cmd (subprocess): mount.quobyte {{(pid=86663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] profiler.connection_string = messaging:// {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] profiler.enabled = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] profiler.es_doc_type = notification {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] profiler.es_scroll_size = 10000 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] profiler.es_scroll_time = 2m {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] profiler.filter_error_trace = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] profiler.hmac_keys = **** {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] profiler.sentinel_service_name = mymaster {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] profiler.socket_timeout = 0.1 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] profiler.trace_requests = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] profiler.trace_sqlalchemy = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] profiler_jaeger.process_tags = {} {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] profiler_jaeger.service_name_prefix = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] profiler_otlp.service_name_prefix = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_policy.enforce_new_defaults = True {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_policy.enforce_scope = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_policy.policy_default_rule = default {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_policy.policy_file = policy.yaml {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] privsep_osbrick.group = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] privsep_osbrick.helper_command = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] privsep_osbrick.user = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cinder_sys_admin.group = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cinder_sys_admin.helper_command = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] cinder_sys_admin.user = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] service_user.auth_section = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] service_user.auth_type = password {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] service_user.cafile = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] service_user.certfile = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] service_user.collect_timing = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] service_user.insecure = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] service_user.keyfile = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] service_user.send_service_user_token = True {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] service_user.split_loggers = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] service_user.timeout = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] glance.auth_section = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] glance.auth_type = password {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] glance.certfile = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] glance.collect_timing = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] glance.insecure = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] glance.keyfile = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] glance.region_name = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] glance.split_loggers = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] glance.timeout = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.backend_availability_zone = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.chap_password = **** {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.chap_username = {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.disk_geometry = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.driver_client_cert = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.driver_client_cert_key = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.driver_data_namespace = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.driver_use_ssl = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.extra_capabilities = {} {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.filter_function = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.goodness_function = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.iscsi_target_flags = {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.iscsi_write_cache = on {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.iser_helper = tgtadm {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.iser_ip_address = 192.168.122.42 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.iser_port = 3260 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.nas_host = {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.nas_login = admin {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.nas_mount_options = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.nas_password = **** {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.nas_private_key = {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.nas_share_path = {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.num_shell_tries = 3 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.quobyte_volume_url = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.replication_device = **** {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.report_discard_supported = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.reserved_percentage = 0 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.target_helper = tgtadm {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.target_ip_address = 192.168.122.42 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.target_port = 3260 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.target_protocol = iscsi {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.trace_flags = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.unique_fqdn_network = True {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.use_chap_auth = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.volume_backend_name = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.volume_clear = zero {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.volume_clear_ionice = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.volume_clear_size = 0 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_reports.file_event_handler = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_reports.log_dir = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.backend_availability_zone = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.backend_host = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.chap_password = **** {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.chap_username = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.chiscsi_conf = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.disk_geometry = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.driver_client_cert = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack quobyte-client[86668]: Reading configuration file: /etc/quobyte/client.cfg Jul 08 01:28:18 devstack quobyte-client[86668]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.driver_data_namespace = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.driver_use_ssl = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86663]: DEBUG oslo_concurrency.processutils [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] CMD "mount.quobyte" returned: 1 in 0.125s {{(pid=86663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.extra_capabilities = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.filter_function = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.goodness_function = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86663]: DEBUG oslo_concurrency.lockutils [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86663]: DEBUG oslo_concurrency.lockutils [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86663]: DEBUG cinder.volume.drivers.quobyte [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=86663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.iser_helper = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.iser_ip_address = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86663]: INFO cinder.volume.drivers.quobyte [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 ... Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.iser_port = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.iser_target_prefix = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.nas_host = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.nas_login = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.nas_mount_options = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.nas_password = **** {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.nas_private_key = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86663]: DEBUG oslo_concurrency.processutils [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 -c /etc/quobyte/client-cinder.cfg {{(pid=86663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.nas_share_path = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.nas_ssh_port = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.num_shell_tries = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.nvmet_port_id = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.replication_device = **** {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.report_discard_supported = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.reserved_percentage = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.scst_target_driver = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.storage_protocol = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.target_helper = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.target_ip_address = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.target_port = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.target_prefix = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.target_protocol = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.trace_flags = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.use_chap_auth = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.volume_clear = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.volume_clear_size = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] QuobyteHD.volumes_dir = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_rabbit.ssl = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack sudo[86675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 -c /etc/quobyte/client-cinder.cfg Jul 08 01:28:18 devstack sudo[86675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_notifications.driver = [] {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_notifications.retry = -1 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] key_manager.fixed_key = **** {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] barbican.barbican_api_version = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] barbican.barbican_endpoint = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] barbican.barbican_endpoint_type = public {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] barbican.barbican_region_name = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] barbican.cafile = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] barbican.certfile = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] barbican.collect_timing = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] barbican.insecure = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] barbican.keyfile = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] barbican.number_of_retries = 60 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] barbican.retry_delay = 1 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] barbican.send_service_user_token = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] barbican.split_loggers = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] barbican.timeout = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] barbican.verify_ssl = True {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] barbican.verify_ssl_path = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] barbican_service_user.auth_section = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] barbican_service_user.auth_type = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] barbican_service_user.cafile = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] barbican_service_user.certfile = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] barbican_service_user.collect_timing = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] barbican_service_user.insecure = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] barbican_service_user.keyfile = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] barbican_service_user.split_loggers = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] barbican_service_user.timeout = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] vault.approle_role_id = **** {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] vault.approle_secret_id = **** {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] vault.kv_mountpoint = secret {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] vault.kv_path = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] vault.kv_version = 2 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] vault.namespace = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] vault.root_token_id = **** {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] vault.ssl_ca_crt_file = None {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] vault.timeout = 60.0 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] vault.use_ssl = False {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:18 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] ******************************************************************************** {{(pid=86346) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 01:28:19 devstack sudo[86675]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:19 devstack cinder-volume[86663]: DEBUG oslo_concurrency.processutils [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.945s {{(pid=86663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:19 devstack cinder-volume[86663]: INFO cinder.volume.drivers.quobyte [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 succeeded Jul 08 01:28:19 devstack cinder-volume[86663]: DEBUG cinder.volume.drivers.quobyte [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=86663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:19 devstack cinder-volume[86663]: DEBUG oslo_concurrency.lockutils [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.968s {{(pid=86663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:19 devstack cinder-volume[86663]: DEBUG oslo_concurrency.processutils [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=86663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:19 devstack sudo[86760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:28:19 devstack sudo[86760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:20 devstack sudo[86760]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:20 devstack cinder-volume[86663]: DEBUG oslo_concurrency.processutils [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.247s {{(pid=86663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:20 devstack cinder-volume[86663]: INFO cinder.volume.driver [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] Driver hasn't implemented _init_vendor_properties() Jul 08 01:28:20 devstack cinder-volume[86663]: DEBUG cinder.volume.driver [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6908683776855, 'free_capacity_gb': 1775.6908683776855, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86663) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 01:28:20 devstack cinder-volume[86663]: DEBUG oslo_db.sqlalchemy.engines [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86663) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:28:20 devstack cinder-volume[86663]: DEBUG dbcounter [-] [86663] Writer thread running {{(pid=86663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 01:28:20 devstack cinder-volume[86663]: DEBUG cinder.db.api [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] Building query based on filter {{(pid=86663) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 01:28:20 devstack cinder-volume[86663]: DEBUG cinder.image.image_utils [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86663) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 01:28:20 devstack cinder-volume[86663]: INFO cinder.keymgr.migration [None req-9614a933-8aa9-4ca8-973d-087a3b2b4781 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 01:28:20 devstack cinder-volume[86663]: DEBUG oslo_concurrency.lockutils [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:20 devstack cinder-volume[86663]: DEBUG oslo_concurrency.lockutils [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:20 devstack cinder-volume[86663]: DEBUG cinder.volume.drivers.quobyte [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=86663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:20 devstack cinder-volume[86663]: DEBUG cinder.volume.drivers.quobyte [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=86663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:20 devstack cinder-volume[86663]: DEBUG oslo_concurrency.lockutils [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:20 devstack cinder-volume[86663]: DEBUG oslo_concurrency.processutils [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=86663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:20 devstack sudo[86884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:28:20 devstack sudo[86884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:21 devstack sudo[86884]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:21 devstack cinder-volume[86663]: DEBUG oslo_concurrency.processutils [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.805s {{(pid=86663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:21 devstack cinder-volume[86663]: DEBUG cinder.manager [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] Notifying Schedulers of capabilities ... {{(pid=86663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:28:21 devstack cinder-volume[86663]: INFO cinder.volume.manager [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] Driver initialization completed successfully. Jul 08 01:28:21 devstack cinder-volume[86663]: INFO cinder.manager [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] Initiating service 3 cleanup Jul 08 01:28:21 devstack cinder-volume[86663]: INFO cinder.manager [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] Service 3 cleanup completed. Jul 08 01:28:21 devstack cinder-volume[86663]: DEBUG cinder.service [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] Creating RPC server for service cinder-volume {{(pid=86663) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 01:28:21 devstack cinder-volume[86663]: DEBUG cinder.service [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86663) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 01:28:21 devstack cinder-volume[86663]: INFO cinder.volume.manager [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 08 01:28:21 devstack cinder-volume[86663]: DEBUG oslo_concurrency.lockutils [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:21 devstack cinder-volume[86663]: DEBUG oslo_concurrency.lockutils [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:21 devstack cinder-volume[86663]: DEBUG cinder.volume.drivers.quobyte [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=86663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:21 devstack cinder-volume[86663]: DEBUG cinder.volume.drivers.quobyte [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=86663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:21 devstack cinder-volume[86663]: DEBUG oslo_concurrency.lockutils [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:21 devstack cinder-volume[86663]: DEBUG oslo_concurrency.processutils [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=86663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:21 devstack sudo[86909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:28:21 devstack sudo[86909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:22 devstack sudo[86909]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:22 devstack cinder-volume[86663]: DEBUG oslo_concurrency.processutils [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.739s {{(pid=86663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:22 devstack cinder-volume[86663]: INFO cinder.volume.manager [None req-544048b5-9b06-4129-8fa2-05d71419ae9e None None] Driver post RPC initialization completed successfully. Jul 08 01:28:24 devstack cinder-volume[86663]: DEBUG oslo_concurrency.lockutils [None req-0eda5918-022e-4c31-9e39-baf814753354 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:24 devstack cinder-volume[86663]: DEBUG oslo_concurrency.lockutils [None req-0eda5918-022e-4c31-9e39-baf814753354 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:24 devstack cinder-volume[86663]: DEBUG cinder.volume.drivers.quobyte [None req-0eda5918-022e-4c31-9e39-baf814753354 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=86663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:24 devstack cinder-volume[86663]: DEBUG cinder.volume.drivers.quobyte [None req-0eda5918-022e-4c31-9e39-baf814753354 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=86663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:24 devstack cinder-volume[86663]: DEBUG oslo_concurrency.lockutils [None req-0eda5918-022e-4c31-9e39-baf814753354 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:24 devstack cinder-volume[86663]: DEBUG oslo_concurrency.processutils [None req-0eda5918-022e-4c31-9e39-baf814753354 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=86663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:24 devstack sudo[86950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:28:24 devstack sudo[86950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:25 devstack sudo[86950]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:25 devstack cinder-volume[86663]: DEBUG oslo_concurrency.processutils [None req-0eda5918-022e-4c31-9e39-baf814753354 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.634s {{(pid=86663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:25 devstack cinder-volume[86663]: DEBUG cinder.manager [None req-0eda5918-022e-4c31-9e39-baf814753354 None None] Notifying Schedulers of capabilities ... {{(pid=86663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:28:26 devstack cinder-volume[86346]: INFO oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] Caught SIGTERM, stopping children Jul 08 01:28:26 devstack cinder-volume[86346]: DEBUG oslo_concurrency.lockutils [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] Acquiring lock "singleton_lock" {{(pid=86346) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 01:28:26 devstack cinder-volume[86346]: DEBUG oslo_concurrency.lockutils [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] Acquired lock "singleton_lock" {{(pid=86346) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 01:28:26 devstack cinder-volume[86346]: DEBUG oslo_concurrency.lockutils [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] Releasing lock "singleton_lock" {{(pid=86346) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 01:28:26 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] Stop services. {{(pid=86346) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 08 01:28:26 devstack cinder-volume[86346]: DEBUG oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] Killing children. {{(pid=86346) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 08 01:28:26 devstack cinder-volume[86346]: INFO oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] Waiting on 1 children to exit Jul 08 01:28:30 devstack cinder-volume[86663]: DEBUG oslo_concurrency.lockutils [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] Acquiring lock "singleton_lock" {{(pid=86663) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 01:28:30 devstack cinder-volume[86663]: DEBUG oslo_concurrency.lockutils [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] Acquired lock "singleton_lock" {{(pid=86663) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 01:28:30 devstack cinder-volume[86663]: DEBUG oslo_concurrency.lockutils [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] Releasing lock "singleton_lock" {{(pid=86663) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 01:28:30 devstack cinder-volume[86663]: WARNING amqp [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 01:28:30 devstack cinder-volume[86663]: WARNING amqp [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 01:28:30 devstack cinder-volume[86346]: INFO oslo_service.backend._eventlet.service [None req-5ea1b777-c935-4af1-ad0e-0795478e64c2 None None] Child 86663 exited with status 0 Jul 08 01:28:30 devstack cinder-volume[87037]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 01:28:30 devstack cinder-volume[87037]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 01:28:30 devstack cinder-volume[87037]: we strongly recommend against using it for new projects. Jul 08 01:28:30 devstack cinder-volume[87037]: If you are already using Eventlet, we recommend migrating to a different Jul 08 01:28:30 devstack cinder-volume[87037]: framework. For more detail see Jul 08 01:28:30 devstack cinder-volume[87037]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 01:28:30 devstack cinder-volume[87037]: import eventlet # noqa Jul 08 01:28:33 devstack cinder-volume[87037]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87037) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 01:28:33 devstack cinder-volume[87037]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87037) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 01:28:33 devstack cinder-volume[87037]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87037) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 01:28:34 devstack cinder-volume[87037]: INFO dbcounter [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] Registered counter for database cinder Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_db.sqlalchemy.engines [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87037) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG dbcounter [-] [87037] Writer thread running {{(pid=87037) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 01:28:34 devstack cinder-volume[87037]: INFO cinder.rpc [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 01:28:34 devstack cinder-volume[87037]: INFO cinder.rpc [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_db.sqlalchemy.engines [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87037) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:28:34 devstack cinder-volume[87037]: INFO cinder.volume.manager [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] Determined volume DB was empty at startup. Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG cinder.volume.manager [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87037) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 01:28:34 devstack cinder-volume[87037]: WARNING stevedore.named [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 01:28:34 devstack cinder-volume[87037]: WARNING castellan.key_manager [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 01:28:34 devstack cinder-volume[87037]: WARNING cinder.keymgr.conf_key_mgr [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 01:28:34 devstack cinder-volume[87037]: INFO cinder.volume.manager [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_db.sqlalchemy.engines [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87037) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:28:34 devstack cinder-volume[87037]: INFO oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] Starting 1 workers Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] Started child 87284 {{(pid=87037) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] Full set of CONF: {{(pid=87037) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] ******************************************************************************** {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] Configuration options gathered from: {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 01:28:34 devstack cinder-volume[87284]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] ================================================================================ {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] allow_availability_zone_fallback = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] allow_compression_on_image_upload = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] allowed_direct_url_schemes = [] {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] api_rate_limit = True {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] auth_strategy = keystone {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_availability_zone = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_host = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_name = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_stats_polling_interval = 60 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backup_api_class = cinder.backup.api.API {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backup_name_template = backup-%s {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backup_use_same_host = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backup_use_temp_snapshot = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] chap_password = **** {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] chap_username = {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cinder_internal_tenant_project_id = 3f654e14c4744630ad01304f23a5710e {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cinder_internal_tenant_user_id = 58298c47bc0c4b59bcf2b7f51a34919e {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cluster = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] compression_format = gzip {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] compute_api_class = cinder.compute.nova.API {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] config_dir = [] {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] config_source = [] {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] control_exchange = openstack {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] debug = True {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] default_availability_zone = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] default_group_type = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] default_volume_type = QuobyteHD {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] disk_geometry = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] driver_client_cert = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] driver_client_cert_key = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] driver_data_namespace = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] driver_ssl_cert_path = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] driver_ssl_cert_verify = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] driver_use_ssl = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] enable_new_services = True {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] enable_unsupported_driver = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] enabled_backends = ['QuobyteHD'] {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] enforce_multipath_for_image_xfer = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] filter_function = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] glance_api_insecure = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] glance_api_servers = ['http://192.168.122.42/image'] {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] glance_api_ssl_compression = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] glance_ca_certificates_file = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] glance_catalog_info = image:glance:publicURL {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] glance_certfile = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] glance_keyfile = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] glance_num_retries = 3 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] glance_request_timeout = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] goodness_function = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] graceful_shutdown_timeout = 5 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] group_api_class = cinder.group.api.API {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] host = devstack {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] image_compress_on_upload = True {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] image_conversion_address_space_limit = 1 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] image_conversion_cpu_limit = 60 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] image_conversion_disable = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-e26df349-37be-4006-b440-ce269fb8586d None None] Starting volume driver QuobyteDriver (1.1.14) Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] image_upload_use_cinder_backend = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-e26df349-37be-4006-b440-ce269fb8586d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87284) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] image_upload_use_internal_tenant = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] image_volume_cache_enabled = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] image_volume_cache_max_count = 0 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] image_volume_cache_max_size_gb = 0 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] init_host_max_objects_retrieval = 0 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] instance_format = [instance: %(uuid)s] {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] iscsi_target_flags = {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] iscsi_write_cache = on {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] iser_helper = tgtadm {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] iser_ip_address = 192.168.122.42 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] iser_port = 3260 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] log_color = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] log_config_append = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] log_dir = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] log_file = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] log_options = True {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] log_rotate_interval = 1 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] log_rotate_interval_type = days {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] log_rotation_type = none {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] max_age = 0 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] max_logfile_count = 30 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] max_logfile_size_mb = 200 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] max_over_subscription_ratio = 20.0 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] message_reap_interval = 86400 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] message_ttl = 2592000 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] migration_create_volume_timeout_secs = 300 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] monkey_patch = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] monkey_patch_modules = [] {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] my_ip = 192.168.122.42 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] no_snapshot_gb_quota = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] num_iser_scan_tries = 3 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] num_shell_tries = 3 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] num_volume_device_scan_tries = 3 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] nvmeof_conn_info_version = 1 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] nvmet_ns_id = 10 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] nvmet_port_id = 1 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] osapi_max_limit = 1000 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] osapi_volume_ext_list = [] {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] osapi_volume_listen_port = 8776 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] osapi_volume_use_ssl = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] osapi_volume_workers = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] per_volume_size_limit = -1 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] periodic_fuzzy_delay = 60 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] periodic_interval = 60 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] public_endpoint = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] publish_errors = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] quota_backup_gigabytes = 1000 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] quota_backups = 10 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] quota_gigabytes = 1000 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] quota_groups = 10 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] quota_snapshots = 10 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] quota_volumes = 10 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] rate_limit_burst = 0 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] rate_limit_except_level = CRITICAL {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] rate_limit_interval = 0 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] reinit_driver_count = 3 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] replication_device = **** {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] report_discard_supported = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] report_interval = 120 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] reservation_clean_interval = 86400 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] reservation_expire = 86400 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] reserved_image_namespaces = [] {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] reserved_percentage = 0 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] rpc_response_timeout = 120 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] run_external_periodic_tasks = True {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] scst_target_driver = iscsi {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] scst_target_iqn_name = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] service_down_time = 720 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] shell_completion = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] snapshot_name_template = snapshot-%s {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] split_loggers = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] state_path = /opt/stack/data/cinder {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] storage_availability_zone = nova {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] storage_protocol = iSCSI {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] syslog_log_facility = LOG_USER {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] target_helper = lioadm {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] target_ip_address = 192.168.122.42 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] target_port = 3260 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] target_protocol = iscsi {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] target_secondary_ip_addresses = [] {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] trace_flags = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] transport_url = **** {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] until_refresh = 0 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] use_chap_auth = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] use_default_quota_class = True {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] use_journal = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] use_json = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] use_multipath_for_image_xfer = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] use_stderr = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] use_syslog = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] verify_glance_signatures = enabled {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] volume_api_class = cinder.volume.api.API {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] volume_backend_name = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] volume_clear = zero {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] volume_clear_ionice = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] volume_clear_size = 0 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] volume_copy_bps_limit = 0 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] volume_dd_blocksize = 1M {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] volume_name_template = volume-%s {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] volume_service_inithost_offload = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] volume_usage_audit_period = month {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] zoning_mode = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_concurrency.disable_process_locking = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] keystone_authtoken.auth_section = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] keystone_authtoken.auth_type = password {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] keystone_authtoken.auth_version = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] keystone_authtoken.cache = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] keystone_authtoken.certfile = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] keystone_authtoken.include_service_catalog = True {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] keystone_authtoken.insecure = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] keystone_authtoken.interface = public {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] keystone_authtoken.keyfile = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] keystone_authtoken.memcache_password = {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] keystone_authtoken.memcache_username = {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] keystone_authtoken.region_name = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] keystone_authtoken.service_type = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.42/identity {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cache.backend = dogpile.cache.null {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cache.backend_argument = **** {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cache.backend_expiration_time = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cache.config_prefix = cache.oslo {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cache.debug_cache_backend = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cache.enable_retry_client = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cache.enable_socket_keepalive = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cache.enabled = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cache.expiration_time = 600 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cache.hashclient_retry_attempts = 2 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cache.memcache_dead_retry = 300 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cache.memcache_pool_maxsize = 10 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cache.memcache_sasl_enabled = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cache.password = **** {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cache.proxies = [] {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cache.redis_db = 0 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cache.redis_server = localhost:6379 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cache.retry_attempts = 2 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cache.retry_delay = 0.0 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cache.socket_keepalive_count = 1 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cache.socket_keepalive_idle = 1 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cache.socket_keepalive_interval = 1 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cache.socket_timeout = 1.0 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cache.tls_allowed_ciphers = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cache.tls_cafile = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cache.tls_certfile = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cache.tls_enabled = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cache.tls_keyfile = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cache.username = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] coordination.backend_url = **** {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] database.asyncio_connection = **** {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] database.asyncio_slave_connection = **** {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] database.backend = sqlalchemy {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e26df349-37be-4006-b440-ce269fb8586d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87284) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] database.connection = **** {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.quobyte [None req-e26df349-37be-4006-b440-ce269fb8586d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 08 01:28:34 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.quobyte [None req-e26df349-37be-4006-b440-ce269fb8586d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] database.connection_debug = 0 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] database.connection_parameters = {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] database.connection_recycle_time = 3600 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] database.connection_trace = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e26df349-37be-4006-b440-ce269fb8586d None None] Running cmd (subprocess): mount.quobyte {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] database.db_inc_retry_interval = True {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] database.db_max_retries = 20 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] database.db_max_retry_interval = 10 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] database.db_retry_interval = 1 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] database.max_overflow = 50 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] database.max_pool_size = 5 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] database.max_retries = 10 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] database.mysql_wsrep_sync_wait = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] database.pool_timeout = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] database.retry_interval = 10 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] database.slave_connection = **** {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] database.sqlite_synchronous = True {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] database.synchronous_reader = True {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] database.use_db_reconnect = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] profiler.connection_string = messaging:// {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] profiler.enabled = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] profiler.es_doc_type = notification {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] profiler.es_scroll_size = 10000 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] profiler.es_scroll_time = 2m {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] profiler.filter_error_trace = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] profiler.hmac_keys = **** {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] profiler.sentinel_service_name = mymaster {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] profiler.socket_timeout = 0.1 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] profiler.trace_requests = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] profiler.trace_sqlalchemy = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] profiler_jaeger.process_tags = {} {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] profiler_jaeger.service_name_prefix = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] profiler_otlp.service_name_prefix = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_policy.enforce_new_defaults = True {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_policy.enforce_scope = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_policy.policy_default_rule = default {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_policy.policy_file = policy.yaml {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] privsep_osbrick.group = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] privsep_osbrick.helper_command = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] privsep_osbrick.user = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cinder_sys_admin.group = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cinder_sys_admin.helper_command = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] cinder_sys_admin.user = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] service_user.auth_section = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] service_user.auth_type = password {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] service_user.cafile = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] service_user.certfile = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] service_user.collect_timing = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] service_user.insecure = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] service_user.keyfile = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] service_user.send_service_user_token = True {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] service_user.split_loggers = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] service_user.timeout = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] glance.auth_section = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] glance.auth_type = password {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] glance.certfile = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] glance.collect_timing = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] glance.insecure = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] glance.keyfile = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] glance.region_name = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] glance.split_loggers = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] glance.timeout = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.backend_availability_zone = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.chap_password = **** {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.chap_username = {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.disk_geometry = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.driver_client_cert = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.driver_client_cert_key = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.driver_data_namespace = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.driver_use_ssl = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.extra_capabilities = {} {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.filter_function = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.goodness_function = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.iscsi_target_flags = {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.iscsi_write_cache = on {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.iser_helper = tgtadm {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.iser_ip_address = 192.168.122.42 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.iser_port = 3260 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.nas_host = {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.nas_login = admin {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.nas_mount_options = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.nas_password = **** {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.nas_private_key = {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.nas_share_path = {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.num_shell_tries = 3 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.quobyte_volume_url = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.replication_device = **** {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.report_discard_supported = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.reserved_percentage = 0 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack quobyte-client[87288]: Reading configuration file: /etc/quobyte/client.cfg Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.target_helper = tgtadm {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack quobyte-client[87288]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.target_ip_address = 192.168.122.42 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.target_port = 3260 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.target_protocol = iscsi {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.trace_flags = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.unique_fqdn_network = True {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.use_chap_auth = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.volume_backend_name = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.volume_clear = zero {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.volume_clear_ionice = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.volume_clear_size = 0 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_reports.file_event_handler = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_reports.log_dir = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.backend_availability_zone = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.backend_host = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.chap_password = **** {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.chap_username = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.chiscsi_conf = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.disk_geometry = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.driver_client_cert = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.driver_data_namespace = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.driver_use_ssl = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.extra_capabilities = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.filter_function = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.goodness_function = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e26df349-37be-4006-b440-ce269fb8586d None None] CMD "mount.quobyte" returned: 1 in 0.059s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e26df349-37be-4006-b440-ce269fb8586d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e26df349-37be-4006-b440-ce269fb8586d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e26df349-37be-4006-b440-ce269fb8586d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.iser_helper = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.iser_ip_address = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.iser_port = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.iser_target_prefix = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.nas_host = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.nas_login = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.nas_mount_options = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.nas_password = **** {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.nas_private_key = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e26df349-37be-4006-b440-ce269fb8586d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e26df349-37be-4006-b440-ce269fb8586d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.nas_share_path = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e26df349-37be-4006-b440-ce269fb8586d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.nas_ssh_port = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.num_shell_tries = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:34 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.nvmet_port_id = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.replication_device = **** {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.report_discard_supported = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.reserved_percentage = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.scst_target_driver = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.storage_protocol = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.target_helper = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.target_ip_address = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.target_port = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.target_prefix = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.target_protocol = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.trace_flags = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.use_chap_auth = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.volume_clear = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.volume_clear_size = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] QuobyteHD.volumes_dir = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack sudo[87289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_rabbit.ssl = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack sudo[87289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_notifications.driver = [] {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_notifications.retry = -1 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] key_manager.fixed_key = **** {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] barbican.barbican_api_version = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] barbican.barbican_endpoint = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] barbican.barbican_endpoint_type = public {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] barbican.barbican_region_name = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] barbican.cafile = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] barbican.certfile = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] barbican.collect_timing = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] barbican.insecure = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] barbican.keyfile = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] barbican.number_of_retries = 60 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] barbican.retry_delay = 1 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] barbican.send_service_user_token = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] barbican.split_loggers = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] barbican.timeout = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] barbican.verify_ssl = True {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] barbican.verify_ssl_path = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] barbican_service_user.auth_section = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] barbican_service_user.auth_type = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] barbican_service_user.cafile = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] barbican_service_user.certfile = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] barbican_service_user.collect_timing = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] barbican_service_user.insecure = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] barbican_service_user.keyfile = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] barbican_service_user.split_loggers = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] barbican_service_user.timeout = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] vault.approle_role_id = **** {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] vault.approle_secret_id = **** {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] vault.kv_mountpoint = secret {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] vault.kv_path = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] vault.kv_version = 2 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] vault.namespace = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] vault.root_token_id = **** {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] vault.ssl_ca_crt_file = None {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] vault.timeout = 60.0 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] vault.use_ssl = False {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:28:35 devstack cinder-volume[87037]: DEBUG oslo_service.backend._eventlet.service [None req-3c21c4b5-cc44-4986-bc4a-7ec7806031b8 None None] ******************************************************************************** {{(pid=87037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 01:28:35 devstack sudo[87289]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e26df349-37be-4006-b440-ce269fb8586d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.639s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:35 devstack cinder-volume[87284]: INFO cinder.volume.driver [None req-e26df349-37be-4006-b440-ce269fb8586d None None] Driver hasn't implemented _init_vendor_properties() Jul 08 01:28:35 devstack cinder-volume[87284]: DEBUG cinder.volume.driver [None req-e26df349-37be-4006-b440-ce269fb8586d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6908683776855, 'free_capacity_gb': 1775.6908683776855, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87284) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 01:28:35 devstack cinder-volume[87284]: DEBUG oslo_db.sqlalchemy.engines [None req-e26df349-37be-4006-b440-ce269fb8586d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87284) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:28:35 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writer thread running {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 01:28:35 devstack cinder-volume[87284]: DEBUG cinder.db.api [None req-e26df349-37be-4006-b440-ce269fb8586d None None] Building query based on filter {{(pid=87284) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 01:28:35 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-e26df349-37be-4006-b440-ce269fb8586d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87284) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 01:28:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e26df349-37be-4006-b440-ce269fb8586d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e26df349-37be-4006-b440-ce269fb8586d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:35 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e26df349-37be-4006-b440-ce269fb8586d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:35 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e26df349-37be-4006-b440-ce269fb8586d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e26df349-37be-4006-b440-ce269fb8586d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e26df349-37be-4006-b440-ce269fb8586d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:35 devstack cinder-volume[87284]: INFO cinder.keymgr.migration [None req-b16cce83-762a-4538-bd0b-9ed26f457169 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 01:28:35 devstack sudo[87294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:28:35 devstack sudo[87294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:36 devstack sudo[87294]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e26df349-37be-4006-b440-ce269fb8586d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.625s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:36 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-e26df349-37be-4006-b440-ce269fb8586d None None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:28:36 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-e26df349-37be-4006-b440-ce269fb8586d None None] Driver initialization completed successfully. Jul 08 01:28:36 devstack cinder-volume[87284]: INFO cinder.manager [None req-e26df349-37be-4006-b440-ce269fb8586d None None] Initiating service 3 cleanup Jul 08 01:28:36 devstack cinder-volume[87284]: INFO cinder.manager [None req-e26df349-37be-4006-b440-ce269fb8586d None None] Service 3 cleanup completed. Jul 08 01:28:36 devstack cinder-volume[87284]: DEBUG cinder.service [None req-e26df349-37be-4006-b440-ce269fb8586d None None] Creating RPC server for service cinder-volume {{(pid=87284) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 01:28:36 devstack cinder-volume[87284]: DEBUG cinder.service [None req-e26df349-37be-4006-b440-ce269fb8586d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87284) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 01:28:36 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-e26df349-37be-4006-b440-ce269fb8586d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 08 01:28:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e26df349-37be-4006-b440-ce269fb8586d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e26df349-37be-4006-b440-ce269fb8586d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e26df349-37be-4006-b440-ce269fb8586d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e26df349-37be-4006-b440-ce269fb8586d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e26df349-37be-4006-b440-ce269fb8586d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e26df349-37be-4006-b440-ce269fb8586d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:36 devstack sudo[87301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:28:36 devstack sudo[87301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:37 devstack sudo[87301]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e26df349-37be-4006-b440-ce269fb8586d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.610s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:37 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-e26df349-37be-4006-b440-ce269fb8586d None None] Driver post RPC initialization completed successfully. Jul 08 01:28:44 devstack cinder-volume[87037]: DEBUG dbcounter [-] [87037] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87037) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:28:46 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:28:47 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=1 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:28:55 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager._thread_info {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:28:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread count: 6 {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:28:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread info: [<_MainThread(MainThread, started 127058402500736)>, , , , , ] {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:29:32 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4f3fb29-05f0-4b75-b615-b088a1405447 tempest-TaggedAttachmentsTest-723894748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:29:32 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c4f3fb29-05f0-4b75-b615-b088a1405447 tempest-TaggedAttachmentsTest-723894748 None] Flow 'volume_create_manager' (bf1a0326-c2b1-482c-a472-99209187a87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:29:32 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c4f3fb29-05f0-4b75-b615-b088a1405447 tempest-TaggedAttachmentsTest-723894748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a645150-8f4c-49b1-b07c-03df77919644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:32 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c4f3fb29-05f0-4b75-b615-b088a1405447 tempest-TaggedAttachmentsTest-723894748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a645150-8f4c-49b1-b07c-03df77919644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-290991476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97e50584-4560-4038-afbd-391bd801738f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='411d5c2f1d3c4a72990456bc0638e286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:29:33Z,use_quota=True,user_id='2795c93c775c4290a10f32dcc4dc4d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:32 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c4f3fb29-05f0-4b75-b615-b088a1405447 tempest-TaggedAttachmentsTest-723894748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (788f025e-0a5a-4af5-807b-f602b033f66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:32 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c4f3fb29-05f0-4b75-b615-b088a1405447 tempest-TaggedAttachmentsTest-723894748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (788f025e-0a5a-4af5-807b-f602b033f66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:32 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c4f3fb29-05f0-4b75-b615-b088a1405447 tempest-TaggedAttachmentsTest-723894748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4be7055a-6f64-47d4-849c-b9386aaf43df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:32 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c4f3fb29-05f0-4b75-b615-b088a1405447 tempest-TaggedAttachmentsTest-723894748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4be7055a-6f64-47d4-849c-b9386aaf43df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97e50584-4560-4038-afbd-391bd801738f', 'volume_name': 'volume-97e50584-4560-4038-afbd-391bd801738f', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:32 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c4f3fb29-05f0-4b75-b615-b088a1405447 tempest-TaggedAttachmentsTest-723894748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ec2fba1-d684-4663-9ad2-234e6fb3300b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:32 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c4f3fb29-05f0-4b75-b615-b088a1405447 tempest-TaggedAttachmentsTest-723894748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ec2fba1-d684-4663-9ad2-234e6fb3300b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:32 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c4f3fb29-05f0-4b75-b615-b088a1405447 tempest-TaggedAttachmentsTest-723894748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9754edb-1bb2-4a37-9546-461c5993f4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:32 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-c4f3fb29-05f0-4b75-b615-b088a1405447 tempest-TaggedAttachmentsTest-723894748 None] Volume 97e50584-4560-4038-afbd-391bd801738f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97e50584-4560-4038-afbd-391bd801738f', 'volume_size': 1} Jul 08 01:29:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c4f3fb29-05f0-4b75-b615-b088a1405447 tempest-TaggedAttachmentsTest-723894748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c4f3fb29-05f0-4b75-b615-b088a1405447 tempest-TaggedAttachmentsTest-723894748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:32 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c4f3fb29-05f0-4b75-b615-b088a1405447 tempest-TaggedAttachmentsTest-723894748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-290991476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97e50584-4560-4038-afbd-391bd801738f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='411d5c2f1d3c4a72990456bc0638e286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:29:33Z,use_quota=True,user_id='2795c93c775c4290a10f32dcc4dc4d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:29:32 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-c4f3fb29-05f0-4b75-b615-b088a1405447 tempest-TaggedAttachmentsTest-723894748 None] Creating volume 97e50584-4560-4038-afbd-391bd801738f {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:29:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c4f3fb29-05f0-4b75-b615-b088a1405447 tempest-TaggedAttachmentsTest-723894748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c4f3fb29-05f0-4b75-b615-b088a1405447 tempest-TaggedAttachmentsTest-723894748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:32 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c4f3fb29-05f0-4b75-b615-b088a1405447 tempest-TaggedAttachmentsTest-723894748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:29:32 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c4f3fb29-05f0-4b75-b615-b088a1405447 tempest-TaggedAttachmentsTest-723894748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:29:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c4f3fb29-05f0-4b75-b615-b088a1405447 tempest-TaggedAttachmentsTest-723894748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:32 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c4f3fb29-05f0-4b75-b615-b088a1405447 tempest-TaggedAttachmentsTest-723894748 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:29:32 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-c4f3fb29-05f0-4b75-b615-b088a1405447 tempest-TaggedAttachmentsTest-723894748 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:29:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c4f3fb29-05f0-4b75-b615-b088a1405447 tempest-TaggedAttachmentsTest-723894748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-97e50584-4560-4038-afbd-391bd801738f 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:32 devstack sudo[87429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-97e50584-4560-4038-afbd-391bd801738f 1073741824 Jul 08 01:29:32 devstack sudo[87429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:34 devstack sudo[87429]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c4f3fb29-05f0-4b75-b615-b088a1405447 tempest-TaggedAttachmentsTest-723894748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-97e50584-4560-4038-afbd-391bd801738f 1073741824" returned: 0 in 1.267s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c4f3fb29-05f0-4b75-b615-b088a1405447 tempest-TaggedAttachmentsTest-723894748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-97e50584-4560-4038-afbd-391bd801738f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:34 devstack sudo[87759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-97e50584-4560-4038-afbd-391bd801738f Jul 08 01:29:34 devstack sudo[87759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:35 devstack sudo[87759]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c4f3fb29-05f0-4b75-b615-b088a1405447 tempest-TaggedAttachmentsTest-723894748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-97e50584-4560-4038-afbd-391bd801738f" returned: 0 in 0.800s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:35 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c4f3fb29-05f0-4b75-b615-b088a1405447 tempest-TaggedAttachmentsTest-723894748 None] <== create_volume: return (2142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:29:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c4f3fb29-05f0-4b75-b615-b088a1405447 tempest-TaggedAttachmentsTest-723894748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.147s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:35 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c4f3fb29-05f0-4b75-b615-b088a1405447 tempest-TaggedAttachmentsTest-723894748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9754edb-1bb2-4a37-9546-461c5993f4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97e50584-4560-4038-afbd-391bd801738f', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:35 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c4f3fb29-05f0-4b75-b615-b088a1405447 tempest-TaggedAttachmentsTest-723894748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a73469bc-f058-438a-9ed2-7e06adc2eb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:35 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-c4f3fb29-05f0-4b75-b615-b088a1405447 tempest-TaggedAttachmentsTest-723894748 None] Volume volume-97e50584-4560-4038-afbd-391bd801738f (97e50584-4560-4038-afbd-391bd801738f): created successfully Jul 08 01:29:35 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c4f3fb29-05f0-4b75-b615-b088a1405447 tempest-TaggedAttachmentsTest-723894748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a73469bc-f058-438a-9ed2-7e06adc2eb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:35 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c4f3fb29-05f0-4b75-b615-b088a1405447 tempest-TaggedAttachmentsTest-723894748 None] Flow 'volume_create_manager' (bf1a0326-c2b1-482c-a472-99209187a87f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:29:35 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-c4f3fb29-05f0-4b75-b615-b088a1405447 tempest-TaggedAttachmentsTest-723894748 None] Created volume successfully. Jul 08 01:29:45 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:29:45 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:29:55 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:29:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:29:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:29:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:55 devstack sudo[87892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:29:55 devstack sudo[87892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:56 devstack sudo[87892]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.032s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:56 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:29:56 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager._thread_info {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:29:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread count: 6 {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:29:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread info: [<_MainThread(MainThread, started 127058402500736)>, , , , , ] {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:30:16 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-025b1950-8244-465b-8819-1e52dd436030 tempest-VolumesAdminNegativeTest-552322454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:30:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-025b1950-8244-465b-8819-1e52dd436030 tempest-VolumesAdminNegativeTest-552322454 None] Flow 'volume_create_manager' (c28541af-8ed7-496e-bd0d-f32cecbce660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:30:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-025b1950-8244-465b-8819-1e52dd436030 tempest-VolumesAdminNegativeTest-552322454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (835e42d6-f557-4648-bfa6-ce3fe610de07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-025b1950-8244-465b-8819-1e52dd436030 tempest-VolumesAdminNegativeTest-552322454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (835e42d6-f557-4648-bfa6-ce3fe610de07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-78512419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c72aa7c9-3ef7-4550-a91e-aed333a10b01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b226e94f0494a3fa95ff6cb191182a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:30:16Z,use_quota=True,user_id='49120d6a9ccd4332bc904133c9e84016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-025b1950-8244-465b-8819-1e52dd436030 tempest-VolumesAdminNegativeTest-552322454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b3bf807-58fc-4730-812b-6c5f5a049daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-025b1950-8244-465b-8819-1e52dd436030 tempest-VolumesAdminNegativeTest-552322454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b3bf807-58fc-4730-812b-6c5f5a049daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-025b1950-8244-465b-8819-1e52dd436030 tempest-VolumesAdminNegativeTest-552322454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b376bcd9-511d-404b-a681-380fdb299e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-025b1950-8244-465b-8819-1e52dd436030 tempest-VolumesAdminNegativeTest-552322454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b376bcd9-511d-404b-a681-380fdb299e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c72aa7c9-3ef7-4550-a91e-aed333a10b01', 'volume_name': 'volume-c72aa7c9-3ef7-4550-a91e-aed333a10b01', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-025b1950-8244-465b-8819-1e52dd436030 tempest-VolumesAdminNegativeTest-552322454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97ec4d5f-3a42-4606-930b-ab22ec3c2f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-025b1950-8244-465b-8819-1e52dd436030 tempest-VolumesAdminNegativeTest-552322454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97ec4d5f-3a42-4606-930b-ab22ec3c2f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-025b1950-8244-465b-8819-1e52dd436030 tempest-VolumesAdminNegativeTest-552322454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c996902-9b5b-4e08-a3df-72c3da8b76fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:16 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-025b1950-8244-465b-8819-1e52dd436030 tempest-VolumesAdminNegativeTest-552322454 None] Volume c72aa7c9-3ef7-4550-a91e-aed333a10b01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c72aa7c9-3ef7-4550-a91e-aed333a10b01', 'volume_size': 1} Jul 08 01:30:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-025b1950-8244-465b-8819-1e52dd436030 tempest-VolumesAdminNegativeTest-552322454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-025b1950-8244-465b-8819-1e52dd436030 tempest-VolumesAdminNegativeTest-552322454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:16 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-025b1950-8244-465b-8819-1e52dd436030 tempest-VolumesAdminNegativeTest-552322454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-78512419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c72aa7c9-3ef7-4550-a91e-aed333a10b01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b226e94f0494a3fa95ff6cb191182a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:30:16Z,use_quota=True,user_id='49120d6a9ccd4332bc904133c9e84016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:30:16 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-025b1950-8244-465b-8819-1e52dd436030 tempest-VolumesAdminNegativeTest-552322454 None] Creating volume c72aa7c9-3ef7-4550-a91e-aed333a10b01 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:30:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-025b1950-8244-465b-8819-1e52dd436030 tempest-VolumesAdminNegativeTest-552322454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-025b1950-8244-465b-8819-1e52dd436030 tempest-VolumesAdminNegativeTest-552322454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:16 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-025b1950-8244-465b-8819-1e52dd436030 tempest-VolumesAdminNegativeTest-552322454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:30:16 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-025b1950-8244-465b-8819-1e52dd436030 tempest-VolumesAdminNegativeTest-552322454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:30:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-025b1950-8244-465b-8819-1e52dd436030 tempest-VolumesAdminNegativeTest-552322454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:16 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-025b1950-8244-465b-8819-1e52dd436030 tempest-VolumesAdminNegativeTest-552322454 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:30:16 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-025b1950-8244-465b-8819-1e52dd436030 tempest-VolumesAdminNegativeTest-552322454 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:30:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-025b1950-8244-465b-8819-1e52dd436030 tempest-VolumesAdminNegativeTest-552322454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c72aa7c9-3ef7-4550-a91e-aed333a10b01 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:16 devstack sudo[88252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c72aa7c9-3ef7-4550-a91e-aed333a10b01 1073741824 Jul 08 01:30:16 devstack sudo[88252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:18 devstack sudo[88252]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-025b1950-8244-465b-8819-1e52dd436030 tempest-VolumesAdminNegativeTest-552322454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c72aa7c9-3ef7-4550-a91e-aed333a10b01 1073741824" returned: 0 in 2.099s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-025b1950-8244-465b-8819-1e52dd436030 tempest-VolumesAdminNegativeTest-552322454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c72aa7c9-3ef7-4550-a91e-aed333a10b01 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:20 devstack sudo[88263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c72aa7c9-3ef7-4550-a91e-aed333a10b01 Jul 08 01:30:20 devstack sudo[88263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:21 devstack sudo[88263]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-025b1950-8244-465b-8819-1e52dd436030 tempest-VolumesAdminNegativeTest-552322454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c72aa7c9-3ef7-4550-a91e-aed333a10b01" returned: 0 in 0.918s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:21 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-025b1950-8244-465b-8819-1e52dd436030 tempest-VolumesAdminNegativeTest-552322454 None] <== create_volume: return (5311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:30:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-025b1950-8244-465b-8819-1e52dd436030 tempest-VolumesAdminNegativeTest-552322454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 5.319s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:23 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-025b1950-8244-465b-8819-1e52dd436030 tempest-VolumesAdminNegativeTest-552322454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c996902-9b5b-4e08-a3df-72c3da8b76fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c72aa7c9-3ef7-4550-a91e-aed333a10b01', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:23 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-025b1950-8244-465b-8819-1e52dd436030 tempest-VolumesAdminNegativeTest-552322454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (487fcd68-8469-4bbb-95a7-466f4a14f373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:23 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-025b1950-8244-465b-8819-1e52dd436030 tempest-VolumesAdminNegativeTest-552322454 None] Volume volume-c72aa7c9-3ef7-4550-a91e-aed333a10b01 (c72aa7c9-3ef7-4550-a91e-aed333a10b01): created successfully Jul 08 01:30:23 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-025b1950-8244-465b-8819-1e52dd436030 tempest-VolumesAdminNegativeTest-552322454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (487fcd68-8469-4bbb-95a7-466f4a14f373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-025b1950-8244-465b-8819-1e52dd436030 tempest-VolumesAdminNegativeTest-552322454 None] Flow 'volume_create_manager' (c28541af-8ed7-496e-bd0d-f32cecbce660) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:30:24 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-025b1950-8244-465b-8819-1e52dd436030 tempest-VolumesAdminNegativeTest-552322454 None] Created volume successfully. Jul 08 01:30:26 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b517beee-a768-4364-958d-1b206cf053bb tempest-VolumesAdminNegativeTest-552322454 None] Acquiring lock "cinder-c72aa7c9-3ef7-4550-a91e-aed333a10b01-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:26 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b517beee-a768-4364-958d-1b206cf053bb tempest-VolumesAdminNegativeTest-552322454 None] Lock "cinder-c72aa7c9-3ef7-4550-a91e-aed333a10b01-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:26 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b517beee-a768-4364-958d-1b206cf053bb tempest-VolumesAdminNegativeTest-552322454 None] Acquiring lock "cinder-quobyte-c72aa7c9-3ef7-4550-a91e-aed333a10b01" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:26 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b517beee-a768-4364-958d-1b206cf053bb tempest-VolumesAdminNegativeTest-552322454 None] Lock "cinder-quobyte-c72aa7c9-3ef7-4550-a91e-aed333a10b01" acquired by "delete_volume" :: waited 0.039s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:26 devstack cinder-volume[87284]: INFO oslo.privsep.daemon [None req-b517beee-a768-4364-958d-1b206cf053bb tempest-VolumesAdminNegativeTest-552322454 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpw2uk1jyw/privsep.sock'] Jul 08 01:30:26 devstack sudo[88294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpw2uk1jyw/privsep.sock Jul 08 01:30:26 devstack sudo[88294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:27 devstack cinder-volume[87284]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 08 01:30:27 devstack cinder-volume[87284]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 01:30:27 devstack cinder-volume[87284]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 08 01:30:27 devstack cinder-volume[87284]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 01:30:27 devstack cinder-volume[87284]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 08 01:30:27 devstack cinder-volume[87284]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 08 01:30:27 devstack cinder-volume[87284]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 01:30:27 devstack cinder-volume[87284]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 01:30:27 devstack cinder-volume[87284]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 08 01:30:28 devstack cinder-volume[87284]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 08 01:30:28 devstack cinder-volume[87284]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 01:30:28 devstack cinder-volume[87284]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 08 01:30:28 devstack cinder-volume[87284]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 01:30:28 devstack cinder-volume[87284]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 08 01:30:28 devstack cinder-volume[87284]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 08 01:30:28 devstack cinder-volume[87284]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 01:30:28 devstack cinder-volume[87284]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 01:30:28 devstack cinder-volume[87284]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 08 01:30:28 devstack sudo[88294]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:28 devstack cinder-volume[87284]: INFO oslo.privsep.daemon [None req-b517beee-a768-4364-958d-1b206cf053bb tempest-VolumesAdminNegativeTest-552322454 None] Spawned new privsep daemon via rootwrap Jul 08 01:30:28 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [None req-b517beee-a768-4364-958d-1b206cf053bb tempest-VolumesAdminNegativeTest-552322454 None] Accepted privsep connection to /tmp/tmpw2uk1jyw/privsep.sock {{(pid=87284) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 08 01:30:28 devstack cinder-volume[87284]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 08 01:30:28 devstack cinder-volume[87284]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 08 01:30:28 devstack cinder-volume[87284]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 08 01:30:28 devstack cinder-volume[87284]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88341 Jul 08 01:30:28 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3124769-86ad-4b2d-bd5a-10930d86ea50]: (2,) {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:30:28 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[0762a97a-d831-47a8-8ef0-5e6cc5483502]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:30:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b517beee-a768-4364-958d-1b206cf053bb tempest-VolumesAdminNegativeTest-552322454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c72aa7c9-3ef7-4550-a91e-aed333a10b01 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:28 devstack sudo[88343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c72aa7c9-3ef7-4550-a91e-aed333a10b01 Jul 08 01:30:28 devstack sudo[88343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:29 devstack sudo[88343]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b517beee-a768-4364-958d-1b206cf053bb tempest-VolumesAdminNegativeTest-552322454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c72aa7c9-3ef7-4550-a91e-aed333a10b01" returned: 0 in 0.891s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b517beee-a768-4364-958d-1b206cf053bb tempest-VolumesAdminNegativeTest-552322454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c72aa7c9-3ef7-4550-a91e-aed333a10b01 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:29 devstack sudo[88348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c72aa7c9-3ef7-4550-a91e-aed333a10b01 Jul 08 01:30:29 devstack sudo[88348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:30 devstack sudo[88348]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b517beee-a768-4364-958d-1b206cf053bb tempest-VolumesAdminNegativeTest-552322454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c72aa7c9-3ef7-4550-a91e-aed333a10b01" returned: 0 in 0.773s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:30 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b517beee-a768-4364-958d-1b206cf053bb tempest-VolumesAdminNegativeTest-552322454 None] Lock "cinder-quobyte-c72aa7c9-3ef7-4550-a91e-aed333a10b01" released by "delete_volume" :: held 4.074s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:30:30 devstack cinder-volume[87284]: WARNING cinder.quota [None req-b517beee-a768-4364-958d-1b206cf053bb tempest-VolumesAdminNegativeTest-552322454 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:30:30 devstack cinder-volume[87284]: WARNING cinder.quota [None req-b517beee-a768-4364-958d-1b206cf053bb tempest-VolumesAdminNegativeTest-552322454 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:30:30 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-b517beee-a768-4364-958d-1b206cf053bb tempest-VolumesAdminNegativeTest-552322454 None] Created reservations ['8d39cc20-c0d5-45bc-bba8-1ccabfd24a3e', '22b6aca2-36ee-4958-87a4-7ac481d2681c', 'e904b7e7-732d-400c-b89d-a93220bfba54', 'b87b7046-7245-40be-9fe8-25e3782df9e7'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:30:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b517beee-a768-4364-958d-1b206cf053bb tempest-VolumesAdminNegativeTest-552322454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b517beee-a768-4364-958d-1b206cf053bb tempest-VolumesAdminNegativeTest-552322454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:30 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b517beee-a768-4364-958d-1b206cf053bb tempest-VolumesAdminNegativeTest-552322454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:30:30 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b517beee-a768-4364-958d-1b206cf053bb tempest-VolumesAdminNegativeTest-552322454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:30:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b517beee-a768-4364-958d-1b206cf053bb tempest-VolumesAdminNegativeTest-552322454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b517beee-a768-4364-958d-1b206cf053bb tempest-VolumesAdminNegativeTest-552322454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:30 devstack sudo[88351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:30:30 devstack sudo[88351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:31 devstack sudo[88351]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b517beee-a768-4364-958d-1b206cf053bb tempest-VolumesAdminNegativeTest-552322454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.883s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:31 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-b517beee-a768-4364-958d-1b206cf053bb tempest-VolumesAdminNegativeTest-552322454 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:30:31 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-b517beee-a768-4364-958d-1b206cf053bb tempest-VolumesAdminNegativeTest-552322454 None] Deleted volume successfully. Jul 08 01:30:31 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b517beee-a768-4364-958d-1b206cf053bb tempest-VolumesAdminNegativeTest-552322454 None] Lock "cinder-c72aa7c9-3ef7-4550-a91e-aed333a10b01-delete_volume" released by "delete_volume" :: held 5.436s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:30:37 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eee3418-37b2-4e08-bef5-b6e8728328b2 tempest-AttachVolumeShelveTestJSON-1284811158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:30:37 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7eee3418-37b2-4e08-bef5-b6e8728328b2 tempest-AttachVolumeShelveTestJSON-1284811158 None] Flow 'volume_create_manager' (05db55f3-fcba-47be-b556-04191e685787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:30:37 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7eee3418-37b2-4e08-bef5-b6e8728328b2 tempest-AttachVolumeShelveTestJSON-1284811158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a31c3817-ad48-423c-b6c0-1b65a5adc467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:37 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7eee3418-37b2-4e08-bef5-b6e8728328b2 tempest-AttachVolumeShelveTestJSON-1284811158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a31c3817-ad48-423c-b6c0-1b65a5adc467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:30:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1913600957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81a2c2ed-2ba9-49dc-ba0a-9e36dc2b712c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04372ec22ef14ee7808c742ded9d199a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:30:37Z,use_quota=True,user_id='40519e0b79274e6d82b8f903ef8a4304',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:37 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7eee3418-37b2-4e08-bef5-b6e8728328b2 tempest-AttachVolumeShelveTestJSON-1284811158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94b6143e-2871-4169-b86a-22b4079ef0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:37 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7eee3418-37b2-4e08-bef5-b6e8728328b2 tempest-AttachVolumeShelveTestJSON-1284811158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94b6143e-2871-4169-b86a-22b4079ef0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:37 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7eee3418-37b2-4e08-bef5-b6e8728328b2 tempest-AttachVolumeShelveTestJSON-1284811158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ef4cdd0-2272-4f14-82bb-7871bc42a25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:37 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7eee3418-37b2-4e08-bef5-b6e8728328b2 tempest-AttachVolumeShelveTestJSON-1284811158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ef4cdd0-2272-4f14-82bb-7871bc42a25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81a2c2ed-2ba9-49dc-ba0a-9e36dc2b712c', 'volume_name': 'volume-81a2c2ed-2ba9-49dc-ba0a-9e36dc2b712c', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:37 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7eee3418-37b2-4e08-bef5-b6e8728328b2 tempest-AttachVolumeShelveTestJSON-1284811158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c426173-a6e0-49d4-aa7a-0324a99fe50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:37 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7eee3418-37b2-4e08-bef5-b6e8728328b2 tempest-AttachVolumeShelveTestJSON-1284811158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c426173-a6e0-49d4-aa7a-0324a99fe50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:37 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7eee3418-37b2-4e08-bef5-b6e8728328b2 tempest-AttachVolumeShelveTestJSON-1284811158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bbc3b55-1e72-4e2f-99ca-53c2ce3d7402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:37 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-7eee3418-37b2-4e08-bef5-b6e8728328b2 tempest-AttachVolumeShelveTestJSON-1284811158 None] Volume 81a2c2ed-2ba9-49dc-ba0a-9e36dc2b712c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81a2c2ed-2ba9-49dc-ba0a-9e36dc2b712c', 'volume_size': 1} Jul 08 01:30:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-7eee3418-37b2-4e08-bef5-b6e8728328b2 tempest-AttachVolumeShelveTestJSON-1284811158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-7eee3418-37b2-4e08-bef5-b6e8728328b2 tempest-AttachVolumeShelveTestJSON-1284811158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:37 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-7eee3418-37b2-4e08-bef5-b6e8728328b2 tempest-AttachVolumeShelveTestJSON-1284811158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:30:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1913600957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81a2c2ed-2ba9-49dc-ba0a-9e36dc2b712c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04372ec22ef14ee7808c742ded9d199a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:30:37Z,use_quota=True,user_id='40519e0b79274e6d82b8f903ef8a4304',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:30:37 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-7eee3418-37b2-4e08-bef5-b6e8728328b2 tempest-AttachVolumeShelveTestJSON-1284811158 None] Creating volume 81a2c2ed-2ba9-49dc-ba0a-9e36dc2b712c {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:30:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-7eee3418-37b2-4e08-bef5-b6e8728328b2 tempest-AttachVolumeShelveTestJSON-1284811158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-7eee3418-37b2-4e08-bef5-b6e8728328b2 tempest-AttachVolumeShelveTestJSON-1284811158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:37 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-7eee3418-37b2-4e08-bef5-b6e8728328b2 tempest-AttachVolumeShelveTestJSON-1284811158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:30:37 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-7eee3418-37b2-4e08-bef5-b6e8728328b2 tempest-AttachVolumeShelveTestJSON-1284811158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:30:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-7eee3418-37b2-4e08-bef5-b6e8728328b2 tempest-AttachVolumeShelveTestJSON-1284811158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:37 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-7eee3418-37b2-4e08-bef5-b6e8728328b2 tempest-AttachVolumeShelveTestJSON-1284811158 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:30:37 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-7eee3418-37b2-4e08-bef5-b6e8728328b2 tempest-AttachVolumeShelveTestJSON-1284811158 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:30:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7eee3418-37b2-4e08-bef5-b6e8728328b2 tempest-AttachVolumeShelveTestJSON-1284811158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-81a2c2ed-2ba9-49dc-ba0a-9e36dc2b712c 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:37 devstack sudo[88429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-81a2c2ed-2ba9-49dc-ba0a-9e36dc2b712c 1073741824 Jul 08 01:30:37 devstack sudo[88429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:38 devstack sudo[88429]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7eee3418-37b2-4e08-bef5-b6e8728328b2 tempest-AttachVolumeShelveTestJSON-1284811158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-81a2c2ed-2ba9-49dc-ba0a-9e36dc2b712c 1073741824" returned: 0 in 0.921s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7eee3418-37b2-4e08-bef5-b6e8728328b2 tempest-AttachVolumeShelveTestJSON-1284811158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-81a2c2ed-2ba9-49dc-ba0a-9e36dc2b712c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:38 devstack sudo[88435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-81a2c2ed-2ba9-49dc-ba0a-9e36dc2b712c Jul 08 01:30:38 devstack sudo[88435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:39 devstack sudo[88435]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7eee3418-37b2-4e08-bef5-b6e8728328b2 tempest-AttachVolumeShelveTestJSON-1284811158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-81a2c2ed-2ba9-49dc-ba0a-9e36dc2b712c" returned: 0 in 0.662s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:39 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-7eee3418-37b2-4e08-bef5-b6e8728328b2 tempest-AttachVolumeShelveTestJSON-1284811158 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:30:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-7eee3418-37b2-4e08-bef5-b6e8728328b2 tempest-AttachVolumeShelveTestJSON-1284811158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7eee3418-37b2-4e08-bef5-b6e8728328b2 tempest-AttachVolumeShelveTestJSON-1284811158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bbc3b55-1e72-4e2f-99ca-53c2ce3d7402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81a2c2ed-2ba9-49dc-ba0a-9e36dc2b712c', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7eee3418-37b2-4e08-bef5-b6e8728328b2 tempest-AttachVolumeShelveTestJSON-1284811158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eb6ee93-d8b1-4636-aee8-e8dab5df2caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:39 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-7eee3418-37b2-4e08-bef5-b6e8728328b2 tempest-AttachVolumeShelveTestJSON-1284811158 None] Volume volume-81a2c2ed-2ba9-49dc-ba0a-9e36dc2b712c (81a2c2ed-2ba9-49dc-ba0a-9e36dc2b712c): created successfully Jul 08 01:30:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7eee3418-37b2-4e08-bef5-b6e8728328b2 tempest-AttachVolumeShelveTestJSON-1284811158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eb6ee93-d8b1-4636-aee8-e8dab5df2caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7eee3418-37b2-4e08-bef5-b6e8728328b2 tempest-AttachVolumeShelveTestJSON-1284811158 None] Flow 'volume_create_manager' (05db55f3-fcba-47be-b556-04191e685787) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:30:39 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-7eee3418-37b2-4e08-bef5-b6e8728328b2 tempest-AttachVolumeShelveTestJSON-1284811158 None] Created volume successfully. Jul 08 01:30:49 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:UPDATE=14,cinder:SELECT=8,cinder:INSERT=2 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:30:49 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=11,cinder:UPDATE=15,cinder:DELETE=3,cinder:INSERT=4 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:30:55 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:30:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:30:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:30:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:55 devstack sudo[88545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:30:55 devstack sudo[88545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:56 devstack sudo[88545]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.214s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:56 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:30:56 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager._thread_info {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:30:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread count: 8 {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:30:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread info: [<_MainThread(MainThread, started 127058402500736)>, , , , , , , ] {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:31:00 devstack cinder-volume[87284]: WARNING py.warnings [req-74d96c98-6359-4321-b2c7-da7b017a742f req-363147f1-512f-44f0-80ca-5b6f0d741eaf tempest-AttachVolumeShelveTestJSON-1284811158 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jul 08 01:31:00 devstack cinder-volume[87284]: .first() Jul 08 01:31:00 devstack cinder-volume[87284]: Jul 08 01:31:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-74d96c98-6359-4321-b2c7-da7b017a742f req-363147f1-512f-44f0-80ca-5b6f0d741eaf tempest-AttachVolumeShelveTestJSON-1284811158 None] No connector for attachment 46521c49-1a90-4bbf-94de-3257c0305858; skipping storage backend terminate_connection call. {{(pid=87284) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 08 01:31:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-74d96c98-6359-4321-b2c7-da7b017a742f req-363147f1-512f-44f0-80ca-5b6f0d741eaf tempest-AttachVolumeShelveTestJSON-1284811158 None] Deleting attachment 46521c49-1a90-4bbf-94de-3257c0305858. {{(pid=87284) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:31:00 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-3102b808-32ff-47c6-a589-61c26e0411bc tempest-DeleteServersTestJSON-2004159624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:31:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3102b808-32ff-47c6-a589-61c26e0411bc tempest-DeleteServersTestJSON-2004159624 None] Flow 'volume_create_manager' (8a943da1-e689-4f26-bd0b-88155cce507a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:31:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3102b808-32ff-47c6-a589-61c26e0411bc tempest-DeleteServersTestJSON-2004159624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd8b4d0-7f37-4c01-bc4b-823028216386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3102b808-32ff-47c6-a589-61c26e0411bc tempest-DeleteServersTestJSON-2004159624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd8b4d0-7f37-4c01-bc4b-823028216386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1891307697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2bbaa54-8f1c-4594-8663-1f5ab4eb67ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='636d0dccc51e4dcc8299c6d2da8c25c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:31:01Z,use_quota=True,user_id='96ffaf5dbd8445f2bc0431e765929011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3102b808-32ff-47c6-a589-61c26e0411bc tempest-DeleteServersTestJSON-2004159624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (472db645-67cb-4be9-b390-20b96a356fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3102b808-32ff-47c6-a589-61c26e0411bc tempest-DeleteServersTestJSON-2004159624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (472db645-67cb-4be9-b390-20b96a356fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3102b808-32ff-47c6-a589-61c26e0411bc tempest-DeleteServersTestJSON-2004159624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a73a720-d052-4bff-865c-f39d50684d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3102b808-32ff-47c6-a589-61c26e0411bc tempest-DeleteServersTestJSON-2004159624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a73a720-d052-4bff-865c-f39d50684d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2bbaa54-8f1c-4594-8663-1f5ab4eb67ba', 'volume_name': 'volume-f2bbaa54-8f1c-4594-8663-1f5ab4eb67ba', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3102b808-32ff-47c6-a589-61c26e0411bc tempest-DeleteServersTestJSON-2004159624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11b92aef-e7d7-42de-ae5c-9b3296c8adf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3102b808-32ff-47c6-a589-61c26e0411bc tempest-DeleteServersTestJSON-2004159624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11b92aef-e7d7-42de-ae5c-9b3296c8adf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3102b808-32ff-47c6-a589-61c26e0411bc tempest-DeleteServersTestJSON-2004159624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b34d40f4-5ff8-400e-8ee5-a4ee66140dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:00 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-3102b808-32ff-47c6-a589-61c26e0411bc tempest-DeleteServersTestJSON-2004159624 None] Volume f2bbaa54-8f1c-4594-8663-1f5ab4eb67ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2bbaa54-8f1c-4594-8663-1f5ab4eb67ba', 'volume_size': 1} Jul 08 01:31:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3102b808-32ff-47c6-a589-61c26e0411bc tempest-DeleteServersTestJSON-2004159624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3102b808-32ff-47c6-a589-61c26e0411bc tempest-DeleteServersTestJSON-2004159624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3102b808-32ff-47c6-a589-61c26e0411bc tempest-DeleteServersTestJSON-2004159624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1891307697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2bbaa54-8f1c-4594-8663-1f5ab4eb67ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='636d0dccc51e4dcc8299c6d2da8c25c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:31:01Z,use_quota=True,user_id='96ffaf5dbd8445f2bc0431e765929011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:31:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-3102b808-32ff-47c6-a589-61c26e0411bc tempest-DeleteServersTestJSON-2004159624 None] Creating volume f2bbaa54-8f1c-4594-8663-1f5ab4eb67ba {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:31:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3102b808-32ff-47c6-a589-61c26e0411bc tempest-DeleteServersTestJSON-2004159624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3102b808-32ff-47c6-a589-61c26e0411bc tempest-DeleteServersTestJSON-2004159624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3102b808-32ff-47c6-a589-61c26e0411bc tempest-DeleteServersTestJSON-2004159624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:31:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3102b808-32ff-47c6-a589-61c26e0411bc tempest-DeleteServersTestJSON-2004159624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:31:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3102b808-32ff-47c6-a589-61c26e0411bc tempest-DeleteServersTestJSON-2004159624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3102b808-32ff-47c6-a589-61c26e0411bc tempest-DeleteServersTestJSON-2004159624 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:31:00 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-3102b808-32ff-47c6-a589-61c26e0411bc tempest-DeleteServersTestJSON-2004159624 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:31:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3102b808-32ff-47c6-a589-61c26e0411bc tempest-DeleteServersTestJSON-2004159624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f2bbaa54-8f1c-4594-8663-1f5ab4eb67ba 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:00 devstack sudo[88643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f2bbaa54-8f1c-4594-8663-1f5ab4eb67ba 1073741824 Jul 08 01:31:00 devstack sudo[88643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:01 devstack sudo[88643]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3102b808-32ff-47c6-a589-61c26e0411bc tempest-DeleteServersTestJSON-2004159624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f2bbaa54-8f1c-4594-8663-1f5ab4eb67ba 1073741824" returned: 0 in 1.121s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3102b808-32ff-47c6-a589-61c26e0411bc tempest-DeleteServersTestJSON-2004159624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f2bbaa54-8f1c-4594-8663-1f5ab4eb67ba {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:02 devstack sudo[88651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f2bbaa54-8f1c-4594-8663-1f5ab4eb67ba Jul 08 01:31:02 devstack sudo[88651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:02 devstack sudo[88651]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3102b808-32ff-47c6-a589-61c26e0411bc tempest-DeleteServersTestJSON-2004159624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f2bbaa54-8f1c-4594-8663-1f5ab4eb67ba" returned: 0 in 0.970s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:02 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3102b808-32ff-47c6-a589-61c26e0411bc tempest-DeleteServersTestJSON-2004159624 None] <== create_volume: return (2147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:31:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3102b808-32ff-47c6-a589-61c26e0411bc tempest-DeleteServersTestJSON-2004159624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.149s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:02 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3102b808-32ff-47c6-a589-61c26e0411bc tempest-DeleteServersTestJSON-2004159624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b34d40f4-5ff8-400e-8ee5-a4ee66140dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2bbaa54-8f1c-4594-8663-1f5ab4eb67ba', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3102b808-32ff-47c6-a589-61c26e0411bc tempest-DeleteServersTestJSON-2004159624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (180de730-df59-45e3-8078-9a9456927cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:03 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-3102b808-32ff-47c6-a589-61c26e0411bc tempest-DeleteServersTestJSON-2004159624 None] Volume volume-f2bbaa54-8f1c-4594-8663-1f5ab4eb67ba (f2bbaa54-8f1c-4594-8663-1f5ab4eb67ba): created successfully Jul 08 01:31:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3102b808-32ff-47c6-a589-61c26e0411bc tempest-DeleteServersTestJSON-2004159624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (180de730-df59-45e3-8078-9a9456927cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3102b808-32ff-47c6-a589-61c26e0411bc tempest-DeleteServersTestJSON-2004159624 None] Flow 'volume_create_manager' (8a943da1-e689-4f26-bd0b-88155cce507a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:31:03 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-3102b808-32ff-47c6-a589-61c26e0411bc tempest-DeleteServersTestJSON-2004159624 None] Created volume successfully. Jul 08 01:31:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-c235b257-ab0e-4007-9c98-780a6d027759 req-b1ca02f1-2f40-49fd-84ec-a1243c9de4f6 tempest-TaggedAttachmentsTest-723894748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-c235b257-ab0e-4007-9c98-780a6d027759 req-b1ca02f1-2f40-49fd-84ec-a1243c9de4f6 tempest-TaggedAttachmentsTest-723894748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:06 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[43aad93b-6454-441f-a24d-d8dfa460c2b9]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:31:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-c235b257-ab0e-4007-9c98-780a6d027759 req-b1ca02f1-2f40-49fd-84ec-a1243c9de4f6 tempest-TaggedAttachmentsTest-723894748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-97e50584-4560-4038-afbd-391bd801738f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:06 devstack sudo[88681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-97e50584-4560-4038-afbd-391bd801738f Jul 08 01:31:06 devstack sudo[88681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-5eb1b416-6bb4-408f-8481-26d0e7bc1796 req-667149c2-646e-47d6-b667-e64b71f26880 tempest-DeleteServersTestJSON-2004159624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:07 devstack sudo[88681]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-c235b257-ab0e-4007-9c98-780a6d027759 req-b1ca02f1-2f40-49fd-84ec-a1243c9de4f6 tempest-TaggedAttachmentsTest-723894748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-97e50584-4560-4038-afbd-391bd801738f" returned: 0 in 1.118s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-c235b257-ab0e-4007-9c98-780a6d027759 req-b1ca02f1-2f40-49fd-84ec-a1243c9de4f6 tempest-TaggedAttachmentsTest-723894748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.148s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-5eb1b416-6bb4-408f-8481-26d0e7bc1796 req-667149c2-646e-47d6-b667-e64b71f26880 tempest-DeleteServersTestJSON-2004159624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.691s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:07 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f82d8e6-bb7f-4d41-bbb0-6d71817740d8]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:31:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-5eb1b416-6bb4-408f-8481-26d0e7bc1796 req-667149c2-646e-47d6-b667-e64b71f26880 tempest-DeleteServersTestJSON-2004159624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f2bbaa54-8f1c-4594-8663-1f5ab4eb67ba {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:08 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-c235b257-ab0e-4007-9c98-780a6d027759 req-b1ca02f1-2f40-49fd-84ec-a1243c9de4f6 tempest-TaggedAttachmentsTest-723894748 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96', 'name': 'volume-97e50584-4560-4038-afbd-391bd801738f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '42e639fa-d222-412b-bf7e-ccb5f60002fc', 'enforce_multipath': True} {{(pid=87284) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:31:08 devstack sudo[88695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f2bbaa54-8f1c-4594-8663-1f5ab4eb67ba Jul 08 01:31:08 devstack sudo[88695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:08 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-c235b257-ab0e-4007-9c98-780a6d027759 req-b1ca02f1-2f40-49fd-84ec-a1243c9de4f6 tempest-TaggedAttachmentsTest-723894748 None] attachment_update completed successfully. Jul 08 01:31:08 devstack sudo[88695]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-5eb1b416-6bb4-408f-8481-26d0e7bc1796 req-667149c2-646e-47d6-b667-e64b71f26880 tempest-DeleteServersTestJSON-2004159624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f2bbaa54-8f1c-4594-8663-1f5ab4eb67ba" returned: 0 in 0.976s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-5eb1b416-6bb4-408f-8481-26d0e7bc1796 req-667149c2-646e-47d6-b667-e64b71f26880 tempest-DeleteServersTestJSON-2004159624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:09 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-5eb1b416-6bb4-408f-8481-26d0e7bc1796 req-667149c2-646e-47d6-b667-e64b71f26880 tempest-DeleteServersTestJSON-2004159624 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96', 'name': 'volume-f2bbaa54-8f1c-4594-8663-1f5ab4eb67ba', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '153d9e2a-374d-417c-974e-c8210d036cd6', 'enforce_multipath': True} {{(pid=87284) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:31:09 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-5eb1b416-6bb4-408f-8481-26d0e7bc1796 req-667149c2-646e-47d6-b667-e64b71f26880 tempest-DeleteServersTestJSON-2004159624 None] attachment_update completed successfully. Jul 08 01:31:16 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-bbe84abc-6e48-4267-9f98-40d9d946083e req-4f1a4bd1-8abc-4fe4-9f70-be691b355686 tempest-TaggedAttachmentsTest-723894748 None] Terminate volume connection completed successfully. Jul 08 01:31:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-bbe84abc-6e48-4267-9f98-40d9d946083e req-4f1a4bd1-8abc-4fe4-9f70-be691b355686 tempest-TaggedAttachmentsTest-723894748 None] Deleting attachment 42e639fa-d222-412b-bf7e-ccb5f60002fc. {{(pid=87284) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:31:18 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-0e426973-da02-4d8d-bbe0-8d6bc0c092da req-8fff9e97-6cec-4029-9125-343928141ca3 tempest-DeleteServersTestJSON-2004159624 None] Terminate volume connection completed successfully. Jul 08 01:31:18 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-0e426973-da02-4d8d-bbe0-8d6bc0c092da req-8fff9e97-6cec-4029-9125-343928141ca3 tempest-DeleteServersTestJSON-2004159624 None] Deleting attachment 153d9e2a-374d-417c-974e-c8210d036cd6. {{(pid=87284) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:31:22 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-9e4ab52b-d603-4c0a-9f5d-9277dc145887 tempest-DeleteServersTestJSON-2004159624 None] Acquiring lock "cinder-f2bbaa54-8f1c-4594-8663-1f5ab4eb67ba-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:31:22 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-9e4ab52b-d603-4c0a-9f5d-9277dc145887 tempest-DeleteServersTestJSON-2004159624 None] Lock "cinder-f2bbaa54-8f1c-4594-8663-1f5ab4eb67ba-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:31:22 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-9e4ab52b-d603-4c0a-9f5d-9277dc145887 tempest-DeleteServersTestJSON-2004159624 None] Acquiring lock "cinder-quobyte-f2bbaa54-8f1c-4594-8663-1f5ab4eb67ba" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:31:22 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-9e4ab52b-d603-4c0a-9f5d-9277dc145887 tempest-DeleteServersTestJSON-2004159624 None] Lock "cinder-quobyte-f2bbaa54-8f1c-4594-8663-1f5ab4eb67ba" acquired by "delete_volume" :: waited 0.028s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:31:22 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d32c1e8-8799-4bff-b5e1-5d0597b93cf4]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:31:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9e4ab52b-d603-4c0a-9f5d-9277dc145887 tempest-DeleteServersTestJSON-2004159624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f2bbaa54-8f1c-4594-8663-1f5ab4eb67ba {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:22 devstack sudo[89314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f2bbaa54-8f1c-4594-8663-1f5ab4eb67ba Jul 08 01:31:22 devstack sudo[89314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:23 devstack sudo[89314]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9e4ab52b-d603-4c0a-9f5d-9277dc145887 tempest-DeleteServersTestJSON-2004159624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f2bbaa54-8f1c-4594-8663-1f5ab4eb67ba" returned: 0 in 0.932s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9e4ab52b-d603-4c0a-9f5d-9277dc145887 tempest-DeleteServersTestJSON-2004159624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f2bbaa54-8f1c-4594-8663-1f5ab4eb67ba {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:23 devstack sudo[89340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f2bbaa54-8f1c-4594-8663-1f5ab4eb67ba Jul 08 01:31:23 devstack sudo[89340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:24 devstack sudo[89340]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9e4ab52b-d603-4c0a-9f5d-9277dc145887 tempest-DeleteServersTestJSON-2004159624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f2bbaa54-8f1c-4594-8663-1f5ab4eb67ba" returned: 0 in 1.030s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:24 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-9e4ab52b-d603-4c0a-9f5d-9277dc145887 tempest-DeleteServersTestJSON-2004159624 None] Lock "cinder-quobyte-f2bbaa54-8f1c-4594-8663-1f5ab4eb67ba" released by "delete_volume" :: held 2.050s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:31:25 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-9e4ab52b-d603-4c0a-9f5d-9277dc145887 tempest-DeleteServersTestJSON-2004159624 None] Created reservations ['1fc8894e-07fb-4ac0-b1d6-38b74c559424', '4fc0be16-1f9a-4261-b1a2-6a5e52a5d6cd', '72d7e8c2-d251-4ee0-b8f6-ff8e3d548c9f', 'b83674fc-12e4-4ee5-a8dc-4f5d863b0706'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:31:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-9e4ab52b-d603-4c0a-9f5d-9277dc145887 tempest-DeleteServersTestJSON-2004159624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-9e4ab52b-d603-4c0a-9f5d-9277dc145887 tempest-DeleteServersTestJSON-2004159624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:25 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-9e4ab52b-d603-4c0a-9f5d-9277dc145887 tempest-DeleteServersTestJSON-2004159624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:31:25 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-9e4ab52b-d603-4c0a-9f5d-9277dc145887 tempest-DeleteServersTestJSON-2004159624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:31:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-9e4ab52b-d603-4c0a-9f5d-9277dc145887 tempest-DeleteServersTestJSON-2004159624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9e4ab52b-d603-4c0a-9f5d-9277dc145887 tempest-DeleteServersTestJSON-2004159624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:25 devstack sudo[89352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:31:25 devstack sudo[89352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:26 devstack sudo[89352]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9e4ab52b-d603-4c0a-9f5d-9277dc145887 tempest-DeleteServersTestJSON-2004159624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.222s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:26 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-9e4ab52b-d603-4c0a-9f5d-9277dc145887 tempest-DeleteServersTestJSON-2004159624 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:31:26 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-9e4ab52b-d603-4c0a-9f5d-9277dc145887 tempest-DeleteServersTestJSON-2004159624 None] Deleted volume successfully. Jul 08 01:31:26 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-9e4ab52b-d603-4c0a-9f5d-9277dc145887 tempest-DeleteServersTestJSON-2004159624 None] Lock "cinder-f2bbaa54-8f1c-4594-8663-1f5ab4eb67ba-delete_volume" released by "delete_volume" :: held 3.748s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:31:35 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=21,cinder:UPDATE=16,cinder:INSERT=1 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:31:36 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=21,cinder:INSERT=4,cinder:UPDATE=12,cinder:DELETE=2 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:31:39 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5d167fdc-85c2-4453-ab76-55ead417bb31 tempest-TaggedAttachmentsTest-723894748 None] Acquiring lock "cinder-97e50584-4560-4038-afbd-391bd801738f-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:31:39 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5d167fdc-85c2-4453-ab76-55ead417bb31 tempest-TaggedAttachmentsTest-723894748 None] Lock "cinder-97e50584-4560-4038-afbd-391bd801738f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:31:39 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5d167fdc-85c2-4453-ab76-55ead417bb31 tempest-TaggedAttachmentsTest-723894748 None] Acquiring lock "cinder-quobyte-97e50584-4560-4038-afbd-391bd801738f" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:31:39 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5d167fdc-85c2-4453-ab76-55ead417bb31 tempest-TaggedAttachmentsTest-723894748 None] Lock "cinder-quobyte-97e50584-4560-4038-afbd-391bd801738f" acquired by "delete_volume" :: waited 0.016s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:31:39 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d220d4f-db06-445b-8606-a30b94ff440d]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:31:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5d167fdc-85c2-4453-ab76-55ead417bb31 tempest-TaggedAttachmentsTest-723894748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-97e50584-4560-4038-afbd-391bd801738f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:39 devstack sudo[89498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-97e50584-4560-4038-afbd-391bd801738f Jul 08 01:31:39 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:40 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5d167fdc-85c2-4453-ab76-55ead417bb31 tempest-TaggedAttachmentsTest-723894748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-97e50584-4560-4038-afbd-391bd801738f" returned: 0 in 0.989s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5d167fdc-85c2-4453-ab76-55ead417bb31 tempest-TaggedAttachmentsTest-723894748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-97e50584-4560-4038-afbd-391bd801738f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:40 devstack sudo[89504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-97e50584-4560-4038-afbd-391bd801738f Jul 08 01:31:40 devstack sudo[89504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:41 devstack sudo[89504]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5d167fdc-85c2-4453-ab76-55ead417bb31 tempest-TaggedAttachmentsTest-723894748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-97e50584-4560-4038-afbd-391bd801738f" returned: 0 in 1.220s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:41 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5d167fdc-85c2-4453-ab76-55ead417bb31 tempest-TaggedAttachmentsTest-723894748 None] Lock "cinder-quobyte-97e50584-4560-4038-afbd-391bd801738f" released by "delete_volume" :: held 2.293s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:31:41 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-5d167fdc-85c2-4453-ab76-55ead417bb31 tempest-TaggedAttachmentsTest-723894748 None] Created reservations ['6252dcea-a493-45f6-a1ac-7b3bc7b3b308', '0aa4fef3-00bb-4871-8999-9e2bbb314c93', '82a80942-3e76-4e44-afb0-17ecacefa8d8', '1dbbbb91-3fca-4783-ad13-2d36feb92e3a'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:31:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5d167fdc-85c2-4453-ab76-55ead417bb31 tempest-TaggedAttachmentsTest-723894748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5d167fdc-85c2-4453-ab76-55ead417bb31 tempest-TaggedAttachmentsTest-723894748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:42 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5d167fdc-85c2-4453-ab76-55ead417bb31 tempest-TaggedAttachmentsTest-723894748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:31:42 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5d167fdc-85c2-4453-ab76-55ead417bb31 tempest-TaggedAttachmentsTest-723894748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:31:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5d167fdc-85c2-4453-ab76-55ead417bb31 tempest-TaggedAttachmentsTest-723894748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5d167fdc-85c2-4453-ab76-55ead417bb31 tempest-TaggedAttachmentsTest-723894748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:42 devstack sudo[89513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:31:42 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:42 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5d167fdc-85c2-4453-ab76-55ead417bb31 tempest-TaggedAttachmentsTest-723894748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.738s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:42 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-5d167fdc-85c2-4453-ab76-55ead417bb31 tempest-TaggedAttachmentsTest-723894748 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:31:42 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-5d167fdc-85c2-4453-ab76-55ead417bb31 tempest-TaggedAttachmentsTest-723894748 None] Deleted volume successfully. Jul 08 01:31:42 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5d167fdc-85c2-4453-ab76-55ead417bb31 tempest-TaggedAttachmentsTest-723894748 None] Lock "cinder-97e50584-4560-4038-afbd-391bd801738f-delete_volume" released by "delete_volume" :: held 3.302s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:31:51 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=4,cinder:UPDATE=12,cinder:INSERT=2 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:31:52 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:31:55 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:31:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:31:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:31:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:55 devstack sudo[89593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:31:55 devstack sudo[89593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:56 devstack sudo[89593]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.951s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:56 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:32:03 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c24f60bf-0b10-4d87-8355-c2dcc245cf03 tempest-AttachVolumeShelveTestJSON-1284811158 None] Acquiring lock "cinder-81a2c2ed-2ba9-49dc-ba0a-9e36dc2b712c-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:03 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c24f60bf-0b10-4d87-8355-c2dcc245cf03 tempest-AttachVolumeShelveTestJSON-1284811158 None] Lock "cinder-81a2c2ed-2ba9-49dc-ba0a-9e36dc2b712c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:03 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c24f60bf-0b10-4d87-8355-c2dcc245cf03 tempest-AttachVolumeShelveTestJSON-1284811158 None] Acquiring lock "cinder-quobyte-81a2c2ed-2ba9-49dc-ba0a-9e36dc2b712c" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:03 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c24f60bf-0b10-4d87-8355-c2dcc245cf03 tempest-AttachVolumeShelveTestJSON-1284811158 None] Lock "cinder-quobyte-81a2c2ed-2ba9-49dc-ba0a-9e36dc2b712c" acquired by "delete_volume" :: waited 0.023s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:03 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd0f7e6-0100-47d1-8ce5-609166c22018]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c24f60bf-0b10-4d87-8355-c2dcc245cf03 tempest-AttachVolumeShelveTestJSON-1284811158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-81a2c2ed-2ba9-49dc-ba0a-9e36dc2b712c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:04 devstack sudo[89671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-81a2c2ed-2ba9-49dc-ba0a-9e36dc2b712c Jul 08 01:32:04 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:05 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c24f60bf-0b10-4d87-8355-c2dcc245cf03 tempest-AttachVolumeShelveTestJSON-1284811158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-81a2c2ed-2ba9-49dc-ba0a-9e36dc2b712c" returned: 0 in 1.300s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c24f60bf-0b10-4d87-8355-c2dcc245cf03 tempest-AttachVolumeShelveTestJSON-1284811158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-81a2c2ed-2ba9-49dc-ba0a-9e36dc2b712c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:05 devstack sudo[89695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-81a2c2ed-2ba9-49dc-ba0a-9e36dc2b712c Jul 08 01:32:05 devstack sudo[89695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:06 devstack sudo[89695]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c24f60bf-0b10-4d87-8355-c2dcc245cf03 tempest-AttachVolumeShelveTestJSON-1284811158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-81a2c2ed-2ba9-49dc-ba0a-9e36dc2b712c" returned: 0 in 0.995s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:06 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c24f60bf-0b10-4d87-8355-c2dcc245cf03 tempest-AttachVolumeShelveTestJSON-1284811158 None] Lock "cinder-quobyte-81a2c2ed-2ba9-49dc-ba0a-9e36dc2b712c" released by "delete_volume" :: held 2.377s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:06 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-c24f60bf-0b10-4d87-8355-c2dcc245cf03 tempest-AttachVolumeShelveTestJSON-1284811158 None] Created reservations ['3a7bea93-9e24-4ffc-a21e-13c044b5eaf7', 'f14e41a4-1b5c-4bb5-8fa2-e73467203c9d', 'd2fbab14-9dd5-43fa-b2ce-7c618d86e5d6', '7c1d059d-6eb6-46ca-84b0-77aa5f55f326'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:32:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c24f60bf-0b10-4d87-8355-c2dcc245cf03 tempest-AttachVolumeShelveTestJSON-1284811158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c24f60bf-0b10-4d87-8355-c2dcc245cf03 tempest-AttachVolumeShelveTestJSON-1284811158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:06 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c24f60bf-0b10-4d87-8355-c2dcc245cf03 tempest-AttachVolumeShelveTestJSON-1284811158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:32:06 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c24f60bf-0b10-4d87-8355-c2dcc245cf03 tempest-AttachVolumeShelveTestJSON-1284811158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:32:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c24f60bf-0b10-4d87-8355-c2dcc245cf03 tempest-AttachVolumeShelveTestJSON-1284811158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c24f60bf-0b10-4d87-8355-c2dcc245cf03 tempest-AttachVolumeShelveTestJSON-1284811158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:06 devstack sudo[89704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:32:06 devstack sudo[89704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:07 devstack sudo[89704]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c24f60bf-0b10-4d87-8355-c2dcc245cf03 tempest-AttachVolumeShelveTestJSON-1284811158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.255s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:07 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-c24f60bf-0b10-4d87-8355-c2dcc245cf03 tempest-AttachVolumeShelveTestJSON-1284811158 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:32:07 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-c24f60bf-0b10-4d87-8355-c2dcc245cf03 tempest-AttachVolumeShelveTestJSON-1284811158 None] Deleted volume successfully. Jul 08 01:32:07 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c24f60bf-0b10-4d87-8355-c2dcc245cf03 tempest-AttachVolumeShelveTestJSON-1284811158 None] Lock "cinder-81a2c2ed-2ba9-49dc-ba0a-9e36dc2b712c-delete_volume" released by "delete_volume" :: held 3.976s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:16 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:UPDATE=9,cinder:SELECT=5,cinder:INSERT=4 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:32:17 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=5,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:32:19 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-07d84cb2-c1fd-4fb5-a380-7947bcb4010d tempest-ServersNegativeTestJSON-1000969047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:32:19 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07d84cb2-c1fd-4fb5-a380-7947bcb4010d tempest-ServersNegativeTestJSON-1000969047 None] Flow 'volume_create_manager' (87485608-de69-4e63-8247-13c276ce3627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:32:19 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07d84cb2-c1fd-4fb5-a380-7947bcb4010d tempest-ServersNegativeTestJSON-1000969047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (526e5aec-3793-4b6b-9c64-a2cc9aa0e3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:19 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07d84cb2-c1fd-4fb5-a380-7947bcb4010d tempest-ServersNegativeTestJSON-1000969047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (526e5aec-3793-4b6b-9c64-a2cc9aa0e3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-686774129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d958e52d-04fb-4900-af2a-d88679c99ec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64aa5ffc7be0446789e7676366e5e493',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:32:19Z,use_quota=True,user_id='4534a616927f46bab7165fbc8e37729c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:19 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07d84cb2-c1fd-4fb5-a380-7947bcb4010d tempest-ServersNegativeTestJSON-1000969047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94cefa2a-e111-43d3-8130-2e37f22c2831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:19 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07d84cb2-c1fd-4fb5-a380-7947bcb4010d tempest-ServersNegativeTestJSON-1000969047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94cefa2a-e111-43d3-8130-2e37f22c2831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:19 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07d84cb2-c1fd-4fb5-a380-7947bcb4010d tempest-ServersNegativeTestJSON-1000969047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d2d46fb-95a4-45c0-ac68-e7d864f31a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:19 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07d84cb2-c1fd-4fb5-a380-7947bcb4010d tempest-ServersNegativeTestJSON-1000969047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d2d46fb-95a4-45c0-ac68-e7d864f31a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd958e52d-04fb-4900-af2a-d88679c99ec0', 'volume_name': 'volume-d958e52d-04fb-4900-af2a-d88679c99ec0', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:19 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07d84cb2-c1fd-4fb5-a380-7947bcb4010d tempest-ServersNegativeTestJSON-1000969047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f25b4382-1a81-4e9a-9c4e-6b20d5e7664a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:19 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07d84cb2-c1fd-4fb5-a380-7947bcb4010d tempest-ServersNegativeTestJSON-1000969047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f25b4382-1a81-4e9a-9c4e-6b20d5e7664a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:19 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07d84cb2-c1fd-4fb5-a380-7947bcb4010d tempest-ServersNegativeTestJSON-1000969047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21bfb9d8-016d-4dad-b942-670ccb506727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:19 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-07d84cb2-c1fd-4fb5-a380-7947bcb4010d tempest-ServersNegativeTestJSON-1000969047 None] Volume d958e52d-04fb-4900-af2a-d88679c99ec0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d958e52d-04fb-4900-af2a-d88679c99ec0', 'volume_size': 1} Jul 08 01:32:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-07d84cb2-c1fd-4fb5-a380-7947bcb4010d tempest-ServersNegativeTestJSON-1000969047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-07d84cb2-c1fd-4fb5-a380-7947bcb4010d tempest-ServersNegativeTestJSON-1000969047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:19 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-07d84cb2-c1fd-4fb5-a380-7947bcb4010d tempest-ServersNegativeTestJSON-1000969047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-686774129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d958e52d-04fb-4900-af2a-d88679c99ec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64aa5ffc7be0446789e7676366e5e493',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:32:19Z,use_quota=True,user_id='4534a616927f46bab7165fbc8e37729c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:32:19 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-07d84cb2-c1fd-4fb5-a380-7947bcb4010d tempest-ServersNegativeTestJSON-1000969047 None] Creating volume d958e52d-04fb-4900-af2a-d88679c99ec0 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:32:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-07d84cb2-c1fd-4fb5-a380-7947bcb4010d tempest-ServersNegativeTestJSON-1000969047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-07d84cb2-c1fd-4fb5-a380-7947bcb4010d tempest-ServersNegativeTestJSON-1000969047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:19 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-07d84cb2-c1fd-4fb5-a380-7947bcb4010d tempest-ServersNegativeTestJSON-1000969047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:32:19 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-07d84cb2-c1fd-4fb5-a380-7947bcb4010d tempest-ServersNegativeTestJSON-1000969047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:32:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-07d84cb2-c1fd-4fb5-a380-7947bcb4010d tempest-ServersNegativeTestJSON-1000969047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:19 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-07d84cb2-c1fd-4fb5-a380-7947bcb4010d tempest-ServersNegativeTestJSON-1000969047 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:32:19 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-07d84cb2-c1fd-4fb5-a380-7947bcb4010d tempest-ServersNegativeTestJSON-1000969047 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:32:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-07d84cb2-c1fd-4fb5-a380-7947bcb4010d tempest-ServersNegativeTestJSON-1000969047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d958e52d-04fb-4900-af2a-d88679c99ec0 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:19 devstack sudo[89880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d958e52d-04fb-4900-af2a-d88679c99ec0 1073741824 Jul 08 01:32:19 devstack sudo[89880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:21 devstack sudo[89880]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-07d84cb2-c1fd-4fb5-a380-7947bcb4010d tempest-ServersNegativeTestJSON-1000969047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d958e52d-04fb-4900-af2a-d88679c99ec0 1073741824" returned: 0 in 1.601s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-07d84cb2-c1fd-4fb5-a380-7947bcb4010d tempest-ServersNegativeTestJSON-1000969047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d958e52d-04fb-4900-af2a-d88679c99ec0 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:21 devstack sudo[89885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d958e52d-04fb-4900-af2a-d88679c99ec0 Jul 08 01:32:21 devstack sudo[89885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:22 devstack sudo[89885]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-07d84cb2-c1fd-4fb5-a380-7947bcb4010d tempest-ServersNegativeTestJSON-1000969047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d958e52d-04fb-4900-af2a-d88679c99ec0" returned: 0 in 1.324s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:22 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-07d84cb2-c1fd-4fb5-a380-7947bcb4010d tempest-ServersNegativeTestJSON-1000969047 None] <== create_volume: return (3051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:32:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-07d84cb2-c1fd-4fb5-a380-7947bcb4010d tempest-ServersNegativeTestJSON-1000969047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.073s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07d84cb2-c1fd-4fb5-a380-7947bcb4010d tempest-ServersNegativeTestJSON-1000969047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21bfb9d8-016d-4dad-b942-670ccb506727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d958e52d-04fb-4900-af2a-d88679c99ec0', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07d84cb2-c1fd-4fb5-a380-7947bcb4010d tempest-ServersNegativeTestJSON-1000969047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c8ce9fe-28a1-497a-919b-424c73b16be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:22 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-07d84cb2-c1fd-4fb5-a380-7947bcb4010d tempest-ServersNegativeTestJSON-1000969047 None] Volume volume-d958e52d-04fb-4900-af2a-d88679c99ec0 (d958e52d-04fb-4900-af2a-d88679c99ec0): created successfully Jul 08 01:32:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07d84cb2-c1fd-4fb5-a380-7947bcb4010d tempest-ServersNegativeTestJSON-1000969047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c8ce9fe-28a1-497a-919b-424c73b16be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07d84cb2-c1fd-4fb5-a380-7947bcb4010d tempest-ServersNegativeTestJSON-1000969047 None] Flow 'volume_create_manager' (87485608-de69-4e63-8247-13c276ce3627) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:32:22 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-07d84cb2-c1fd-4fb5-a380-7947bcb4010d tempest-ServersNegativeTestJSON-1000969047 None] Created volume successfully. Jul 08 01:32:24 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [req-f0bcef28-64bd-467f-bb95-d0cae238a68b req-40e4f96b-3dfe-48d0-8af8-22212bf49a85 tempest-VolumesSnapshotsTestJSON-777488311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:32:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-f0bcef28-64bd-467f-bb95-d0cae238a68b req-40e4f96b-3dfe-48d0-8af8-22212bf49a85 tempest-VolumesSnapshotsTestJSON-777488311 None] Flow 'volume_create_manager' (b7f53c15-39f1-4f15-948f-c152956b7421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:32:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-f0bcef28-64bd-467f-bb95-d0cae238a68b req-40e4f96b-3dfe-48d0-8af8-22212bf49a85 tempest-VolumesSnapshotsTestJSON-777488311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cececcf8-78c4-4e05-bfd4-cad8e23992f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-f0bcef28-64bd-467f-bb95-d0cae238a68b req-40e4f96b-3dfe-48d0-8af8-22212bf49a85 tempest-VolumesSnapshotsTestJSON-777488311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cececcf8-78c4-4e05-bfd4-cad8e23992f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1316523863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dddde4e5-b011-4873-8f7f-dc53d0031594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20bb7f17ec83468bafc656c3342fec46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:32:24Z,use_quota=True,user_id='cacab0e17dcf4d558940db542a1db69f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-f0bcef28-64bd-467f-bb95-d0cae238a68b req-40e4f96b-3dfe-48d0-8af8-22212bf49a85 tempest-VolumesSnapshotsTestJSON-777488311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (262a4a5c-909d-41a5-8cad-0dba86747367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-f0bcef28-64bd-467f-bb95-d0cae238a68b req-40e4f96b-3dfe-48d0-8af8-22212bf49a85 tempest-VolumesSnapshotsTestJSON-777488311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (262a4a5c-909d-41a5-8cad-0dba86747367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-f0bcef28-64bd-467f-bb95-d0cae238a68b req-40e4f96b-3dfe-48d0-8af8-22212bf49a85 tempest-VolumesSnapshotsTestJSON-777488311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a019117a-fbfc-4ad0-a2e0-e43a81edc909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-f0bcef28-64bd-467f-bb95-d0cae238a68b req-40e4f96b-3dfe-48d0-8af8-22212bf49a85 tempest-VolumesSnapshotsTestJSON-777488311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a019117a-fbfc-4ad0-a2e0-e43a81edc909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dddde4e5-b011-4873-8f7f-dc53d0031594', 'volume_name': 'volume-dddde4e5-b011-4873-8f7f-dc53d0031594', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-f0bcef28-64bd-467f-bb95-d0cae238a68b req-40e4f96b-3dfe-48d0-8af8-22212bf49a85 tempest-VolumesSnapshotsTestJSON-777488311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (662c6b67-a1a5-4367-a2e2-a23a60f1bcae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-f0bcef28-64bd-467f-bb95-d0cae238a68b req-40e4f96b-3dfe-48d0-8af8-22212bf49a85 tempest-VolumesSnapshotsTestJSON-777488311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (662c6b67-a1a5-4367-a2e2-a23a60f1bcae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-f0bcef28-64bd-467f-bb95-d0cae238a68b req-40e4f96b-3dfe-48d0-8af8-22212bf49a85 tempest-VolumesSnapshotsTestJSON-777488311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f8af1fc-fe1e-4e19-b410-e23227bd5e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:24 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [req-f0bcef28-64bd-467f-bb95-d0cae238a68b req-40e4f96b-3dfe-48d0-8af8-22212bf49a85 tempest-VolumesSnapshotsTestJSON-777488311 None] Volume dddde4e5-b011-4873-8f7f-dc53d0031594: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dddde4e5-b011-4873-8f7f-dc53d0031594', 'volume_size': 1} Jul 08 01:32:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-f0bcef28-64bd-467f-bb95-d0cae238a68b req-40e4f96b-3dfe-48d0-8af8-22212bf49a85 tempest-VolumesSnapshotsTestJSON-777488311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-f0bcef28-64bd-467f-bb95-d0cae238a68b req-40e4f96b-3dfe-48d0-8af8-22212bf49a85 tempest-VolumesSnapshotsTestJSON-777488311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:24 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [req-f0bcef28-64bd-467f-bb95-d0cae238a68b req-40e4f96b-3dfe-48d0-8af8-22212bf49a85 tempest-VolumesSnapshotsTestJSON-777488311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1316523863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dddde4e5-b011-4873-8f7f-dc53d0031594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20bb7f17ec83468bafc656c3342fec46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:32:24Z,use_quota=True,user_id='cacab0e17dcf4d558940db542a1db69f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:32:24 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [req-f0bcef28-64bd-467f-bb95-d0cae238a68b req-40e4f96b-3dfe-48d0-8af8-22212bf49a85 tempest-VolumesSnapshotsTestJSON-777488311 None] Creating volume dddde4e5-b011-4873-8f7f-dc53d0031594 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:32:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-f0bcef28-64bd-467f-bb95-d0cae238a68b req-40e4f96b-3dfe-48d0-8af8-22212bf49a85 tempest-VolumesSnapshotsTestJSON-777488311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-f0bcef28-64bd-467f-bb95-d0cae238a68b req-40e4f96b-3dfe-48d0-8af8-22212bf49a85 tempest-VolumesSnapshotsTestJSON-777488311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:24 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [req-f0bcef28-64bd-467f-bb95-d0cae238a68b req-40e4f96b-3dfe-48d0-8af8-22212bf49a85 tempest-VolumesSnapshotsTestJSON-777488311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:32:24 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [req-f0bcef28-64bd-467f-bb95-d0cae238a68b req-40e4f96b-3dfe-48d0-8af8-22212bf49a85 tempest-VolumesSnapshotsTestJSON-777488311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:32:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-f0bcef28-64bd-467f-bb95-d0cae238a68b req-40e4f96b-3dfe-48d0-8af8-22212bf49a85 tempest-VolumesSnapshotsTestJSON-777488311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:24 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [req-f0bcef28-64bd-467f-bb95-d0cae238a68b req-40e4f96b-3dfe-48d0-8af8-22212bf49a85 tempest-VolumesSnapshotsTestJSON-777488311 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:32:24 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [req-f0bcef28-64bd-467f-bb95-d0cae238a68b req-40e4f96b-3dfe-48d0-8af8-22212bf49a85 tempest-VolumesSnapshotsTestJSON-777488311 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:32:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-f0bcef28-64bd-467f-bb95-d0cae238a68b req-40e4f96b-3dfe-48d0-8af8-22212bf49a85 tempest-VolumesSnapshotsTestJSON-777488311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:24 devstack sudo[89930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594 1073741824 Jul 08 01:32:24 devstack sudo[89930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:25 devstack sudo[89930]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-f0bcef28-64bd-467f-bb95-d0cae238a68b req-40e4f96b-3dfe-48d0-8af8-22212bf49a85 tempest-VolumesSnapshotsTestJSON-777488311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594 1073741824" returned: 0 in 1.270s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-f0bcef28-64bd-467f-bb95-d0cae238a68b req-40e4f96b-3dfe-48d0-8af8-22212bf49a85 tempest-VolumesSnapshotsTestJSON-777488311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:25 devstack sudo[89944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594 Jul 08 01:32:25 devstack sudo[89944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:25 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-35e4cae2-2539-4c00-bb21-9fb896d1bdef tempest-ServersNegativeTestJSON-1000969047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:32:25 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-35e4cae2-2539-4c00-bb21-9fb896d1bdef tempest-ServersNegativeTestJSON-1000969047 None] Flow 'volume_create_manager' (c2feb54a-840a-4a7a-a0bd-bea0ebca541e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:32:25 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-35e4cae2-2539-4c00-bb21-9fb896d1bdef tempest-ServersNegativeTestJSON-1000969047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2659e984-6a00-4305-ab7a-364e90993efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:25 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-35e4cae2-2539-4c00-bb21-9fb896d1bdef tempest-ServersNegativeTestJSON-1000969047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2659e984-6a00-4305-ab7a-364e90993efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1463823045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f63c866d-e6f7-4ab7-8721-a3d0d1328c89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64aa5ffc7be0446789e7676366e5e493',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:32:26Z,use_quota=True,user_id='4534a616927f46bab7165fbc8e37729c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-35e4cae2-2539-4c00-bb21-9fb896d1bdef tempest-ServersNegativeTestJSON-1000969047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4808abd3-8fd3-4d7b-81c2-c6909798ad7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-35e4cae2-2539-4c00-bb21-9fb896d1bdef tempest-ServersNegativeTestJSON-1000969047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4808abd3-8fd3-4d7b-81c2-c6909798ad7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-35e4cae2-2539-4c00-bb21-9fb896d1bdef tempest-ServersNegativeTestJSON-1000969047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a067c6c-cce8-4a7c-8691-3b84af954c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-35e4cae2-2539-4c00-bb21-9fb896d1bdef tempest-ServersNegativeTestJSON-1000969047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a067c6c-cce8-4a7c-8691-3b84af954c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f63c866d-e6f7-4ab7-8721-a3d0d1328c89', 'volume_name': 'volume-f63c866d-e6f7-4ab7-8721-a3d0d1328c89', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-35e4cae2-2539-4c00-bb21-9fb896d1bdef tempest-ServersNegativeTestJSON-1000969047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c091970-0a17-46eb-8218-3b11571f6098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-35e4cae2-2539-4c00-bb21-9fb896d1bdef tempest-ServersNegativeTestJSON-1000969047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c091970-0a17-46eb-8218-3b11571f6098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-35e4cae2-2539-4c00-bb21-9fb896d1bdef tempest-ServersNegativeTestJSON-1000969047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b43b135d-7583-4d13-9041-d59bc93b98c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:26 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-35e4cae2-2539-4c00-bb21-9fb896d1bdef tempest-ServersNegativeTestJSON-1000969047 None] Volume f63c866d-e6f7-4ab7-8721-a3d0d1328c89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f63c866d-e6f7-4ab7-8721-a3d0d1328c89', 'volume_size': 1} Jul 08 01:32:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-35e4cae2-2539-4c00-bb21-9fb896d1bdef tempest-ServersNegativeTestJSON-1000969047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:26 devstack sudo[89944]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-f0bcef28-64bd-467f-bb95-d0cae238a68b req-40e4f96b-3dfe-48d0-8af8-22212bf49a85 tempest-VolumesSnapshotsTestJSON-777488311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594" returned: 0 in 0.848s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:26 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [req-f0bcef28-64bd-467f-bb95-d0cae238a68b req-40e4f96b-3dfe-48d0-8af8-22212bf49a85 tempest-VolumesSnapshotsTestJSON-777488311 None] <== create_volume: return (2171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:32:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-f0bcef28-64bd-467f-bb95-d0cae238a68b req-40e4f96b-3dfe-48d0-8af8-22212bf49a85 tempest-VolumesSnapshotsTestJSON-777488311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.177s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-35e4cae2-2539-4c00-bb21-9fb896d1bdef tempest-ServersNegativeTestJSON-1000969047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.632s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:26 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-35e4cae2-2539-4c00-bb21-9fb896d1bdef tempest-ServersNegativeTestJSON-1000969047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1463823045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f63c866d-e6f7-4ab7-8721-a3d0d1328c89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64aa5ffc7be0446789e7676366e5e493',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:32:26Z,use_quota=True,user_id='4534a616927f46bab7165fbc8e37729c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:32:26 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-35e4cae2-2539-4c00-bb21-9fb896d1bdef tempest-ServersNegativeTestJSON-1000969047 None] Creating volume f63c866d-e6f7-4ab7-8721-a3d0d1328c89 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:32:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-35e4cae2-2539-4c00-bb21-9fb896d1bdef tempest-ServersNegativeTestJSON-1000969047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-35e4cae2-2539-4c00-bb21-9fb896d1bdef tempest-ServersNegativeTestJSON-1000969047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:26 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-35e4cae2-2539-4c00-bb21-9fb896d1bdef tempest-ServersNegativeTestJSON-1000969047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:32:26 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-35e4cae2-2539-4c00-bb21-9fb896d1bdef tempest-ServersNegativeTestJSON-1000969047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:32:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-35e4cae2-2539-4c00-bb21-9fb896d1bdef tempest-ServersNegativeTestJSON-1000969047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:26 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-35e4cae2-2539-4c00-bb21-9fb896d1bdef tempest-ServersNegativeTestJSON-1000969047 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:32:26 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-35e4cae2-2539-4c00-bb21-9fb896d1bdef tempest-ServersNegativeTestJSON-1000969047 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:32:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-35e4cae2-2539-4c00-bb21-9fb896d1bdef tempest-ServersNegativeTestJSON-1000969047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f63c866d-e6f7-4ab7-8721-a3d0d1328c89 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:26 devstack sudo[89947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f63c866d-e6f7-4ab7-8721-a3d0d1328c89 1073741824 Jul 08 01:32:26 devstack sudo[89947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-f0bcef28-64bd-467f-bb95-d0cae238a68b req-40e4f96b-3dfe-48d0-8af8-22212bf49a85 tempest-VolumesSnapshotsTestJSON-777488311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f8af1fc-fe1e-4e19-b410-e23227bd5e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dddde4e5-b011-4873-8f7f-dc53d0031594', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-f0bcef28-64bd-467f-bb95-d0cae238a68b req-40e4f96b-3dfe-48d0-8af8-22212bf49a85 tempest-VolumesSnapshotsTestJSON-777488311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c170e738-ed3a-4909-8ecb-d3d2410d0b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:26 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [req-f0bcef28-64bd-467f-bb95-d0cae238a68b req-40e4f96b-3dfe-48d0-8af8-22212bf49a85 tempest-VolumesSnapshotsTestJSON-777488311 None] Volume volume-dddde4e5-b011-4873-8f7f-dc53d0031594 (dddde4e5-b011-4873-8f7f-dc53d0031594): created successfully Jul 08 01:32:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-f0bcef28-64bd-467f-bb95-d0cae238a68b req-40e4f96b-3dfe-48d0-8af8-22212bf49a85 tempest-VolumesSnapshotsTestJSON-777488311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c170e738-ed3a-4909-8ecb-d3d2410d0b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-f0bcef28-64bd-467f-bb95-d0cae238a68b req-40e4f96b-3dfe-48d0-8af8-22212bf49a85 tempest-VolumesSnapshotsTestJSON-777488311 None] Flow 'volume_create_manager' (b7f53c15-39f1-4f15-948f-c152956b7421) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:32:26 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-f0bcef28-64bd-467f-bb95-d0cae238a68b req-40e4f96b-3dfe-48d0-8af8-22212bf49a85 tempest-VolumesSnapshotsTestJSON-777488311 None] Created volume successfully. Jul 08 01:32:27 devstack sudo[89947]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-35e4cae2-2539-4c00-bb21-9fb896d1bdef tempest-ServersNegativeTestJSON-1000969047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f63c866d-e6f7-4ab7-8721-a3d0d1328c89 1073741824" returned: 0 in 0.933s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-35e4cae2-2539-4c00-bb21-9fb896d1bdef tempest-ServersNegativeTestJSON-1000969047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f63c866d-e6f7-4ab7-8721-a3d0d1328c89 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:27 devstack sudo[89953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f63c866d-e6f7-4ab7-8721-a3d0d1328c89 Jul 08 01:32:27 devstack sudo[89953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-c35c88ab-2791-4a47-bccc-038888248312 req-a11be980-643b-422e-ac97-226662517b4c tempest-VolumesSnapshotsTestJSON-777488311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:28 devstack sudo[89953]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-35e4cae2-2539-4c00-bb21-9fb896d1bdef tempest-ServersNegativeTestJSON-1000969047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f63c866d-e6f7-4ab7-8721-a3d0d1328c89" returned: 0 in 1.070s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:28 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-35e4cae2-2539-4c00-bb21-9fb896d1bdef tempest-ServersNegativeTestJSON-1000969047 None] <== create_volume: return (2064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:32:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-35e4cae2-2539-4c00-bb21-9fb896d1bdef tempest-ServersNegativeTestJSON-1000969047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.068s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-c35c88ab-2791-4a47-bccc-038888248312 req-a11be980-643b-422e-ac97-226662517b4c tempest-VolumesSnapshotsTestJSON-777488311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.396s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-35e4cae2-2539-4c00-bb21-9fb896d1bdef tempest-ServersNegativeTestJSON-1000969047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b43b135d-7583-4d13-9041-d59bc93b98c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f63c866d-e6f7-4ab7-8721-a3d0d1328c89', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-35e4cae2-2539-4c00-bb21-9fb896d1bdef tempest-ServersNegativeTestJSON-1000969047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6444479-feb0-444c-bd31-d5d791b033c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:28 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [req-c35c88ab-2791-4a47-bccc-038888248312 req-a11be980-643b-422e-ac97-226662517b4c tempest-VolumesSnapshotsTestJSON-777488311 None] Creating offline snapshot fba3f9a6-6f02-4d8e-82ba-6723036b401c of volume dddde4e5-b011-4873-8f7f-dc53d0031594 {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:32:28 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-35e4cae2-2539-4c00-bb21-9fb896d1bdef tempest-ServersNegativeTestJSON-1000969047 None] Volume volume-f63c866d-e6f7-4ab7-8721-a3d0d1328c89 (f63c866d-e6f7-4ab7-8721-a3d0d1328c89): created successfully Jul 08 01:32:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-35e4cae2-2539-4c00-bb21-9fb896d1bdef tempest-ServersNegativeTestJSON-1000969047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6444479-feb0-444c-bd31-d5d791b033c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-35e4cae2-2539-4c00-bb21-9fb896d1bdef tempest-ServersNegativeTestJSON-1000969047 None] Flow 'volume_create_manager' (c2feb54a-840a-4a7a-a0bd-bea0ebca541e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:32:28 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[65aea864-ef7a-459f-b46e-da27e232cf97]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-c35c88ab-2791-4a47-bccc-038888248312 req-a11be980-643b-422e-ac97-226662517b4c tempest-VolumesSnapshotsTestJSON-777488311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:28 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-35e4cae2-2539-4c00-bb21-9fb896d1bdef tempest-ServersNegativeTestJSON-1000969047 None] Created volume successfully. Jul 08 01:32:29 devstack sudo[89957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594 Jul 08 01:32:29 devstack sudo[89957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:29 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-96509002-c668-4261-a7db-ebfc5732c0fc tempest-ServersNegativeTestJSON-1000969047 None] Acquiring lock "cinder-f63c866d-e6f7-4ab7-8721-a3d0d1328c89-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:29 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-96509002-c668-4261-a7db-ebfc5732c0fc tempest-ServersNegativeTestJSON-1000969047 None] Lock "cinder-f63c866d-e6f7-4ab7-8721-a3d0d1328c89-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:29 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-96509002-c668-4261-a7db-ebfc5732c0fc tempest-ServersNegativeTestJSON-1000969047 None] Acquiring lock "cinder-quobyte-f63c866d-e6f7-4ab7-8721-a3d0d1328c89" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:29 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-96509002-c668-4261-a7db-ebfc5732c0fc tempest-ServersNegativeTestJSON-1000969047 None] Lock "cinder-quobyte-f63c866d-e6f7-4ab7-8721-a3d0d1328c89" acquired by "delete_volume" :: waited 0.033s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:29 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdcb8ad-108b-4b91-8f2f-edd8f63d77fc]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-96509002-c668-4261-a7db-ebfc5732c0fc tempest-ServersNegativeTestJSON-1000969047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f63c866d-e6f7-4ab7-8721-a3d0d1328c89 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:29 devstack sudo[89964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f63c866d-e6f7-4ab7-8721-a3d0d1328c89 Jul 08 01:32:29 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:30 devstack sudo[89957]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-c35c88ab-2791-4a47-bccc-038888248312 req-a11be980-643b-422e-ac97-226662517b4c tempest-VolumesSnapshotsTestJSON-777488311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594" returned: 0 in 1.199s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-c35c88ab-2791-4a47-bccc-038888248312 req-a11be980-643b-422e-ac97-226662517b4c tempest-VolumesSnapshotsTestJSON-777488311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594.fba3f9a6-6f02-4d8e-82ba-6723036b401c 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:30 devstack sudo[89970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594.fba3f9a6-6f02-4d8e-82ba-6723036b401c 1G Jul 08 01:32:30 devstack sudo[89970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:31 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-96509002-c668-4261-a7db-ebfc5732c0fc tempest-ServersNegativeTestJSON-1000969047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f63c866d-e6f7-4ab7-8721-a3d0d1328c89" returned: 0 in 1.317s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-96509002-c668-4261-a7db-ebfc5732c0fc tempest-ServersNegativeTestJSON-1000969047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f63c866d-e6f7-4ab7-8721-a3d0d1328c89 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:31 devstack sudo[89998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f63c866d-e6f7-4ab7-8721-a3d0d1328c89 Jul 08 01:32:31 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:31 devstack sudo[89970]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-c35c88ab-2791-4a47-bccc-038888248312 req-a11be980-643b-422e-ac97-226662517b4c tempest-VolumesSnapshotsTestJSON-777488311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594.fba3f9a6-6f02-4d8e-82ba-6723036b401c 1G" returned: 0 in 1.524s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-c35c88ab-2791-4a47-bccc-038888248312 req-a11be980-643b-422e-ac97-226662517b4c tempest-VolumesSnapshotsTestJSON-777488311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dddde4e5-b011-4873-8f7f-dc53d0031594 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594.fba3f9a6-6f02-4d8e-82ba-6723036b401c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:31 devstack sudo[90006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dddde4e5-b011-4873-8f7f-dc53d0031594 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594.fba3f9a6-6f02-4d8e-82ba-6723036b401c Jul 08 01:32:31 devstack sudo[90006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:31 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-96509002-c668-4261-a7db-ebfc5732c0fc tempest-ServersNegativeTestJSON-1000969047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f63c866d-e6f7-4ab7-8721-a3d0d1328c89" returned: 0 in 0.702s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:31 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-96509002-c668-4261-a7db-ebfc5732c0fc tempest-ServersNegativeTestJSON-1000969047 None] Lock "cinder-quobyte-f63c866d-e6f7-4ab7-8721-a3d0d1328c89" released by "delete_volume" :: held 2.112s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:31 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-96509002-c668-4261-a7db-ebfc5732c0fc tempest-ServersNegativeTestJSON-1000969047 None] Created reservations ['63918760-7998-465d-804c-78aa4b1436a1', '34a2a960-c4af-4a28-8ae8-02c26f3ccb60', 'c676da1d-d789-443b-9bb9-1baa6650aef4', '4a5e11f2-abf1-4f68-b20a-16796d247b5e'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:32:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-96509002-c668-4261-a7db-ebfc5732c0fc tempest-ServersNegativeTestJSON-1000969047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-96509002-c668-4261-a7db-ebfc5732c0fc tempest-ServersNegativeTestJSON-1000969047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:32 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-96509002-c668-4261-a7db-ebfc5732c0fc tempest-ServersNegativeTestJSON-1000969047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:32:32 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-96509002-c668-4261-a7db-ebfc5732c0fc tempest-ServersNegativeTestJSON-1000969047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:32:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-96509002-c668-4261-a7db-ebfc5732c0fc tempest-ServersNegativeTestJSON-1000969047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-96509002-c668-4261-a7db-ebfc5732c0fc tempest-ServersNegativeTestJSON-1000969047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:32 devstack sudo[90009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:32:32 devstack sudo[90009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:32 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1e1a5eb0-28fa-48ef-8717-961f3a72fc8d tempest-ServersNegativeTestJSON-1000969047 None] Acquiring lock "cinder-d958e52d-04fb-4900-af2a-d88679c99ec0-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:32 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1e1a5eb0-28fa-48ef-8717-961f3a72fc8d tempest-ServersNegativeTestJSON-1000969047 None] Lock "cinder-d958e52d-04fb-4900-af2a-d88679c99ec0-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:32 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1e1a5eb0-28fa-48ef-8717-961f3a72fc8d tempest-ServersNegativeTestJSON-1000969047 None] Acquiring lock "cinder-quobyte-d958e52d-04fb-4900-af2a-d88679c99ec0" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:32 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1e1a5eb0-28fa-48ef-8717-961f3a72fc8d tempest-ServersNegativeTestJSON-1000969047 None] Lock "cinder-quobyte-d958e52d-04fb-4900-af2a-d88679c99ec0" acquired by "delete_volume" :: waited 0.018s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:32 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa08eff2-8fe2-42a8-b9bd-9b6e8cb9a92b]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1e1a5eb0-28fa-48ef-8717-961f3a72fc8d tempest-ServersNegativeTestJSON-1000969047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d958e52d-04fb-4900-af2a-d88679c99ec0 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:32 devstack sudo[90012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d958e52d-04fb-4900-af2a-d88679c99ec0 Jul 08 01:32:32 devstack sudo[90012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:32 devstack sudo[90006]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-c35c88ab-2791-4a47-bccc-038888248312 req-a11be980-643b-422e-ac97-226662517b4c tempest-VolumesSnapshotsTestJSON-777488311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dddde4e5-b011-4873-8f7f-dc53d0031594 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594.fba3f9a6-6f02-4d8e-82ba-6723036b401c" returned: 0 in 0.912s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:32 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [req-c35c88ab-2791-4a47-bccc-038888248312 req-a11be980-643b-422e-ac97-226662517b4c tempest-VolumesSnapshotsTestJSON-777488311 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594.fba3f9a6-6f02-4d8e-82ba-6723036b401c is being set with open permissions: ugo+rw Jul 08 01:32:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-c35c88ab-2791-4a47-bccc-038888248312 req-a11be980-643b-422e-ac97-226662517b4c tempest-VolumesSnapshotsTestJSON-777488311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594.fba3f9a6-6f02-4d8e-82ba-6723036b401c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:32 devstack sudo[90017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594.fba3f9a6-6f02-4d8e-82ba-6723036b401c Jul 08 01:32:32 devstack sudo[90017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:32 devstack sudo[90009]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-96509002-c668-4261-a7db-ebfc5732c0fc tempest-ServersNegativeTestJSON-1000969047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.744s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:32 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-96509002-c668-4261-a7db-ebfc5732c0fc tempest-ServersNegativeTestJSON-1000969047 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:32:32 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-96509002-c668-4261-a7db-ebfc5732c0fc tempest-ServersNegativeTestJSON-1000969047 None] Deleted volume successfully. Jul 08 01:32:32 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-96509002-c668-4261-a7db-ebfc5732c0fc tempest-ServersNegativeTestJSON-1000969047 None] Lock "cinder-f63c866d-e6f7-4ab7-8721-a3d0d1328c89-delete_volume" released by "delete_volume" :: held 3.185s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:33 devstack sudo[90012]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1e1a5eb0-28fa-48ef-8717-961f3a72fc8d tempest-ServersNegativeTestJSON-1000969047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d958e52d-04fb-4900-af2a-d88679c99ec0" returned: 0 in 0.925s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1e1a5eb0-28fa-48ef-8717-961f3a72fc8d tempest-ServersNegativeTestJSON-1000969047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d958e52d-04fb-4900-af2a-d88679c99ec0 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:33 devstack sudo[90026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d958e52d-04fb-4900-af2a-d88679c99ec0 Jul 08 01:32:33 devstack sudo[90026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:33 devstack sudo[90017]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-c35c88ab-2791-4a47-bccc-038888248312 req-a11be980-643b-422e-ac97-226662517b4c tempest-VolumesSnapshotsTestJSON-777488311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594.fba3f9a6-6f02-4d8e-82ba-6723036b401c" returned: 0 in 0.720s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-c35c88ab-2791-4a47-bccc-038888248312 req-a11be980-643b-422e-ac97-226662517b4c tempest-VolumesSnapshotsTestJSON-777488311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:33 devstack sudo[90028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594.info Jul 08 01:32:33 devstack sudo[90028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:33 devstack sudo[90026]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1e1a5eb0-28fa-48ef-8717-961f3a72fc8d tempest-ServersNegativeTestJSON-1000969047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d958e52d-04fb-4900-af2a-d88679c99ec0" returned: 0 in 0.706s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:33 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1e1a5eb0-28fa-48ef-8717-961f3a72fc8d tempest-ServersNegativeTestJSON-1000969047 None] Lock "cinder-quobyte-d958e52d-04fb-4900-af2a-d88679c99ec0" released by "delete_volume" :: held 1.675s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:33 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-1e1a5eb0-28fa-48ef-8717-961f3a72fc8d tempest-ServersNegativeTestJSON-1000969047 None] Created reservations ['03574105-67c9-4387-a0b9-725e97fe00fe', '2387617e-542d-4fa0-ac0f-e72fdd95933d', 'a56510fb-9175-483c-9f65-65f2ec9f1d91', 'af36ca4c-49a3-47bf-a266-eed874e99604'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:32:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-1e1a5eb0-28fa-48ef-8717-961f3a72fc8d tempest-ServersNegativeTestJSON-1000969047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-1e1a5eb0-28fa-48ef-8717-961f3a72fc8d tempest-ServersNegativeTestJSON-1000969047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:34 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-1e1a5eb0-28fa-48ef-8717-961f3a72fc8d tempest-ServersNegativeTestJSON-1000969047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:32:34 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-1e1a5eb0-28fa-48ef-8717-961f3a72fc8d tempest-ServersNegativeTestJSON-1000969047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:32:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-1e1a5eb0-28fa-48ef-8717-961f3a72fc8d tempest-ServersNegativeTestJSON-1000969047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1e1a5eb0-28fa-48ef-8717-961f3a72fc8d tempest-ServersNegativeTestJSON-1000969047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:34 devstack sudo[90031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:32:34 devstack sudo[90031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:34 devstack sudo[90028]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-c35c88ab-2791-4a47-bccc-038888248312 req-a11be980-643b-422e-ac97-226662517b4c tempest-VolumesSnapshotsTestJSON-777488311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594.info" returned: 0 in 0.660s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:34 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [req-c35c88ab-2791-4a47-bccc-038888248312 req-a11be980-643b-422e-ac97-226662517b4c tempest-VolumesSnapshotsTestJSON-777488311 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594.info is being set with open permissions: ugo+rw Jul 08 01:32:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-c35c88ab-2791-4a47-bccc-038888248312 req-a11be980-643b-422e-ac97-226662517b4c tempest-VolumesSnapshotsTestJSON-777488311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:34 devstack sudo[90035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594.info Jul 08 01:32:34 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:35 devstack sudo[90031]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1e1a5eb0-28fa-48ef-8717-961f3a72fc8d tempest-ServersNegativeTestJSON-1000969047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.052s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:35 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-1e1a5eb0-28fa-48ef-8717-961f3a72fc8d tempest-ServersNegativeTestJSON-1000969047 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:32:35 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-1e1a5eb0-28fa-48ef-8717-961f3a72fc8d tempest-ServersNegativeTestJSON-1000969047 None] Deleted volume successfully. Jul 08 01:32:35 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1e1a5eb0-28fa-48ef-8717-961f3a72fc8d tempest-ServersNegativeTestJSON-1000969047 None] Lock "cinder-d958e52d-04fb-4900-af2a-d88679c99ec0-delete_volume" released by "delete_volume" :: held 3.025s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:35 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-c35c88ab-2791-4a47-bccc-038888248312 req-a11be980-643b-422e-ac97-226662517b4c tempest-VolumesSnapshotsTestJSON-777488311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594.info" returned: 0 in 1.104s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-c35c88ab-2791-4a47-bccc-038888248312 req-a11be980-643b-422e-ac97-226662517b4c tempest-VolumesSnapshotsTestJSON-777488311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.727s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:35 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-c35c88ab-2791-4a47-bccc-038888248312 req-a11be980-643b-422e-ac97-226662517b4c tempest-VolumesSnapshotsTestJSON-777488311 None] Create snapshot completed successfully Jul 08 01:32:35 devstack cinder-volume[87284]: DEBUG cinder.coordination [req-57d11b42-9758-41e6-90f2-9939f312cb3e req-2d1f2147-5af7-4468-bf35-a321f47215a6 tempest-VolumesSnapshotsTestJSON-777488311 None] Acquiring lock "cinder-fba3f9a6-6f02-4d8e-82ba-6723036b401c-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:35 devstack cinder-volume[87284]: DEBUG cinder.coordination [req-57d11b42-9758-41e6-90f2-9939f312cb3e req-2d1f2147-5af7-4468-bf35-a321f47215a6 tempest-VolumesSnapshotsTestJSON-777488311 None] Lock "cinder-fba3f9a6-6f02-4d8e-82ba-6723036b401c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:35 devstack cinder-volume[87284]: DEBUG cinder.coordination [req-57d11b42-9758-41e6-90f2-9939f312cb3e req-2d1f2147-5af7-4468-bf35-a321f47215a6 tempest-VolumesSnapshotsTestJSON-777488311 None] Acquiring lock "cinder-quobyte-dddde4e5-b011-4873-8f7f-dc53d0031594" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:36 devstack cinder-volume[87284]: DEBUG cinder.coordination [req-57d11b42-9758-41e6-90f2-9939f312cb3e req-2d1f2147-5af7-4468-bf35-a321f47215a6 tempest-VolumesSnapshotsTestJSON-777488311 None] Lock "cinder-quobyte-dddde4e5-b011-4873-8f7f-dc53d0031594" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:36 devstack cinder-volume[87284]: DEBUG cinder.coordination [req-57d11b42-9758-41e6-90f2-9939f312cb3e req-2d1f2147-5af7-4468-bf35-a321f47215a6 tempest-VolumesSnapshotsTestJSON-777488311 None] Acquiring lock "cinder-quobyte-fba3f9a6-6f02-4d8e-82ba-6723036b401c" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:36 devstack cinder-volume[87284]: DEBUG cinder.coordination [req-57d11b42-9758-41e6-90f2-9939f312cb3e req-2d1f2147-5af7-4468-bf35-a321f47215a6 tempest-VolumesSnapshotsTestJSON-777488311 None] Lock "cinder-quobyte-fba3f9a6-6f02-4d8e-82ba-6723036b401c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [req-57d11b42-9758-41e6-90f2-9939f312cb3e req-2d1f2147-5af7-4468-bf35-a321f47215a6 tempest-VolumesSnapshotsTestJSON-777488311 None] Deleting offline snapshot fba3f9a6-6f02-4d8e-82ba-6723036b401c of volume dddde4e5-b011-4873-8f7f-dc53d0031594 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:32:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [req-57d11b42-9758-41e6-90f2-9939f312cb3e req-2d1f2147-5af7-4468-bf35-a321f47215a6 tempest-VolumesSnapshotsTestJSON-777488311 None] snapshot_file for this snap is: volume-dddde4e5-b011-4873-8f7f-dc53d0031594.fba3f9a6-6f02-4d8e-82ba-6723036b401c {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:32:36 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb08af94-1b08-4a95-8756-f24c5da33a01]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-57d11b42-9758-41e6-90f2-9939f312cb3e req-2d1f2147-5af7-4468-bf35-a321f47215a6 tempest-VolumesSnapshotsTestJSON-777488311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594.fba3f9a6-6f02-4d8e-82ba-6723036b401c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:36 devstack sudo[90114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594.fba3f9a6-6f02-4d8e-82ba-6723036b401c Jul 08 01:32:36 devstack sudo[90114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:38 devstack sudo[90114]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-57d11b42-9758-41e6-90f2-9939f312cb3e req-2d1f2147-5af7-4468-bf35-a321f47215a6 tempest-VolumesSnapshotsTestJSON-777488311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594.fba3f9a6-6f02-4d8e-82ba-6723036b401c" returned: 0 in 2.099s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:38 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [req-57d11b42-9758-41e6-90f2-9939f312cb3e req-2d1f2147-5af7-4468-bf35-a321f47215a6 tempest-VolumesSnapshotsTestJSON-777488311 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dddde4e5-b011-4873-8f7f-dc53d0031594(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:32:38 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[0584488d-a737-4250-a2aa-8e90f32ff3cb]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-57d11b42-9758-41e6-90f2-9939f312cb3e req-2d1f2147-5af7-4468-bf35-a321f47215a6 tempest-VolumesSnapshotsTestJSON-777488311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:38 devstack sudo[90178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594 Jul 08 01:32:38 devstack sudo[90178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:40 devstack sudo[90178]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-57d11b42-9758-41e6-90f2-9939f312cb3e req-2d1f2147-5af7-4468-bf35-a321f47215a6 tempest-VolumesSnapshotsTestJSON-777488311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594" returned: 0 in 1.895s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-57d11b42-9758-41e6-90f2-9939f312cb3e req-2d1f2147-5af7-4468-bf35-a321f47215a6 tempest-VolumesSnapshotsTestJSON-777488311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594.fba3f9a6-6f02-4d8e-82ba-6723036b401c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:40 devstack sudo[90196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594.fba3f9a6-6f02-4d8e-82ba-6723036b401c Jul 08 01:32:40 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:41 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-57d11b42-9758-41e6-90f2-9939f312cb3e req-2d1f2147-5af7-4468-bf35-a321f47215a6 tempest-VolumesSnapshotsTestJSON-777488311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594.fba3f9a6-6f02-4d8e-82ba-6723036b401c" returned: 0 in 0.953s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-57d11b42-9758-41e6-90f2-9939f312cb3e req-2d1f2147-5af7-4468-bf35-a321f47215a6 tempest-VolumesSnapshotsTestJSON-777488311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594.fba3f9a6-6f02-4d8e-82ba-6723036b401c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-57d11b42-9758-41e6-90f2-9939f312cb3e req-2d1f2147-5af7-4468-bf35-a321f47215a6 tempest-VolumesSnapshotsTestJSON-777488311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594.fba3f9a6-6f02-4d8e-82ba-6723036b401c" returned: 0 in 0.694s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:43 devstack cinder-volume[87284]: DEBUG cinder.coordination [req-57d11b42-9758-41e6-90f2-9939f312cb3e req-2d1f2147-5af7-4468-bf35-a321f47215a6 tempest-VolumesSnapshotsTestJSON-777488311 None] Lock "cinder-quobyte-fba3f9a6-6f02-4d8e-82ba-6723036b401c" released by "_delete_snapshot" :: held 5.893s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:43 devstack cinder-volume[87284]: DEBUG cinder.coordination [req-57d11b42-9758-41e6-90f2-9939f312cb3e req-2d1f2147-5af7-4468-bf35-a321f47215a6 tempest-VolumesSnapshotsTestJSON-777488311 None] Lock "cinder-quobyte-dddde4e5-b011-4873-8f7f-dc53d0031594" released by "delete_snapshot" :: held 5.924s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:43 devstack cinder-volume[87284]: WARNING cinder.quota [req-57d11b42-9758-41e6-90f2-9939f312cb3e req-2d1f2147-5af7-4468-bf35-a321f47215a6 tempest-VolumesSnapshotsTestJSON-777488311 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:32:43 devstack cinder-volume[87284]: DEBUG cinder.quota [req-57d11b42-9758-41e6-90f2-9939f312cb3e req-2d1f2147-5af7-4468-bf35-a321f47215a6 tempest-VolumesSnapshotsTestJSON-777488311 None] Created reservations ['d4339af8-3056-4cf2-a675-9b5f4f49937c', '556c011a-9496-4709-9a80-8f92844a17fb', 'eb86a199-e244-4a87-b0f3-5ce2cc780ee4', 'edc077ba-fe84-4254-b488-054f95c08e5b'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:32:43 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-57d11b42-9758-41e6-90f2-9939f312cb3e req-2d1f2147-5af7-4468-bf35-a321f47215a6 tempest-VolumesSnapshotsTestJSON-777488311 None] Delete snapshot completed successfully. Jul 08 01:32:43 devstack cinder-volume[87284]: DEBUG cinder.coordination [req-57d11b42-9758-41e6-90f2-9939f312cb3e req-2d1f2147-5af7-4468-bf35-a321f47215a6 tempest-VolumesSnapshotsTestJSON-777488311 None] Lock "cinder-fba3f9a6-6f02-4d8e-82ba-6723036b401c-delete_snapshot" released by "delete_snapshot" :: held 7.394s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:43 devstack cinder-volume[87284]: DEBUG cinder.coordination [req-7a0b5e21-2085-4676-8a4e-afdfdddf3e07 req-49897041-b0b9-4c36-8a9d-779259298b25 tempest-VolumesSnapshotsTestJSON-777488311 None] Acquiring lock "cinder-dddde4e5-b011-4873-8f7f-dc53d0031594-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:43 devstack cinder-volume[87284]: DEBUG cinder.coordination [req-7a0b5e21-2085-4676-8a4e-afdfdddf3e07 req-49897041-b0b9-4c36-8a9d-779259298b25 tempest-VolumesSnapshotsTestJSON-777488311 None] Lock "cinder-dddde4e5-b011-4873-8f7f-dc53d0031594-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:44 devstack cinder-volume[87284]: DEBUG cinder.coordination [req-7a0b5e21-2085-4676-8a4e-afdfdddf3e07 req-49897041-b0b9-4c36-8a9d-779259298b25 tempest-VolumesSnapshotsTestJSON-777488311 None] Acquiring lock "cinder-quobyte-dddde4e5-b011-4873-8f7f-dc53d0031594" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:32:44 devstack cinder-volume[87284]: DEBUG cinder.coordination [req-7a0b5e21-2085-4676-8a4e-afdfdddf3e07 req-49897041-b0b9-4c36-8a9d-779259298b25 tempest-VolumesSnapshotsTestJSON-777488311 None] Lock "cinder-quobyte-dddde4e5-b011-4873-8f7f-dc53d0031594" acquired by "delete_volume" :: waited 0.031s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:32:44 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce15a73-cc9f-4998-bf5c-3ce36584b963]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:32:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-7a0b5e21-2085-4676-8a4e-afdfdddf3e07 req-49897041-b0b9-4c36-8a9d-779259298b25 tempest-VolumesSnapshotsTestJSON-777488311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:44 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-862fe181-2a77-44db-a02b-c32a4cba7cec tempest-ServerRescueNegativeTestJSON-1380173565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:32:44 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-862fe181-2a77-44db-a02b-c32a4cba7cec tempest-ServerRescueNegativeTestJSON-1380173565 None] Flow 'volume_create_manager' (c21df4e5-cea7-4bbd-b190-065499936836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:32:44 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-862fe181-2a77-44db-a02b-c32a4cba7cec tempest-ServerRescueNegativeTestJSON-1380173565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a0595e7-0b93-40ae-a107-aa10608c0b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:44 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-862fe181-2a77-44db-a02b-c32a4cba7cec tempest-ServerRescueNegativeTestJSON-1380173565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a0595e7-0b93-40ae-a107-aa10608c0b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-120186154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ef6bec5-4709-4ad1-b0dc-41e811a2e1dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e2dac2ef74e418a80dac2ee9e51c9ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:32:44Z,use_quota=True,user_id='356dc53cc0e44b94be9d8cfa605c19a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:44 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-862fe181-2a77-44db-a02b-c32a4cba7cec tempest-ServerRescueNegativeTestJSON-1380173565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c48e6bc2-429a-48b1-9808-50b6ca9f9f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:44 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-862fe181-2a77-44db-a02b-c32a4cba7cec tempest-ServerRescueNegativeTestJSON-1380173565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c48e6bc2-429a-48b1-9808-50b6ca9f9f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:44 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-862fe181-2a77-44db-a02b-c32a4cba7cec tempest-ServerRescueNegativeTestJSON-1380173565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b2294c7-52dd-4483-88c1-2f08c352f413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:44 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-862fe181-2a77-44db-a02b-c32a4cba7cec tempest-ServerRescueNegativeTestJSON-1380173565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b2294c7-52dd-4483-88c1-2f08c352f413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ef6bec5-4709-4ad1-b0dc-41e811a2e1dd', 'volume_name': 'volume-7ef6bec5-4709-4ad1-b0dc-41e811a2e1dd', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:44 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-862fe181-2a77-44db-a02b-c32a4cba7cec tempest-ServerRescueNegativeTestJSON-1380173565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bce048d1-e265-429e-b459-81769a49ed39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:44 devstack sudo[90209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594 Jul 08 01:32:44 devstack sudo[90209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:44 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-862fe181-2a77-44db-a02b-c32a4cba7cec tempest-ServerRescueNegativeTestJSON-1380173565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bce048d1-e265-429e-b459-81769a49ed39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:44 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-862fe181-2a77-44db-a02b-c32a4cba7cec tempest-ServerRescueNegativeTestJSON-1380173565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b57e40-a26a-4a86-b890-7d6c71e0d24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:44 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-862fe181-2a77-44db-a02b-c32a4cba7cec tempest-ServerRescueNegativeTestJSON-1380173565 None] Volume 7ef6bec5-4709-4ad1-b0dc-41e811a2e1dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ef6bec5-4709-4ad1-b0dc-41e811a2e1dd', 'volume_size': 1} Jul 08 01:32:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-862fe181-2a77-44db-a02b-c32a4cba7cec tempest-ServerRescueNegativeTestJSON-1380173565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-862fe181-2a77-44db-a02b-c32a4cba7cec tempest-ServerRescueNegativeTestJSON-1380173565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:44 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-862fe181-2a77-44db-a02b-c32a4cba7cec tempest-ServerRescueNegativeTestJSON-1380173565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-120186154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ef6bec5-4709-4ad1-b0dc-41e811a2e1dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e2dac2ef74e418a80dac2ee9e51c9ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:32:44Z,use_quota=True,user_id='356dc53cc0e44b94be9d8cfa605c19a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:32:44 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-862fe181-2a77-44db-a02b-c32a4cba7cec tempest-ServerRescueNegativeTestJSON-1380173565 None] Creating volume 7ef6bec5-4709-4ad1-b0dc-41e811a2e1dd {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:32:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-862fe181-2a77-44db-a02b-c32a4cba7cec tempest-ServerRescueNegativeTestJSON-1380173565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-862fe181-2a77-44db-a02b-c32a4cba7cec tempest-ServerRescueNegativeTestJSON-1380173565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:44 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-862fe181-2a77-44db-a02b-c32a4cba7cec tempest-ServerRescueNegativeTestJSON-1380173565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:32:44 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-862fe181-2a77-44db-a02b-c32a4cba7cec tempest-ServerRescueNegativeTestJSON-1380173565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:32:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-862fe181-2a77-44db-a02b-c32a4cba7cec tempest-ServerRescueNegativeTestJSON-1380173565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:44 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-862fe181-2a77-44db-a02b-c32a4cba7cec tempest-ServerRescueNegativeTestJSON-1380173565 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:32:44 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-862fe181-2a77-44db-a02b-c32a4cba7cec tempest-ServerRescueNegativeTestJSON-1380173565 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:32:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-862fe181-2a77-44db-a02b-c32a4cba7cec tempest-ServerRescueNegativeTestJSON-1380173565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7ef6bec5-4709-4ad1-b0dc-41e811a2e1dd 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:44 devstack sudo[90212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7ef6bec5-4709-4ad1-b0dc-41e811a2e1dd 1073741824 Jul 08 01:32:44 devstack sudo[90212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:45 devstack sudo[90209]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-7a0b5e21-2085-4676-8a4e-afdfdddf3e07 req-49897041-b0b9-4c36-8a9d-779259298b25 tempest-VolumesSnapshotsTestJSON-777488311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594" returned: 0 in 1.519s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-7a0b5e21-2085-4676-8a4e-afdfdddf3e07 req-49897041-b0b9-4c36-8a9d-779259298b25 tempest-VolumesSnapshotsTestJSON-777488311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:45 devstack sudo[90224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594 Jul 08 01:32:45 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-862fe181-2a77-44db-a02b-c32a4cba7cec tempest-ServerRescueNegativeTestJSON-1380173565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7ef6bec5-4709-4ad1-b0dc-41e811a2e1dd 1073741824" returned: 0 in 1.413s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:45 devstack sudo[90212]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-862fe181-2a77-44db-a02b-c32a4cba7cec tempest-ServerRescueNegativeTestJSON-1380173565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7ef6bec5-4709-4ad1-b0dc-41e811a2e1dd {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:45 devstack sudo[90226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7ef6bec5-4709-4ad1-b0dc-41e811a2e1dd Jul 08 01:32:45 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:46 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-862fe181-2a77-44db-a02b-c32a4cba7cec tempest-ServerRescueNegativeTestJSON-1380173565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7ef6bec5-4709-4ad1-b0dc-41e811a2e1dd" returned: 0 in 1.203s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:46 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-862fe181-2a77-44db-a02b-c32a4cba7cec tempest-ServerRescueNegativeTestJSON-1380173565 None] <== create_volume: return (2687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:32:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-862fe181-2a77-44db-a02b-c32a4cba7cec tempest-ServerRescueNegativeTestJSON-1380173565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.692s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:46 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-7a0b5e21-2085-4676-8a4e-afdfdddf3e07 req-49897041-b0b9-4c36-8a9d-779259298b25 tempest-VolumesSnapshotsTestJSON-777488311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dddde4e5-b011-4873-8f7f-dc53d0031594" returned: 0 in 1.375s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-862fe181-2a77-44db-a02b-c32a4cba7cec tempest-ServerRescueNegativeTestJSON-1380173565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b57e40-a26a-4a86-b890-7d6c71e0d24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ef6bec5-4709-4ad1-b0dc-41e811a2e1dd', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-862fe181-2a77-44db-a02b-c32a4cba7cec tempest-ServerRescueNegativeTestJSON-1380173565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0217c2a8-c518-4609-a7e3-65f8c1598f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:47 devstack cinder-volume[87284]: DEBUG cinder.coordination [req-7a0b5e21-2085-4676-8a4e-afdfdddf3e07 req-49897041-b0b9-4c36-8a9d-779259298b25 tempest-VolumesSnapshotsTestJSON-777488311 None] Lock "cinder-quobyte-dddde4e5-b011-4873-8f7f-dc53d0031594" released by "delete_volume" :: held 3.060s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:47 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-862fe181-2a77-44db-a02b-c32a4cba7cec tempest-ServerRescueNegativeTestJSON-1380173565 None] Volume volume-7ef6bec5-4709-4ad1-b0dc-41e811a2e1dd (7ef6bec5-4709-4ad1-b0dc-41e811a2e1dd): created successfully Jul 08 01:32:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-862fe181-2a77-44db-a02b-c32a4cba7cec tempest-ServerRescueNegativeTestJSON-1380173565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0217c2a8-c518-4609-a7e3-65f8c1598f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-862fe181-2a77-44db-a02b-c32a4cba7cec tempest-ServerRescueNegativeTestJSON-1380173565 None] Flow 'volume_create_manager' (c21df4e5-cea7-4bbd-b190-065499936836) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:32:47 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-862fe181-2a77-44db-a02b-c32a4cba7cec tempest-ServerRescueNegativeTestJSON-1380173565 None] Created volume successfully. Jul 08 01:32:47 devstack cinder-volume[87284]: DEBUG cinder.quota [req-7a0b5e21-2085-4676-8a4e-afdfdddf3e07 req-49897041-b0b9-4c36-8a9d-779259298b25 tempest-VolumesSnapshotsTestJSON-777488311 None] Created reservations ['593dc9bc-a9a8-43a0-84af-ece77ec68307', '4bf627ae-9823-4752-a0cd-5d3485c62c72', 'a06cdb8f-e14d-4ded-b4bd-0becbad20f8a', '7058e193-4d6a-486a-a1eb-e15e7b850288'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:32:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-7a0b5e21-2085-4676-8a4e-afdfdddf3e07 req-49897041-b0b9-4c36-8a9d-779259298b25 tempest-VolumesSnapshotsTestJSON-777488311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-7a0b5e21-2085-4676-8a4e-afdfdddf3e07 req-49897041-b0b9-4c36-8a9d-779259298b25 tempest-VolumesSnapshotsTestJSON-777488311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:47 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [req-7a0b5e21-2085-4676-8a4e-afdfdddf3e07 req-49897041-b0b9-4c36-8a9d-779259298b25 tempest-VolumesSnapshotsTestJSON-777488311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:32:47 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [req-7a0b5e21-2085-4676-8a4e-afdfdddf3e07 req-49897041-b0b9-4c36-8a9d-779259298b25 tempest-VolumesSnapshotsTestJSON-777488311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:32:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-7a0b5e21-2085-4676-8a4e-afdfdddf3e07 req-49897041-b0b9-4c36-8a9d-779259298b25 tempest-VolumesSnapshotsTestJSON-777488311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-7a0b5e21-2085-4676-8a4e-afdfdddf3e07 req-49897041-b0b9-4c36-8a9d-779259298b25 tempest-VolumesSnapshotsTestJSON-777488311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:47 devstack sudo[90230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:32:47 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:49 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-7a0b5e21-2085-4676-8a4e-afdfdddf3e07 req-49897041-b0b9-4c36-8a9d-779259298b25 tempest-VolumesSnapshotsTestJSON-777488311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.803s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:49 devstack cinder-volume[87284]: DEBUG cinder.manager [req-7a0b5e21-2085-4676-8a4e-afdfdddf3e07 req-49897041-b0b9-4c36-8a9d-779259298b25 tempest-VolumesSnapshotsTestJSON-777488311 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:32:49 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-7a0b5e21-2085-4676-8a4e-afdfdddf3e07 req-49897041-b0b9-4c36-8a9d-779259298b25 tempest-VolumesSnapshotsTestJSON-777488311 None] Deleted volume successfully. Jul 08 01:32:49 devstack cinder-volume[87284]: DEBUG cinder.coordination [req-7a0b5e21-2085-4676-8a4e-afdfdddf3e07 req-49897041-b0b9-4c36-8a9d-779259298b25 tempest-VolumesSnapshotsTestJSON-777488311 None] Lock "cinder-dddde4e5-b011-4873-8f7f-dc53d0031594-delete_volume" released by "delete_volume" :: held 5.415s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:32:55 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:32:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:32:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:32:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:55 devstack sudo[90276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:32:55 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:55 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-9be9cf2d-4d7e-4f30-adcd-3d63c3bdb4c5 tempest-GroupSnapshotsTest-313287482 None] Group tempest-GroupSnapshotsTest-Group-1285962787: creating Jul 08 01:32:55 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.839s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:55 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:32:56 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager._thread_info {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:32:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread count: 8 {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:32:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread info: [<_MainThread(MainThread, started 127058402500736)>, , , , , , , ] {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:32:56 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-9be9cf2d-4d7e-4f30-adcd-3d63c3bdb4c5 tempest-GroupSnapshotsTest-313287482 None] Group tempest-GroupSnapshotsTest-Group-1285962787: created successfully Jul 08 01:32:56 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-9be9cf2d-4d7e-4f30-adcd-3d63c3bdb4c5 tempest-GroupSnapshotsTest-313287482 None] Create group completed successfully. Jul 08 01:32:57 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-0348e34d-f4bf-433a-a33c-7e40cbb936bd tempest-GroupSnapshotsTest-313287482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:32:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0348e34d-f4bf-433a-a33c-7e40cbb936bd tempest-GroupSnapshotsTest-313287482 None] Flow 'volume_create_manager' (4d8822dd-b9db-4591-9787-df889b3edc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:32:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0348e34d-f4bf-433a-a33c-7e40cbb936bd tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92a7b8fb-d0cf-43f4-a651-c36028a73e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0348e34d-f4bf-433a-a33c-7e40cbb936bd tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92a7b8fb-d0cf-43f4-a651-c36028a73e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-907971734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=079e3a9f-c00d-4047-9bba-1958d584f134,host='devstack@QuobyteHD#QuobyteHD',id=a64ff073-f491-45fd-9c0e-0949de3551f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7f7103321442c28889b646c417250e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:32:58Z,use_quota=True,user_id='e38df0a12e4041979038905b265e56c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e2bce72-f5e3-4c00-bb16-ecda9eca4be2),volume_type_id=2e2bce72-f5e3-4c00-bb16-ecda9eca4be2)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0348e34d-f4bf-433a-a33c-7e40cbb936bd tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c20105c1-89c3-498c-83b9-1b4d3b6e0ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0348e34d-f4bf-433a-a33c-7e40cbb936bd tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c20105c1-89c3-498c-83b9-1b4d3b6e0ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0348e34d-f4bf-433a-a33c-7e40cbb936bd tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e75ad470-bfdf-41a1-a490-2ddebf1020d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0348e34d-f4bf-433a-a33c-7e40cbb936bd tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e75ad470-bfdf-41a1-a490-2ddebf1020d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a64ff073-f491-45fd-9c0e-0949de3551f9', 'volume_name': 'volume-a64ff073-f491-45fd-9c0e-0949de3551f9', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0348e34d-f4bf-433a-a33c-7e40cbb936bd tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d503c8cc-7a56-46b2-ba40-9ae8b2ad0fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0348e34d-f4bf-433a-a33c-7e40cbb936bd tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d503c8cc-7a56-46b2-ba40-9ae8b2ad0fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0348e34d-f4bf-433a-a33c-7e40cbb936bd tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d802f45c-d2e2-4546-8b49-e207f9131536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:57 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-0348e34d-f4bf-433a-a33c-7e40cbb936bd tempest-GroupSnapshotsTest-313287482 None] Volume a64ff073-f491-45fd-9c0e-0949de3551f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a64ff073-f491-45fd-9c0e-0949de3551f9', 'volume_size': 1} Jul 08 01:32:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0348e34d-f4bf-433a-a33c-7e40cbb936bd tempest-GroupSnapshotsTest-313287482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0348e34d-f4bf-433a-a33c-7e40cbb936bd tempest-GroupSnapshotsTest-313287482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0348e34d-f4bf-433a-a33c-7e40cbb936bd tempest-GroupSnapshotsTest-313287482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=079e3a9f-c00d-4047-9bba-1958d584f134,created_at=2026-07-07T23:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-907971734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=079e3a9f-c00d-4047-9bba-1958d584f134,host='devstack@QuobyteHD#QuobyteHD',id=a64ff073-f491-45fd-9c0e-0949de3551f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7f7103321442c28889b646c417250e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:32:58Z,use_quota=True,user_id='e38df0a12e4041979038905b265e56c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e2bce72-f5e3-4c00-bb16-ecda9eca4be2),volume_type_id=2e2bce72-f5e3-4c00-bb16-ecda9eca4be2)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:32:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-0348e34d-f4bf-433a-a33c-7e40cbb936bd tempest-GroupSnapshotsTest-313287482 None] Creating volume a64ff073-f491-45fd-9c0e-0949de3551f9 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:32:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0348e34d-f4bf-433a-a33c-7e40cbb936bd tempest-GroupSnapshotsTest-313287482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:32:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0348e34d-f4bf-433a-a33c-7e40cbb936bd tempest-GroupSnapshotsTest-313287482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:32:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0348e34d-f4bf-433a-a33c-7e40cbb936bd tempest-GroupSnapshotsTest-313287482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:32:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0348e34d-f4bf-433a-a33c-7e40cbb936bd tempest-GroupSnapshotsTest-313287482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:32:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0348e34d-f4bf-433a-a33c-7e40cbb936bd tempest-GroupSnapshotsTest-313287482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0348e34d-f4bf-433a-a33c-7e40cbb936bd tempest-GroupSnapshotsTest-313287482 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:32:57 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-0348e34d-f4bf-433a-a33c-7e40cbb936bd tempest-GroupSnapshotsTest-313287482 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:32:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0348e34d-f4bf-433a-a33c-7e40cbb936bd tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:57 devstack sudo[90293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9 1073741824 Jul 08 01:32:57 devstack sudo[90293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:58 devstack sudo[90293]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0348e34d-f4bf-433a-a33c-7e40cbb936bd tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9 1073741824" returned: 0 in 1.126s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0348e34d-f4bf-433a-a33c-7e40cbb936bd tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:32:59 devstack sudo[90301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9 Jul 08 01:32:59 devstack sudo[90301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:32:59 devstack sudo[90301]: pam_unix(sudo:session): session closed for user root Jul 08 01:32:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0348e34d-f4bf-433a-a33c-7e40cbb936bd tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9" returned: 0 in 0.824s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:32:59 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0348e34d-f4bf-433a-a33c-7e40cbb936bd tempest-GroupSnapshotsTest-313287482 None] <== create_volume: return (2016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:32:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0348e34d-f4bf-433a-a33c-7e40cbb936bd tempest-GroupSnapshotsTest-313287482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.019s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:32:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0348e34d-f4bf-433a-a33c-7e40cbb936bd tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d802f45c-d2e2-4546-8b49-e207f9131536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a64ff073-f491-45fd-9c0e-0949de3551f9', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0348e34d-f4bf-433a-a33c-7e40cbb936bd tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b79f5588-b79d-461c-8e03-8bc463963d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:32:59 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-0348e34d-f4bf-433a-a33c-7e40cbb936bd tempest-GroupSnapshotsTest-313287482 None] Volume volume-a64ff073-f491-45fd-9c0e-0949de3551f9 (a64ff073-f491-45fd-9c0e-0949de3551f9): created successfully Jul 08 01:32:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0348e34d-f4bf-433a-a33c-7e40cbb936bd tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b79f5588-b79d-461c-8e03-8bc463963d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:32:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0348e34d-f4bf-433a-a33c-7e40cbb936bd tempest-GroupSnapshotsTest-313287482 None] Flow 'volume_create_manager' (4d8822dd-b9db-4591-9787-df889b3edc7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:32:59 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-0348e34d-f4bf-433a-a33c-7e40cbb936bd tempest-GroupSnapshotsTest-313287482 None] Created volume successfully. Jul 08 01:33:00 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-10abdc5f-42a1-4284-a3ec-6afce08c4e69 tempest-GroupSnapshotsTest-313287482 None] GroupSnapshot 14ba00f4-7e47-4a2f-8d49-10e0906d0031: creating. Jul 08 01:33:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-10abdc5f-42a1-4284-a3ec-6afce08c4e69 tempest-GroupSnapshotsTest-313287482 None] Group snapshot 14ba00f4-7e47-4a2f-8d49-10e0906d0031: creating. {{(pid=87284) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 01:33:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-10abdc5f-42a1-4284-a3ec-6afce08c4e69 tempest-GroupSnapshotsTest-313287482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-10abdc5f-42a1-4284-a3ec-6afce08c4e69 tempest-GroupSnapshotsTest-313287482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-10abdc5f-42a1-4284-a3ec-6afce08c4e69 tempest-GroupSnapshotsTest-313287482 None] Creating offline snapshot b8eaabee-8c90-44d5-b864-04e65362c538 of volume a64ff073-f491-45fd-9c0e-0949de3551f9 {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:33:00 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[152cbecd-12c7-4070-8905-2565a02ce549]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:33:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-10abdc5f-42a1-4284-a3ec-6afce08c4e69 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:01 devstack sudo[90326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9 Jul 08 01:33:01 devstack sudo[90326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:02 devstack sudo[90326]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-10abdc5f-42a1-4284-a3ec-6afce08c4e69 tempest-GroupSnapshotsTest-313287482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9" returned: 0 in 1.218s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-10abdc5f-42a1-4284-a3ec-6afce08c4e69 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9.b8eaabee-8c90-44d5-b864-04e65362c538 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:02 devstack sudo[90334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9.b8eaabee-8c90-44d5-b864-04e65362c538 1G Jul 08 01:33:02 devstack sudo[90334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:04 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7117b22-2c17-4884-a701-f9c6e0f21c9c tempest-ServerActionsTestOtherA-84188968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:33:04 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f7117b22-2c17-4884-a701-f9c6e0f21c9c tempest-ServerActionsTestOtherA-84188968 None] Flow 'volume_create_manager' (6bd3b51a-e0bf-41eb-8799-6aaae9f1b914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:33:04 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f7117b22-2c17-4884-a701-f9c6e0f21c9c tempest-ServerActionsTestOtherA-84188968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3b37896-252f-4d39-92ba-ba5bcfb3dc6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:04 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f7117b22-2c17-4884-a701-f9c6e0f21c9c tempest-ServerActionsTestOtherA-84188968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3b37896-252f-4d39-92ba-ba5bcfb3dc6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-482995627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3322ae6d-a22f-4ba5-8937-23a1c1066cb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83d917d8a46f4ea0a38b29863950673d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:33:04Z,use_quota=True,user_id='0847488c03b446f898c4d007ae08cbab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:04 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f7117b22-2c17-4884-a701-f9c6e0f21c9c tempest-ServerActionsTestOtherA-84188968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0324735-2acb-4dd7-a72b-3bff884886d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:04 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f7117b22-2c17-4884-a701-f9c6e0f21c9c tempest-ServerActionsTestOtherA-84188968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0324735-2acb-4dd7-a72b-3bff884886d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:04 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f7117b22-2c17-4884-a701-f9c6e0f21c9c tempest-ServerActionsTestOtherA-84188968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (611c37ce-50d7-444a-a68a-b463a1dd78b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:04 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f7117b22-2c17-4884-a701-f9c6e0f21c9c tempest-ServerActionsTestOtherA-84188968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (611c37ce-50d7-444a-a68a-b463a1dd78b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3322ae6d-a22f-4ba5-8937-23a1c1066cb7', 'volume_name': 'volume-3322ae6d-a22f-4ba5-8937-23a1c1066cb7', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:04 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f7117b22-2c17-4884-a701-f9c6e0f21c9c tempest-ServerActionsTestOtherA-84188968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (888b5c16-4efe-47bd-bace-fd5a988879b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:04 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f7117b22-2c17-4884-a701-f9c6e0f21c9c tempest-ServerActionsTestOtherA-84188968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (888b5c16-4efe-47bd-bace-fd5a988879b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:04 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f7117b22-2c17-4884-a701-f9c6e0f21c9c tempest-ServerActionsTestOtherA-84188968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6eaac30-3ce3-4576-a553-1f545260d87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:04 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-f7117b22-2c17-4884-a701-f9c6e0f21c9c tempest-ServerActionsTestOtherA-84188968 None] Volume 3322ae6d-a22f-4ba5-8937-23a1c1066cb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3322ae6d-a22f-4ba5-8937-23a1c1066cb7', 'volume_size': 1} Jul 08 01:33:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f7117b22-2c17-4884-a701-f9c6e0f21c9c tempest-ServerActionsTestOtherA-84188968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:04 devstack sudo[90334]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-10abdc5f-42a1-4284-a3ec-6afce08c4e69 tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9.b8eaabee-8c90-44d5-b864-04e65362c538 1G" returned: 0 in 2.118s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-10abdc5f-42a1-4284-a3ec-6afce08c4e69 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a64ff073-f491-45fd-9c0e-0949de3551f9 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9.b8eaabee-8c90-44d5-b864-04e65362c538 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:04 devstack sudo[90342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a64ff073-f491-45fd-9c0e-0949de3551f9 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9.b8eaabee-8c90-44d5-b864-04e65362c538 Jul 08 01:33:04 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:05 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-10abdc5f-42a1-4284-a3ec-6afce08c4e69 tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a64ff073-f491-45fd-9c0e-0949de3551f9 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9.b8eaabee-8c90-44d5-b864-04e65362c538" returned: 0 in 1.480s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:05 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-10abdc5f-42a1-4284-a3ec-6afce08c4e69 tempest-GroupSnapshotsTest-313287482 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9.b8eaabee-8c90-44d5-b864-04e65362c538 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:33:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-10abdc5f-42a1-4284-a3ec-6afce08c4e69 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9.b8eaabee-8c90-44d5-b864-04e65362c538 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:05 devstack sudo[90348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9.b8eaabee-8c90-44d5-b864-04e65362c538 Jul 08 01:33:05 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:06 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-10abdc5f-42a1-4284-a3ec-6afce08c4e69 tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9.b8eaabee-8c90-44d5-b864-04e65362c538" returned: 0 in 0.964s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-10abdc5f-42a1-4284-a3ec-6afce08c4e69 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:06 devstack sudo[90351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9.info Jul 08 01:33:06 devstack sudo[90351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:07 devstack sudo[90351]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-10abdc5f-42a1-4284-a3ec-6afce08c4e69 tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9.info" returned: 0 in 1.123s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:07 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-10abdc5f-42a1-4284-a3ec-6afce08c4e69 tempest-GroupSnapshotsTest-313287482 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:33:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-10abdc5f-42a1-4284-a3ec-6afce08c4e69 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:07 devstack sudo[90354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9.info Jul 08 01:33:07 devstack sudo[90354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:08 devstack sudo[90354]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-10abdc5f-42a1-4284-a3ec-6afce08c4e69 tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9.info" returned: 0 in 0.941s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-10abdc5f-42a1-4284-a3ec-6afce08c4e69 tempest-GroupSnapshotsTest-313287482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.988s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f7117b22-2c17-4884-a701-f9c6e0f21c9c tempest-ServerActionsTestOtherA-84188968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.765s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:08 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f7117b22-2c17-4884-a701-f9c6e0f21c9c tempest-ServerActionsTestOtherA-84188968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-482995627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3322ae6d-a22f-4ba5-8937-23a1c1066cb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83d917d8a46f4ea0a38b29863950673d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:33:04Z,use_quota=True,user_id='0847488c03b446f898c4d007ae08cbab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:33:08 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-f7117b22-2c17-4884-a701-f9c6e0f21c9c tempest-ServerActionsTestOtherA-84188968 None] Creating volume 3322ae6d-a22f-4ba5-8937-23a1c1066cb7 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:33:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f7117b22-2c17-4884-a701-f9c6e0f21c9c tempest-ServerActionsTestOtherA-84188968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f7117b22-2c17-4884-a701-f9c6e0f21c9c tempest-ServerActionsTestOtherA-84188968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:08 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f7117b22-2c17-4884-a701-f9c6e0f21c9c tempest-ServerActionsTestOtherA-84188968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:33:08 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f7117b22-2c17-4884-a701-f9c6e0f21c9c tempest-ServerActionsTestOtherA-84188968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:33:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f7117b22-2c17-4884-a701-f9c6e0f21c9c tempest-ServerActionsTestOtherA-84188968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:08 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f7117b22-2c17-4884-a701-f9c6e0f21c9c tempest-ServerActionsTestOtherA-84188968 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:33:08 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-f7117b22-2c17-4884-a701-f9c6e0f21c9c tempest-ServerActionsTestOtherA-84188968 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:33:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f7117b22-2c17-4884-a701-f9c6e0f21c9c tempest-ServerActionsTestOtherA-84188968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3322ae6d-a22f-4ba5-8937-23a1c1066cb7 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:08 devstack sudo[90360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3322ae6d-a22f-4ba5-8937-23a1c1066cb7 1073741824 Jul 08 01:33:08 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:09 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-10abdc5f-42a1-4284-a3ec-6afce08c4e69 tempest-GroupSnapshotsTest-313287482 None] group_snapshot 14ba00f4-7e47-4a2f-8d49-10e0906d0031: created successfully Jul 08 01:33:10 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f7117b22-2c17-4884-a701-f9c6e0f21c9c tempest-ServerActionsTestOtherA-84188968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3322ae6d-a22f-4ba5-8937-23a1c1066cb7 1073741824" returned: 0 in 1.434s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f7117b22-2c17-4884-a701-f9c6e0f21c9c tempest-ServerActionsTestOtherA-84188968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3322ae6d-a22f-4ba5-8937-23a1c1066cb7 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:10 devstack sudo[90393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3322ae6d-a22f-4ba5-8937-23a1c1066cb7 Jul 08 01:33:10 devstack sudo[90393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:11 devstack sudo[90393]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f7117b22-2c17-4884-a701-f9c6e0f21c9c tempest-ServerActionsTestOtherA-84188968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3322ae6d-a22f-4ba5-8937-23a1c1066cb7" returned: 0 in 0.882s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:11 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f7117b22-2c17-4884-a701-f9c6e0f21c9c tempest-ServerActionsTestOtherA-84188968 None] <== create_volume: return (2365ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:33:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f7117b22-2c17-4884-a701-f9c6e0f21c9c tempest-ServerActionsTestOtherA-84188968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.367s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:11 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f7117b22-2c17-4884-a701-f9c6e0f21c9c tempest-ServerActionsTestOtherA-84188968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6eaac30-3ce3-4576-a553-1f545260d87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3322ae6d-a22f-4ba5-8937-23a1c1066cb7', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:11 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f7117b22-2c17-4884-a701-f9c6e0f21c9c tempest-ServerActionsTestOtherA-84188968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a76fb37-71d0-4c90-aa55-403df337f8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f89b4a84-78ef-4348-8bd3-6b60472cf500 tempest-GroupSnapshotsTest-313287482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f89b4a84-78ef-4348-8bd3-6b60472cf500 tempest-GroupSnapshotsTest-313287482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:11 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f89b4a84-78ef-4348-8bd3-6b60472cf500 tempest-GroupSnapshotsTest-313287482 None] Acquiring lock "cinder-quobyte-b8eaabee-8c90-44d5-b864-04e65362c538-cf502d91-5e2d-4e4f-b05a-dd44d9ca98f2" by "_create_volume_from_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:33:11 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-f7117b22-2c17-4884-a701-f9c6e0f21c9c tempest-ServerActionsTestOtherA-84188968 None] Volume volume-3322ae6d-a22f-4ba5-8937-23a1c1066cb7 (3322ae6d-a22f-4ba5-8937-23a1c1066cb7): created successfully Jul 08 01:33:11 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f7117b22-2c17-4884-a701-f9c6e0f21c9c tempest-ServerActionsTestOtherA-84188968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a76fb37-71d0-4c90-aa55-403df337f8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:11 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f7117b22-2c17-4884-a701-f9c6e0f21c9c tempest-ServerActionsTestOtherA-84188968 None] Flow 'volume_create_manager' (6bd3b51a-e0bf-41eb-8799-6aaae9f1b914) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:33:11 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f89b4a84-78ef-4348-8bd3-6b60472cf500 tempest-GroupSnapshotsTest-313287482 None] Lock "cinder-quobyte-b8eaabee-8c90-44d5-b864-04e65362c538-cf502d91-5e2d-4e4f-b05a-dd44d9ca98f2" acquired by "_create_volume_from_snapshot" :: waited 0.066s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:33:11 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f89b4a84-78ef-4348-8bd3-6b60472cf500 tempest-GroupSnapshotsTest-313287482 None] Creating volume cf502d91-5e2d-4e4f-b05a-dd44d9ca98f2 from snapshot b8eaabee-8c90-44d5-b864-04e65362c538 {{(pid=87284) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 01:33:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f89b4a84-78ef-4348-8bd3-6b60472cf500 tempest-GroupSnapshotsTest-313287482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f89b4a84-78ef-4348-8bd3-6b60472cf500 tempest-GroupSnapshotsTest-313287482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:11 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f89b4a84-78ef-4348-8bd3-6b60472cf500 tempest-GroupSnapshotsTest-313287482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:33:11 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f89b4a84-78ef-4348-8bd3-6b60472cf500 tempest-GroupSnapshotsTest-313287482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:33:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f89b4a84-78ef-4348-8bd3-6b60472cf500 tempest-GroupSnapshotsTest-313287482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:11 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f89b4a84-78ef-4348-8bd3-6b60472cf500 tempest-GroupSnapshotsTest-313287482 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:33:11 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f89b4a84-78ef-4348-8bd3-6b60472cf500 tempest-GroupSnapshotsTest-313287482 None] Acquiring lock "cinder-quobyte-cf502d91-5e2d-4e4f-b05a-dd44d9ca98f2" by "_copy_volume_from_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:33:11 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-f7117b22-2c17-4884-a701-f9c6e0f21c9c tempest-ServerActionsTestOtherA-84188968 None] Created volume successfully. Jul 08 01:33:11 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f89b4a84-78ef-4348-8bd3-6b60472cf500 tempest-GroupSnapshotsTest-313287482 None] Lock "cinder-quobyte-cf502d91-5e2d-4e4f-b05a-dd44d9ca98f2" acquired by "_copy_volume_from_snapshot" :: waited 0.053s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:33:11 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f89b4a84-78ef-4348-8bd3-6b60472cf500 tempest-GroupSnapshotsTest-313287482 None] snapshot: b8eaabee-8c90-44d5-b864-04e65362c538, volume: cf502d91-5e2d-4e4f-b05a-dd44d9ca98f2, {{(pid=87284) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:33:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f89b4a84-78ef-4348-8bd3-6b60472cf500 tempest-GroupSnapshotsTest-313287482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f89b4a84-78ef-4348-8bd3-6b60472cf500 tempest-GroupSnapshotsTest-313287482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:11 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f89b4a84-78ef-4348-8bd3-6b60472cf500 tempest-GroupSnapshotsTest-313287482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:33:11 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f89b4a84-78ef-4348-8bd3-6b60472cf500 tempest-GroupSnapshotsTest-313287482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:33:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f89b4a84-78ef-4348-8bd3-6b60472cf500 tempest-GroupSnapshotsTest-313287482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:11 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[093f113b-91c5-4868-a378-09446fbae110]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:33:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f89b4a84-78ef-4348-8bd3-6b60472cf500 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9.b8eaabee-8c90-44d5-b864-04e65362c538 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:11 devstack sudo[90398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9.b8eaabee-8c90-44d5-b864-04e65362c538 Jul 08 01:33:11 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:12 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-22634754-13d6-4c4d-b148-d6014e7c0b2c tempest-ServerRescueNegativeTestJSON-1380173565 None] Acquiring lock "cinder-7ef6bec5-4709-4ad1-b0dc-41e811a2e1dd-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:33:12 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-22634754-13d6-4c4d-b148-d6014e7c0b2c tempest-ServerRescueNegativeTestJSON-1380173565 None] Lock "cinder-7ef6bec5-4709-4ad1-b0dc-41e811a2e1dd-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:33:12 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-22634754-13d6-4c4d-b148-d6014e7c0b2c tempest-ServerRescueNegativeTestJSON-1380173565 None] Acquiring lock "cinder-quobyte-7ef6bec5-4709-4ad1-b0dc-41e811a2e1dd" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:33:12 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-22634754-13d6-4c4d-b148-d6014e7c0b2c tempest-ServerRescueNegativeTestJSON-1380173565 None] Lock "cinder-quobyte-7ef6bec5-4709-4ad1-b0dc-41e811a2e1dd" acquired by "delete_volume" :: waited 0.025s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:33:12 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54d258f-375b-411c-93db-6b88a99d3952]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:33:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-22634754-13d6-4c4d-b148-d6014e7c0b2c tempest-ServerRescueNegativeTestJSON-1380173565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7ef6bec5-4709-4ad1-b0dc-41e811a2e1dd {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:12 devstack sudo[90401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7ef6bec5-4709-4ad1-b0dc-41e811a2e1dd Jul 08 01:33:12 devstack sudo[90401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:12 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f89b4a84-78ef-4348-8bd3-6b60472cf500 tempest-GroupSnapshotsTest-313287482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9.b8eaabee-8c90-44d5-b864-04e65362c538" returned: 0 in 1.407s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:13 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-f89b4a84-78ef-4348-8bd3-6b60472cf500 tempest-GroupSnapshotsTest-313287482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a64ff073-f491-45fd-9c0e-0949de3551f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:33:13 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f89b4a84-78ef-4348-8bd3-6b60472cf500 tempest-GroupSnapshotsTest-313287482 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9 {{(pid=87284) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:33:13 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f89b4a84-78ef-4348-8bd3-6b60472cf500 tempest-GroupSnapshotsTest-313287482 None] Creating direct copy from snapshot {{(pid=87284) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:33:13 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39dce48-6ad3-4f83-a516-47fd532d7f7a]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:33:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f89b4a84-78ef-4348-8bd3-6b60472cf500 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:13 devstack sudo[90407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9 Jul 08 01:33:13 devstack sudo[90407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:13 devstack sudo[90401]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-22634754-13d6-4c4d-b148-d6014e7c0b2c tempest-ServerRescueNegativeTestJSON-1380173565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7ef6bec5-4709-4ad1-b0dc-41e811a2e1dd" returned: 0 in 1.293s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-22634754-13d6-4c4d-b148-d6014e7c0b2c tempest-ServerRescueNegativeTestJSON-1380173565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7ef6bec5-4709-4ad1-b0dc-41e811a2e1dd {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:13 devstack sudo[90413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7ef6bec5-4709-4ad1-b0dc-41e811a2e1dd Jul 08 01:33:13 devstack sudo[90413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:14 devstack sudo[90407]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f89b4a84-78ef-4348-8bd3-6b60472cf500 tempest-GroupSnapshotsTest-313287482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9" returned: 0 in 1.303s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:14 devstack cinder-volume[87284]: DEBUG cinder.utils [None req-f89b4a84-78ef-4348-8bd3-6b60472cf500 tempest-GroupSnapshotsTest-313287482 None] Path /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-cf502d91-5e2d-4e4f-b05a-dd44d9ca98f2 not found in is_blk_device check {{(pid=87284) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:33:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f89b4a84-78ef-4348-8bd3-6b60472cf500 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-cf502d91-5e2d-4e4f-b05a-dd44d9ca98f2 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:14 devstack sudo[90419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-cf502d91-5e2d-4e4f-b05a-dd44d9ca98f2 Jul 08 01:33:14 devstack sudo[90419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:14 devstack sudo[90413]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-22634754-13d6-4c4d-b148-d6014e7c0b2c tempest-ServerRescueNegativeTestJSON-1380173565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7ef6bec5-4709-4ad1-b0dc-41e811a2e1dd" returned: 0 in 1.058s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:14 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-22634754-13d6-4c4d-b148-d6014e7c0b2c tempest-ServerRescueNegativeTestJSON-1380173565 None] Lock "cinder-quobyte-7ef6bec5-4709-4ad1-b0dc-41e811a2e1dd" released by "delete_volume" :: held 2.405s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:33:15 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-22634754-13d6-4c4d-b148-d6014e7c0b2c tempest-ServerRescueNegativeTestJSON-1380173565 None] Created reservations ['a68aec59-814b-4b5a-983e-351e84662018', '1f093158-3124-4956-865c-540cf1e931bd', 'a720b2f7-7b39-4232-872a-118c1adbba64', 'efe8bbf9-1d36-46e2-9b22-4b90be33a3f5'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:33:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-22634754-13d6-4c4d-b148-d6014e7c0b2c tempest-ServerRescueNegativeTestJSON-1380173565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-22634754-13d6-4c4d-b148-d6014e7c0b2c tempest-ServerRescueNegativeTestJSON-1380173565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:15 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-22634754-13d6-4c4d-b148-d6014e7c0b2c tempest-ServerRescueNegativeTestJSON-1380173565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:33:15 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-22634754-13d6-4c4d-b148-d6014e7c0b2c tempest-ServerRescueNegativeTestJSON-1380173565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:33:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-22634754-13d6-4c4d-b148-d6014e7c0b2c tempest-ServerRescueNegativeTestJSON-1380173565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-22634754-13d6-4c4d-b148-d6014e7c0b2c tempest-ServerRescueNegativeTestJSON-1380173565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:15 devstack sudo[90422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:33:15 devstack sudo[90422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:17 devstack sudo[90422]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-22634754-13d6-4c4d-b148-d6014e7c0b2c tempest-ServerRescueNegativeTestJSON-1380173565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.980s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:17 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-22634754-13d6-4c4d-b148-d6014e7c0b2c tempest-ServerRescueNegativeTestJSON-1380173565 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:33:17 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-22634754-13d6-4c4d-b148-d6014e7c0b2c tempest-ServerRescueNegativeTestJSON-1380173565 None] Deleted volume successfully. Jul 08 01:33:17 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=49,cinder:UPDATE=56,cinder:INSERT=13,cinder:DELETE=7 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:33:17 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-22634754-13d6-4c4d-b148-d6014e7c0b2c tempest-ServerRescueNegativeTestJSON-1380173565 None] Lock "cinder-7ef6bec5-4709-4ad1-b0dc-41e811a2e1dd-delete_volume" released by "delete_volume" :: held 4.837s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:33:23 devstack sudo[90419]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f89b4a84-78ef-4348-8bd3-6b60472cf500 tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-cf502d91-5e2d-4e4f-b05a-dd44d9ca98f2" returned: 0 in 9.115s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:23 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[312758d9-061c-4b04-926f-2f54e4808967]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:33:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f89b4a84-78ef-4348-8bd3-6b60472cf500 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:23 devstack sudo[90529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9 Jul 08 01:33:23 devstack sudo[90529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:25 devstack sudo[90529]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f89b4a84-78ef-4348-8bd3-6b60472cf500 tempest-GroupSnapshotsTest-313287482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9" returned: 0 in 1.678s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:25 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-f89b4a84-78ef-4348-8bd3-6b60472cf500 tempest-GroupSnapshotsTest-313287482 None] Image conversion details: src /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9, size 1024.00 MB, duration 9.12 sec, destination /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-cf502d91-5e2d-4e4f-b05a-dd44d9ca98f2 {{(pid=87284) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:33:25 devstack cinder-volume[87284]: INFO cinder.image.image_utils [None req-f89b4a84-78ef-4348-8bd3-6b60472cf500 tempest-GroupSnapshotsTest-313287482 None] Converted 1024.00 MB image at 112.33 MB/s Jul 08 01:33:25 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-f89b4a84-78ef-4348-8bd3-6b60472cf500 tempest-GroupSnapshotsTest-313287482 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-cf502d91-5e2d-4e4f-b05a-dd44d9ca98f2 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:33:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f89b4a84-78ef-4348-8bd3-6b60472cf500 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-cf502d91-5e2d-4e4f-b05a-dd44d9ca98f2 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:25 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:UPDATE=65,cinder:SELECT=54,cinder:DELETE=4,cinder:INSERT=15 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:33:25 devstack sudo[90548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-cf502d91-5e2d-4e4f-b05a-dd44d9ca98f2 Jul 08 01:33:25 devstack sudo[90548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:26 devstack sudo[90548]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f89b4a84-78ef-4348-8bd3-6b60472cf500 tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-cf502d91-5e2d-4e4f-b05a-dd44d9ca98f2" returned: 0 in 0.939s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:26 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f89b4a84-78ef-4348-8bd3-6b60472cf500 tempest-GroupSnapshotsTest-313287482 None] Lock "cinder-quobyte-cf502d91-5e2d-4e4f-b05a-dd44d9ca98f2" released by "_copy_volume_from_snapshot" :: held 14.577s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:33:26 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f89b4a84-78ef-4348-8bd3-6b60472cf500 tempest-GroupSnapshotsTest-313287482 None] Lock "cinder-quobyte-b8eaabee-8c90-44d5-b864-04e65362c538-cf502d91-5e2d-4e4f-b05a-dd44d9ca98f2" released by "_create_volume_from_snapshot" :: held 14.657s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:33:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f89b4a84-78ef-4348-8bd3-6b60472cf500 tempest-GroupSnapshotsTest-313287482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.725s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:26 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-f89b4a84-78ef-4348-8bd3-6b60472cf500 tempest-GroupSnapshotsTest-313287482 None] Create group from source-snapshot-14ba00f4-7e47-4a2f-8d49-10e0906d0031 completed successfully. Jul 08 01:33:27 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1f7ce93c-16fd-4fb9-a871-3ea4305a2557 tempest-GroupSnapshotsTest-313287482 None] Acquiring lock "cinder-quobyte-cf502d91-5e2d-4e4f-b05a-dd44d9ca98f2" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:33:27 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1f7ce93c-16fd-4fb9-a871-3ea4305a2557 tempest-GroupSnapshotsTest-313287482 None] Lock "cinder-quobyte-cf502d91-5e2d-4e4f-b05a-dd44d9ca98f2" acquired by "delete_volume" :: waited 0.017s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:33:28 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aac96ea-24ca-4016-ba8b-d5d7f14ad987]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:33:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1f7ce93c-16fd-4fb9-a871-3ea4305a2557 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-cf502d91-5e2d-4e4f-b05a-dd44d9ca98f2 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:28 devstack sudo[90582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-cf502d91-5e2d-4e4f-b05a-dd44d9ca98f2 Jul 08 01:33:28 devstack sudo[90582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:28 devstack sudo[90582]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1f7ce93c-16fd-4fb9-a871-3ea4305a2557 tempest-GroupSnapshotsTest-313287482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-cf502d91-5e2d-4e4f-b05a-dd44d9ca98f2" returned: 0 in 0.968s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1f7ce93c-16fd-4fb9-a871-3ea4305a2557 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-cf502d91-5e2d-4e4f-b05a-dd44d9ca98f2 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:29 devstack sudo[90605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-cf502d91-5e2d-4e4f-b05a-dd44d9ca98f2 Jul 08 01:33:29 devstack sudo[90605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:29 devstack sudo[90605]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1f7ce93c-16fd-4fb9-a871-3ea4305a2557 tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-cf502d91-5e2d-4e4f-b05a-dd44d9ca98f2" returned: 0 in 0.937s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:29 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1f7ce93c-16fd-4fb9-a871-3ea4305a2557 tempest-GroupSnapshotsTest-313287482 None] Lock "cinder-quobyte-cf502d91-5e2d-4e4f-b05a-dd44d9ca98f2" released by "delete_volume" :: held 1.998s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:33:30 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-1f7ce93c-16fd-4fb9-a871-3ea4305a2557 tempest-GroupSnapshotsTest-313287482 None] Created reservations ['2edc3f93-062c-407e-929e-b86c401e22b3'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:33:30 devstack cinder-volume[87284]: WARNING cinder.quota [None req-1f7ce93c-16fd-4fb9-a871-3ea4305a2557 tempest-GroupSnapshotsTest-313287482 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-633991888 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-633991888, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:33:30 devstack cinder-volume[87284]: WARNING cinder.quota [None req-1f7ce93c-16fd-4fb9-a871-3ea4305a2557 tempest-GroupSnapshotsTest-313287482 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-633991888 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-633991888, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:33:30 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-1f7ce93c-16fd-4fb9-a871-3ea4305a2557 tempest-GroupSnapshotsTest-313287482 None] Created reservations ['2bc96d2b-abbe-40c2-a065-076bd54d9dac', '85c804e3-6f4a-489d-8e44-e4bb8a639577', '2c30c67d-b3aa-497a-96fd-d79d54a0aa3b', 'd5af893f-0630-488f-884a-169fb6a7b01b'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:33:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-1f7ce93c-16fd-4fb9-a871-3ea4305a2557 tempest-GroupSnapshotsTest-313287482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-1f7ce93c-16fd-4fb9-a871-3ea4305a2557 tempest-GroupSnapshotsTest-313287482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:30 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-1f7ce93c-16fd-4fb9-a871-3ea4305a2557 tempest-GroupSnapshotsTest-313287482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:33:30 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-1f7ce93c-16fd-4fb9-a871-3ea4305a2557 tempest-GroupSnapshotsTest-313287482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:33:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-1f7ce93c-16fd-4fb9-a871-3ea4305a2557 tempest-GroupSnapshotsTest-313287482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1f7ce93c-16fd-4fb9-a871-3ea4305a2557 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:30 devstack sudo[90616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:33:30 devstack sudo[90616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:30 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-aa574eca-1b4e-441a-9afc-3b7464347b5a tempest-GroupSnapshotsTest-313287482 None] group_snapshot 14ba00f4-7e47-4a2f-8d49-10e0906d0031: deleting Jul 08 01:33:30 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-aa574eca-1b4e-441a-9afc-3b7464347b5a tempest-GroupSnapshotsTest-313287482 None] group_snapshot 14ba00f4-7e47-4a2f-8d49-10e0906d0031: deleting {{(pid=87284) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 01:33:30 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-aa574eca-1b4e-441a-9afc-3b7464347b5a tempest-GroupSnapshotsTest-313287482 None] Acquiring lock "cinder-quobyte-a64ff073-f491-45fd-9c0e-0949de3551f9" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:33:31 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-aa574eca-1b4e-441a-9afc-3b7464347b5a tempest-GroupSnapshotsTest-313287482 None] Lock "cinder-quobyte-a64ff073-f491-45fd-9c0e-0949de3551f9" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:33:31 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-aa574eca-1b4e-441a-9afc-3b7464347b5a tempest-GroupSnapshotsTest-313287482 None] Acquiring lock "cinder-quobyte-b8eaabee-8c90-44d5-b864-04e65362c538" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:33:31 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-aa574eca-1b4e-441a-9afc-3b7464347b5a tempest-GroupSnapshotsTest-313287482 None] Lock "cinder-quobyte-b8eaabee-8c90-44d5-b864-04e65362c538" acquired by "_delete_snapshot" :: waited 0.060s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:33:31 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-aa574eca-1b4e-441a-9afc-3b7464347b5a tempest-GroupSnapshotsTest-313287482 None] Deleting offline snapshot b8eaabee-8c90-44d5-b864-04e65362c538 of volume a64ff073-f491-45fd-9c0e-0949de3551f9 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:33:31 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-aa574eca-1b4e-441a-9afc-3b7464347b5a tempest-GroupSnapshotsTest-313287482 None] snapshot_file for this snap is: volume-a64ff073-f491-45fd-9c0e-0949de3551f9.b8eaabee-8c90-44d5-b864-04e65362c538 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:33:31 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a65e28-c7a7-4099-ba09-84462db4dade]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:33:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-aa574eca-1b4e-441a-9afc-3b7464347b5a tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9.b8eaabee-8c90-44d5-b864-04e65362c538 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:31 devstack sudo[90635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9.b8eaabee-8c90-44d5-b864-04e65362c538 Jul 08 01:33:31 devstack sudo[90635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:31 devstack sudo[90616]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1f7ce93c-16fd-4fb9-a871-3ea4305a2557 tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.700s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:31 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-1f7ce93c-16fd-4fb9-a871-3ea4305a2557 tempest-GroupSnapshotsTest-313287482 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:33:31 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-1f7ce93c-16fd-4fb9-a871-3ea4305a2557 tempest-GroupSnapshotsTest-313287482 None] Delete group completed successfully. Jul 08 01:33:32 devstack sudo[90635]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-aa574eca-1b4e-441a-9afc-3b7464347b5a tempest-GroupSnapshotsTest-313287482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9.b8eaabee-8c90-44d5-b864-04e65362c538" returned: 0 in 1.646s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:32 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-aa574eca-1b4e-441a-9afc-3b7464347b5a tempest-GroupSnapshotsTest-313287482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a64ff073-f491-45fd-9c0e-0949de3551f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:33:32 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f10e4e5-0501-4f5a-a9c1-120f83c4ce17]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:33:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-aa574eca-1b4e-441a-9afc-3b7464347b5a tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:33 devstack sudo[90656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9 Jul 08 01:33:33 devstack sudo[90656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:34 devstack sudo[90656]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-aa574eca-1b4e-441a-9afc-3b7464347b5a tempest-GroupSnapshotsTest-313287482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9" returned: 0 in 1.630s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-aa574eca-1b4e-441a-9afc-3b7464347b5a tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9.b8eaabee-8c90-44d5-b864-04e65362c538 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:34 devstack sudo[90678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9.b8eaabee-8c90-44d5-b864-04e65362c538 Jul 08 01:33:34 devstack sudo[90678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:36 devstack sudo[90678]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-aa574eca-1b4e-441a-9afc-3b7464347b5a tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9.b8eaabee-8c90-44d5-b864-04e65362c538" returned: 0 in 1.467s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-aa574eca-1b4e-441a-9afc-3b7464347b5a tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9.b8eaabee-8c90-44d5-b864-04e65362c538 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:36 devstack sudo[90694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9.b8eaabee-8c90-44d5-b864-04e65362c538 Jul 08 01:33:36 devstack sudo[90694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:37 devstack sudo[90694]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-aa574eca-1b4e-441a-9afc-3b7464347b5a tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9.b8eaabee-8c90-44d5-b864-04e65362c538" returned: 0 in 1.025s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:37 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-aa574eca-1b4e-441a-9afc-3b7464347b5a tempest-GroupSnapshotsTest-313287482 None] Lock "cinder-quobyte-b8eaabee-8c90-44d5-b864-04e65362c538" released by "_delete_snapshot" :: held 6.037s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:33:37 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-aa574eca-1b4e-441a-9afc-3b7464347b5a tempest-GroupSnapshotsTest-313287482 None] Lock "cinder-quobyte-a64ff073-f491-45fd-9c0e-0949de3551f9" released by "delete_snapshot" :: held 6.108s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:33:37 devstack cinder-volume[87284]: WARNING cinder.quota [None req-aa574eca-1b4e-441a-9afc-3b7464347b5a tempest-GroupSnapshotsTest-313287482 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-633991888 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-633991888, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:33:37 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-aa574eca-1b4e-441a-9afc-3b7464347b5a tempest-GroupSnapshotsTest-313287482 None] Created reservations ['0a26c95d-b4c3-4988-8e6d-a238ec9db3e4', '461c188e-bb1b-41d1-8d4f-f1d471631e09', 'fcaaa959-c395-4f90-8334-5c0c9c647e38', '86ae9b90-fff1-4175-9542-6fa0855e9931'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:33:37 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-aa574eca-1b4e-441a-9afc-3b7464347b5a tempest-GroupSnapshotsTest-313287482 None] group_snapshot 14ba00f4-7e47-4a2f-8d49-10e0906d0031: deleted successfully Jul 08 01:33:38 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-758bd196-cac6-48c7-902d-d106b1e23b30 tempest-GroupSnapshotsTest-313287482 None] Acquiring lock "cinder-quobyte-a64ff073-f491-45fd-9c0e-0949de3551f9" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:33:39 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-758bd196-cac6-48c7-902d-d106b1e23b30 tempest-GroupSnapshotsTest-313287482 None] Lock "cinder-quobyte-a64ff073-f491-45fd-9c0e-0949de3551f9" acquired by "delete_volume" :: waited 0.029s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:33:39 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[9facfffa-9c11-4248-b847-18a9cb335d26]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:33:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-758bd196-cac6-48c7-902d-d106b1e23b30 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:39 devstack sudo[90741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9 Jul 08 01:33:39 devstack sudo[90741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:40 devstack sudo[90741]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-758bd196-cac6-48c7-902d-d106b1e23b30 tempest-GroupSnapshotsTest-313287482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9" returned: 0 in 1.160s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-758bd196-cac6-48c7-902d-d106b1e23b30 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:40 devstack sudo[90769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9 Jul 08 01:33:40 devstack sudo[90769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:41 devstack sudo[90769]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-758bd196-cac6-48c7-902d-d106b1e23b30 tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a64ff073-f491-45fd-9c0e-0949de3551f9" returned: 0 in 0.871s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:41 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-758bd196-cac6-48c7-902d-d106b1e23b30 tempest-GroupSnapshotsTest-313287482 None] Lock "cinder-quobyte-a64ff073-f491-45fd-9c0e-0949de3551f9" released by "delete_volume" :: held 2.257s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:33:41 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-758bd196-cac6-48c7-902d-d106b1e23b30 tempest-GroupSnapshotsTest-313287482 None] Created reservations ['e3841efa-7ab2-4867-a1ea-350e96942ccb'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:33:41 devstack cinder-volume[87284]: WARNING cinder.db.api [None req-758bd196-cac6-48c7-902d-d106b1e23b30 tempest-GroupSnapshotsTest-313287482 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-633991888'] Jul 08 01:33:41 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-758bd196-cac6-48c7-902d-d106b1e23b30 tempest-GroupSnapshotsTest-313287482 None] Created reservations ['834f50b8-abd4-43f4-a7dd-fdb490c3a536', 'fcaabcd8-ca21-4873-a9e4-8644130648ea', 'ab25daab-6dfe-4617-8c4a-66dd6ca10394', '1b9dce7e-b63c-42ba-8117-596d3c75b898'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:33:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-758bd196-cac6-48c7-902d-d106b1e23b30 tempest-GroupSnapshotsTest-313287482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-758bd196-cac6-48c7-902d-d106b1e23b30 tempest-GroupSnapshotsTest-313287482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:41 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-758bd196-cac6-48c7-902d-d106b1e23b30 tempest-GroupSnapshotsTest-313287482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:33:41 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-758bd196-cac6-48c7-902d-d106b1e23b30 tempest-GroupSnapshotsTest-313287482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:33:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-758bd196-cac6-48c7-902d-d106b1e23b30 tempest-GroupSnapshotsTest-313287482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-758bd196-cac6-48c7-902d-d106b1e23b30 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:41 devstack sudo[90776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:33:41 devstack sudo[90776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:42 devstack sudo[90776]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-758bd196-cac6-48c7-902d-d106b1e23b30 tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.191s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:42 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-758bd196-cac6-48c7-902d-d106b1e23b30 tempest-GroupSnapshotsTest-313287482 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:33:42 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-758bd196-cac6-48c7-902d-d106b1e23b30 tempest-GroupSnapshotsTest-313287482 None] Delete group completed successfully. Jul 08 01:33:43 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-ca7d940b-96f0-4671-ae15-46b4c27f6563 tempest-GroupSnapshotsTest-313287482 None] Group tempest-GroupSnapshotsTest-Group-1324379512: creating Jul 08 01:33:43 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-ca7d940b-96f0-4671-ae15-46b4c27f6563 tempest-GroupSnapshotsTest-313287482 None] Group tempest-GroupSnapshotsTest-Group-1324379512: created successfully Jul 08 01:33:43 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-ca7d940b-96f0-4671-ae15-46b4c27f6563 tempest-GroupSnapshotsTest-313287482 None] Create group completed successfully. Jul 08 01:33:45 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-6751b91c-a4d1-4c43-b53b-5cdd01c8af19 tempest-GroupSnapshotsTest-313287482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:33:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6751b91c-a4d1-4c43-b53b-5cdd01c8af19 tempest-GroupSnapshotsTest-313287482 None] Flow 'volume_create_manager' (5d9f3e1c-621d-46d3-9960-d5d665a14347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:33:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6751b91c-a4d1-4c43-b53b-5cdd01c8af19 tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c1cf2ae-0d71-4147-8e4c-90acd81c4b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6751b91c-a4d1-4c43-b53b-5cdd01c8af19 tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c1cf2ae-0d71-4147-8e4c-90acd81c4b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-469137239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b4e98a74-fba0-4cdd-bdb6-812670130fc2,host='devstack@QuobyteHD#QuobyteHD',id=1fd195a6-ac27-47e8-862f-17e7d3569810,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7f7103321442c28889b646c417250e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:33:46Z,use_quota=True,user_id='e38df0a12e4041979038905b265e56c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5482fad7-ae25-4bc6-a973-c0566a324b1b),volume_type_id=5482fad7-ae25-4bc6-a973-c0566a324b1b)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6751b91c-a4d1-4c43-b53b-5cdd01c8af19 tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a3058d7-e1a2-45fa-aed3-2386cc9fe6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6751b91c-a4d1-4c43-b53b-5cdd01c8af19 tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a3058d7-e1a2-45fa-aed3-2386cc9fe6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6751b91c-a4d1-4c43-b53b-5cdd01c8af19 tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb105208-9dce-4457-82fd-b06afb70ede7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6751b91c-a4d1-4c43-b53b-5cdd01c8af19 tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb105208-9dce-4457-82fd-b06afb70ede7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fd195a6-ac27-47e8-862f-17e7d3569810', 'volume_name': 'volume-1fd195a6-ac27-47e8-862f-17e7d3569810', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6751b91c-a4d1-4c43-b53b-5cdd01c8af19 tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a1362f5-b3bd-41f8-9ef9-941dd6f4a7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6751b91c-a4d1-4c43-b53b-5cdd01c8af19 tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a1362f5-b3bd-41f8-9ef9-941dd6f4a7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6751b91c-a4d1-4c43-b53b-5cdd01c8af19 tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14be342e-f245-4c3d-a93e-f2791f5fe904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:45 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-6751b91c-a4d1-4c43-b53b-5cdd01c8af19 tempest-GroupSnapshotsTest-313287482 None] Volume 1fd195a6-ac27-47e8-862f-17e7d3569810: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fd195a6-ac27-47e8-862f-17e7d3569810', 'volume_size': 1} Jul 08 01:33:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6751b91c-a4d1-4c43-b53b-5cdd01c8af19 tempest-GroupSnapshotsTest-313287482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6751b91c-a4d1-4c43-b53b-5cdd01c8af19 tempest-GroupSnapshotsTest-313287482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:45 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-6751b91c-a4d1-4c43-b53b-5cdd01c8af19 tempest-GroupSnapshotsTest-313287482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b4e98a74-fba0-4cdd-bdb6-812670130fc2,created_at=2026-07-07T23:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-469137239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b4e98a74-fba0-4cdd-bdb6-812670130fc2,host='devstack@QuobyteHD#QuobyteHD',id=1fd195a6-ac27-47e8-862f-17e7d3569810,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7f7103321442c28889b646c417250e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:33:46Z,use_quota=True,user_id='e38df0a12e4041979038905b265e56c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5482fad7-ae25-4bc6-a973-c0566a324b1b),volume_type_id=5482fad7-ae25-4bc6-a973-c0566a324b1b)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:33:45 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-6751b91c-a4d1-4c43-b53b-5cdd01c8af19 tempest-GroupSnapshotsTest-313287482 None] Creating volume 1fd195a6-ac27-47e8-862f-17e7d3569810 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:33:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6751b91c-a4d1-4c43-b53b-5cdd01c8af19 tempest-GroupSnapshotsTest-313287482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6751b91c-a4d1-4c43-b53b-5cdd01c8af19 tempest-GroupSnapshotsTest-313287482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:45 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-6751b91c-a4d1-4c43-b53b-5cdd01c8af19 tempest-GroupSnapshotsTest-313287482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:33:45 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-6751b91c-a4d1-4c43-b53b-5cdd01c8af19 tempest-GroupSnapshotsTest-313287482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:33:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6751b91c-a4d1-4c43-b53b-5cdd01c8af19 tempest-GroupSnapshotsTest-313287482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:45 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-6751b91c-a4d1-4c43-b53b-5cdd01c8af19 tempest-GroupSnapshotsTest-313287482 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:33:45 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-6751b91c-a4d1-4c43-b53b-5cdd01c8af19 tempest-GroupSnapshotsTest-313287482 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:33:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6751b91c-a4d1-4c43-b53b-5cdd01c8af19 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:45 devstack sudo[90803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810 1073741824 Jul 08 01:33:45 devstack sudo[90803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:47 devstack sudo[90803]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6751b91c-a4d1-4c43-b53b-5cdd01c8af19 tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810 1073741824" returned: 0 in 1.296s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6751b91c-a4d1-4c43-b53b-5cdd01c8af19 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:47 devstack sudo[90810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810 Jul 08 01:33:47 devstack sudo[90810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:48 devstack sudo[90810]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6751b91c-a4d1-4c43-b53b-5cdd01c8af19 tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810" returned: 0 in 0.821s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:48 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-6751b91c-a4d1-4c43-b53b-5cdd01c8af19 tempest-GroupSnapshotsTest-313287482 None] <== create_volume: return (2186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:33:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6751b91c-a4d1-4c43-b53b-5cdd01c8af19 tempest-GroupSnapshotsTest-313287482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.189s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6751b91c-a4d1-4c43-b53b-5cdd01c8af19 tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14be342e-f245-4c3d-a93e-f2791f5fe904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fd195a6-ac27-47e8-862f-17e7d3569810', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6751b91c-a4d1-4c43-b53b-5cdd01c8af19 tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e07ae5-497b-456b-a5c7-dc739cf7f972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:48 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-6751b91c-a4d1-4c43-b53b-5cdd01c8af19 tempest-GroupSnapshotsTest-313287482 None] Volume volume-1fd195a6-ac27-47e8-862f-17e7d3569810 (1fd195a6-ac27-47e8-862f-17e7d3569810): created successfully Jul 08 01:33:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6751b91c-a4d1-4c43-b53b-5cdd01c8af19 tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e07ae5-497b-456b-a5c7-dc739cf7f972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6751b91c-a4d1-4c43-b53b-5cdd01c8af19 tempest-GroupSnapshotsTest-313287482 None] Flow 'volume_create_manager' (5d9f3e1c-621d-46d3-9960-d5d665a14347) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:33:48 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-6751b91c-a4d1-4c43-b53b-5cdd01c8af19 tempest-GroupSnapshotsTest-313287482 None] Created volume successfully. Jul 08 01:33:50 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-01e494ad-9a7d-48b8-9830-e725d8e341db tempest-VolumesTestJSON-1756675815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:33:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-01e494ad-9a7d-48b8-9830-e725d8e341db tempest-VolumesTestJSON-1756675815 None] Flow 'volume_create_manager' (bc8bd62b-1a2c-454c-8bab-137bea0a8cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:33:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-01e494ad-9a7d-48b8-9830-e725d8e341db tempest-VolumesTestJSON-1756675815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c1c53bd-b054-4c26-a58d-9c5b9f1bd702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-01e494ad-9a7d-48b8-9830-e725d8e341db tempest-VolumesTestJSON-1756675815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c1c53bd-b054-4c26-a58d-9c5b9f1bd702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-396399688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c83a41e-ae87-4f1d-a5a8-e1291d16e7b3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='499650424f61461a93431d39a7b206ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:33:50Z,use_quota=True,user_id='7110f3443c764cadad7929411ac7caaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-01e494ad-9a7d-48b8-9830-e725d8e341db tempest-VolumesTestJSON-1756675815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7838d7b8-c26e-48ae-991c-bbcba5efd0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-01e494ad-9a7d-48b8-9830-e725d8e341db tempest-VolumesTestJSON-1756675815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7838d7b8-c26e-48ae-991c-bbcba5efd0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-01e494ad-9a7d-48b8-9830-e725d8e341db tempest-VolumesTestJSON-1756675815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b7eef49-e0c4-4d15-bc0d-957693661851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-01e494ad-9a7d-48b8-9830-e725d8e341db tempest-VolumesTestJSON-1756675815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b7eef49-e0c4-4d15-bc0d-957693661851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c83a41e-ae87-4f1d-a5a8-e1291d16e7b3', 'volume_name': 'volume-5c83a41e-ae87-4f1d-a5a8-e1291d16e7b3', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-01e494ad-9a7d-48b8-9830-e725d8e341db tempest-VolumesTestJSON-1756675815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f09b7c95-7f33-4455-93ae-97016885a3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-01e494ad-9a7d-48b8-9830-e725d8e341db tempest-VolumesTestJSON-1756675815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f09b7c95-7f33-4455-93ae-97016885a3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-01e494ad-9a7d-48b8-9830-e725d8e341db tempest-VolumesTestJSON-1756675815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3401c55a-750a-4065-96e9-f48f2ab605e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:50 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-01e494ad-9a7d-48b8-9830-e725d8e341db tempest-VolumesTestJSON-1756675815 None] Volume 5c83a41e-ae87-4f1d-a5a8-e1291d16e7b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c83a41e-ae87-4f1d-a5a8-e1291d16e7b3', 'volume_size': 1} Jul 08 01:33:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-01e494ad-9a7d-48b8-9830-e725d8e341db tempest-VolumesTestJSON-1756675815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-01e494ad-9a7d-48b8-9830-e725d8e341db tempest-VolumesTestJSON-1756675815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-01e494ad-9a7d-48b8-9830-e725d8e341db tempest-VolumesTestJSON-1756675815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-396399688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c83a41e-ae87-4f1d-a5a8-e1291d16e7b3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='499650424f61461a93431d39a7b206ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:33:50Z,use_quota=True,user_id='7110f3443c764cadad7929411ac7caaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:33:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-01e494ad-9a7d-48b8-9830-e725d8e341db tempest-VolumesTestJSON-1756675815 None] Creating volume 5c83a41e-ae87-4f1d-a5a8-e1291d16e7b3 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:33:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-01e494ad-9a7d-48b8-9830-e725d8e341db tempest-VolumesTestJSON-1756675815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-01e494ad-9a7d-48b8-9830-e725d8e341db tempest-VolumesTestJSON-1756675815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-01e494ad-9a7d-48b8-9830-e725d8e341db tempest-VolumesTestJSON-1756675815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:33:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-01e494ad-9a7d-48b8-9830-e725d8e341db tempest-VolumesTestJSON-1756675815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:33:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-01e494ad-9a7d-48b8-9830-e725d8e341db tempest-VolumesTestJSON-1756675815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-01e494ad-9a7d-48b8-9830-e725d8e341db tempest-VolumesTestJSON-1756675815 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:33:50 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-01e494ad-9a7d-48b8-9830-e725d8e341db tempest-VolumesTestJSON-1756675815 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:33:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-01e494ad-9a7d-48b8-9830-e725d8e341db tempest-VolumesTestJSON-1756675815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5c83a41e-ae87-4f1d-a5a8-e1291d16e7b3 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:50 devstack sudo[90814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5c83a41e-ae87-4f1d-a5a8-e1291d16e7b3 1073741824 Jul 08 01:33:50 devstack sudo[90814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:50 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eda6cc2-008a-4903-95ee-dc066b01a5f7 tempest-GroupSnapshotsTest-313287482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:33:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8eda6cc2-008a-4903-95ee-dc066b01a5f7 tempest-GroupSnapshotsTest-313287482 None] Flow 'volume_create_manager' (fcf44a02-5f34-434c-9397-b92404c2e174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:33:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8eda6cc2-008a-4903-95ee-dc066b01a5f7 tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fb7891e-be2c-4627-b2e8-5aba679f9d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8eda6cc2-008a-4903-95ee-dc066b01a5f7 tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fb7891e-be2c-4627-b2e8-5aba679f9d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-609990752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b4e98a74-fba0-4cdd-bdb6-812670130fc2,host='devstack@QuobyteHD#QuobyteHD',id=ef2469b2-50bd-4124-930c-75a1207542af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7f7103321442c28889b646c417250e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:33:50Z,use_quota=True,user_id='e38df0a12e4041979038905b265e56c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5482fad7-ae25-4bc6-a973-c0566a324b1b),volume_type_id=5482fad7-ae25-4bc6-a973-c0566a324b1b)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8eda6cc2-008a-4903-95ee-dc066b01a5f7 tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0b6c303-dbc7-404f-b84c-750f33860bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8eda6cc2-008a-4903-95ee-dc066b01a5f7 tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0b6c303-dbc7-404f-b84c-750f33860bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8eda6cc2-008a-4903-95ee-dc066b01a5f7 tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (749c9d0d-7479-4af3-8221-7f6f4bc87951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8eda6cc2-008a-4903-95ee-dc066b01a5f7 tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (749c9d0d-7479-4af3-8221-7f6f4bc87951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef2469b2-50bd-4124-930c-75a1207542af', 'volume_name': 'volume-ef2469b2-50bd-4124-930c-75a1207542af', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8eda6cc2-008a-4903-95ee-dc066b01a5f7 tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa07a356-30a7-437a-9467-e3adb4e9af4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8eda6cc2-008a-4903-95ee-dc066b01a5f7 tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa07a356-30a7-437a-9467-e3adb4e9af4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8eda6cc2-008a-4903-95ee-dc066b01a5f7 tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a18bd94a-c3f1-4e9b-820f-b5ea42e22b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:50 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-8eda6cc2-008a-4903-95ee-dc066b01a5f7 tempest-GroupSnapshotsTest-313287482 None] Volume ef2469b2-50bd-4124-930c-75a1207542af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef2469b2-50bd-4124-930c-75a1207542af', 'volume_size': 1} Jul 08 01:33:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8eda6cc2-008a-4903-95ee-dc066b01a5f7 tempest-GroupSnapshotsTest-313287482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:51 devstack sudo[90814]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-01e494ad-9a7d-48b8-9830-e725d8e341db tempest-VolumesTestJSON-1756675815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5c83a41e-ae87-4f1d-a5a8-e1291d16e7b3 1073741824" returned: 0 in 0.969s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-01e494ad-9a7d-48b8-9830-e725d8e341db tempest-VolumesTestJSON-1756675815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5c83a41e-ae87-4f1d-a5a8-e1291d16e7b3 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:51 devstack sudo[90820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5c83a41e-ae87-4f1d-a5a8-e1291d16e7b3 Jul 08 01:33:51 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:52 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-01e494ad-9a7d-48b8-9830-e725d8e341db tempest-VolumesTestJSON-1756675815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5c83a41e-ae87-4f1d-a5a8-e1291d16e7b3" returned: 0 in 0.757s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-01e494ad-9a7d-48b8-9830-e725d8e341db tempest-VolumesTestJSON-1756675815 None] <== create_volume: return (1790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:33:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-01e494ad-9a7d-48b8-9830-e725d8e341db tempest-VolumesTestJSON-1756675815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.792s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8eda6cc2-008a-4903-95ee-dc066b01a5f7 tempest-GroupSnapshotsTest-313287482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.620s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-8eda6cc2-008a-4903-95ee-dc066b01a5f7 tempest-GroupSnapshotsTest-313287482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b4e98a74-fba0-4cdd-bdb6-812670130fc2,created_at=2026-07-07T23:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-609990752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b4e98a74-fba0-4cdd-bdb6-812670130fc2,host='devstack@QuobyteHD#QuobyteHD',id=ef2469b2-50bd-4124-930c-75a1207542af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7f7103321442c28889b646c417250e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:33:50Z,use_quota=True,user_id='e38df0a12e4041979038905b265e56c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5482fad7-ae25-4bc6-a973-c0566a324b1b),volume_type_id=5482fad7-ae25-4bc6-a973-c0566a324b1b)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:33:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-8eda6cc2-008a-4903-95ee-dc066b01a5f7 tempest-GroupSnapshotsTest-313287482 None] Creating volume ef2469b2-50bd-4124-930c-75a1207542af {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:33:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8eda6cc2-008a-4903-95ee-dc066b01a5f7 tempest-GroupSnapshotsTest-313287482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8eda6cc2-008a-4903-95ee-dc066b01a5f7 tempest-GroupSnapshotsTest-313287482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-8eda6cc2-008a-4903-95ee-dc066b01a5f7 tempest-GroupSnapshotsTest-313287482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:33:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-8eda6cc2-008a-4903-95ee-dc066b01a5f7 tempest-GroupSnapshotsTest-313287482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:33:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8eda6cc2-008a-4903-95ee-dc066b01a5f7 tempest-GroupSnapshotsTest-313287482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-8eda6cc2-008a-4903-95ee-dc066b01a5f7 tempest-GroupSnapshotsTest-313287482 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:33:52 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-8eda6cc2-008a-4903-95ee-dc066b01a5f7 tempest-GroupSnapshotsTest-313287482 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:33:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8eda6cc2-008a-4903-95ee-dc066b01a5f7 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:52 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-01e494ad-9a7d-48b8-9830-e725d8e341db tempest-VolumesTestJSON-1756675815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3401c55a-750a-4065-96e9-f48f2ab605e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c83a41e-ae87-4f1d-a5a8-e1291d16e7b3', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:52 devstack sudo[90823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af 1073741824 Jul 08 01:33:52 devstack sudo[90823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:52 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-01e494ad-9a7d-48b8-9830-e725d8e341db tempest-VolumesTestJSON-1756675815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5156e8f-5c47-4f9a-9cf6-47cff1bba49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:52 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-01e494ad-9a7d-48b8-9830-e725d8e341db tempest-VolumesTestJSON-1756675815 None] Volume volume-5c83a41e-ae87-4f1d-a5a8-e1291d16e7b3 (5c83a41e-ae87-4f1d-a5a8-e1291d16e7b3): created successfully Jul 08 01:33:52 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-01e494ad-9a7d-48b8-9830-e725d8e341db tempest-VolumesTestJSON-1756675815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5156e8f-5c47-4f9a-9cf6-47cff1bba49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:52 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-01e494ad-9a7d-48b8-9830-e725d8e341db tempest-VolumesTestJSON-1756675815 None] Flow 'volume_create_manager' (bc8bd62b-1a2c-454c-8bab-137bea0a8cf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:33:52 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-01e494ad-9a7d-48b8-9830-e725d8e341db tempest-VolumesTestJSON-1756675815 None] Created volume successfully. Jul 08 01:33:53 devstack sudo[90823]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8eda6cc2-008a-4903-95ee-dc066b01a5f7 tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af 1073741824" returned: 0 in 1.004s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8eda6cc2-008a-4903-95ee-dc066b01a5f7 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:53 devstack sudo[90828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af Jul 08 01:33:53 devstack sudo[90828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:53 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-672da2ed-2f89-494b-bda6-5cac421e6445 tempest-VolumesTestJSON-1756675815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:33:53 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-672da2ed-2f89-494b-bda6-5cac421e6445 tempest-VolumesTestJSON-1756675815 None] Flow 'volume_create_manager' (861e2971-1195-44d1-b77c-9b2291035c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:33:53 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-672da2ed-2f89-494b-bda6-5cac421e6445 tempest-VolumesTestJSON-1756675815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1552d1a5-91bd-4098-88e1-8ed50faad57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:53 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-672da2ed-2f89-494b-bda6-5cac421e6445 tempest-VolumesTestJSON-1756675815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1552d1a5-91bd-4098-88e1-8ed50faad57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1641138183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5286c56-4fad-486d-99fa-014479397156,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='499650424f61461a93431d39a7b206ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:33:54Z,use_quota=True,user_id='7110f3443c764cadad7929411ac7caaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:53 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-672da2ed-2f89-494b-bda6-5cac421e6445 tempest-VolumesTestJSON-1756675815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f664b06a-f937-47d1-b27d-852c05b756be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:53 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-672da2ed-2f89-494b-bda6-5cac421e6445 tempest-VolumesTestJSON-1756675815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f664b06a-f937-47d1-b27d-852c05b756be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:53 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-672da2ed-2f89-494b-bda6-5cac421e6445 tempest-VolumesTestJSON-1756675815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c76bcf-9f01-4184-923a-2479cc0b93f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:53 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-672da2ed-2f89-494b-bda6-5cac421e6445 tempest-VolumesTestJSON-1756675815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c76bcf-9f01-4184-923a-2479cc0b93f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5286c56-4fad-486d-99fa-014479397156', 'volume_name': 'volume-d5286c56-4fad-486d-99fa-014479397156', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:53 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-672da2ed-2f89-494b-bda6-5cac421e6445 tempest-VolumesTestJSON-1756675815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0ef68e8-6d52-445d-a0de-3f556c41d6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:53 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-672da2ed-2f89-494b-bda6-5cac421e6445 tempest-VolumesTestJSON-1756675815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0ef68e8-6d52-445d-a0de-3f556c41d6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:53 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-672da2ed-2f89-494b-bda6-5cac421e6445 tempest-VolumesTestJSON-1756675815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb2d1ea7-dafc-4923-a248-8f250b4ae680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:53 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-672da2ed-2f89-494b-bda6-5cac421e6445 tempest-VolumesTestJSON-1756675815 None] Volume d5286c56-4fad-486d-99fa-014479397156: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5286c56-4fad-486d-99fa-014479397156', 'volume_size': 1} Jul 08 01:33:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-672da2ed-2f89-494b-bda6-5cac421e6445 tempest-VolumesTestJSON-1756675815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:54 devstack sudo[90828]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8eda6cc2-008a-4903-95ee-dc066b01a5f7 tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af" returned: 0 in 0.815s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:54 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-8eda6cc2-008a-4903-95ee-dc066b01a5f7 tempest-GroupSnapshotsTest-313287482 None] <== create_volume: return (1901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:33:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8eda6cc2-008a-4903-95ee-dc066b01a5f7 tempest-GroupSnapshotsTest-313287482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.903s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-672da2ed-2f89-494b-bda6-5cac421e6445 tempest-VolumesTestJSON-1756675815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.121s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:54 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-672da2ed-2f89-494b-bda6-5cac421e6445 tempest-VolumesTestJSON-1756675815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1641138183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5286c56-4fad-486d-99fa-014479397156,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='499650424f61461a93431d39a7b206ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:33:54Z,use_quota=True,user_id='7110f3443c764cadad7929411ac7caaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:33:54 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-672da2ed-2f89-494b-bda6-5cac421e6445 tempest-VolumesTestJSON-1756675815 None] Creating volume d5286c56-4fad-486d-99fa-014479397156 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:33:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-672da2ed-2f89-494b-bda6-5cac421e6445 tempest-VolumesTestJSON-1756675815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-672da2ed-2f89-494b-bda6-5cac421e6445 tempest-VolumesTestJSON-1756675815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:54 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-672da2ed-2f89-494b-bda6-5cac421e6445 tempest-VolumesTestJSON-1756675815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:33:54 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-672da2ed-2f89-494b-bda6-5cac421e6445 tempest-VolumesTestJSON-1756675815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:33:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-672da2ed-2f89-494b-bda6-5cac421e6445 tempest-VolumesTestJSON-1756675815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:54 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-672da2ed-2f89-494b-bda6-5cac421e6445 tempest-VolumesTestJSON-1756675815 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:33:54 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-672da2ed-2f89-494b-bda6-5cac421e6445 tempest-VolumesTestJSON-1756675815 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:33:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-672da2ed-2f89-494b-bda6-5cac421e6445 tempest-VolumesTestJSON-1756675815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d5286c56-4fad-486d-99fa-014479397156 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:54 devstack sudo[90831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d5286c56-4fad-486d-99fa-014479397156 1073741824 Jul 08 01:33:54 devstack sudo[90831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8eda6cc2-008a-4903-95ee-dc066b01a5f7 tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a18bd94a-c3f1-4e9b-820f-b5ea42e22b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef2469b2-50bd-4124-930c-75a1207542af', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8eda6cc2-008a-4903-95ee-dc066b01a5f7 tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b74b650d-9352-42b8-a92c-49334a388b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:54 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-8eda6cc2-008a-4903-95ee-dc066b01a5f7 tempest-GroupSnapshotsTest-313287482 None] Volume volume-ef2469b2-50bd-4124-930c-75a1207542af (ef2469b2-50bd-4124-930c-75a1207542af): created successfully Jul 08 01:33:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8eda6cc2-008a-4903-95ee-dc066b01a5f7 tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b74b650d-9352-42b8-a92c-49334a388b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8eda6cc2-008a-4903-95ee-dc066b01a5f7 tempest-GroupSnapshotsTest-313287482 None] Flow 'volume_create_manager' (fcf44a02-5f34-434c-9397-b92404c2e174) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:33:54 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-8eda6cc2-008a-4903-95ee-dc066b01a5f7 tempest-GroupSnapshotsTest-313287482 None] Created volume successfully. Jul 08 01:33:55 devstack sudo[90831]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-672da2ed-2f89-494b-bda6-5cac421e6445 tempest-VolumesTestJSON-1756675815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d5286c56-4fad-486d-99fa-014479397156 1073741824" returned: 0 in 0.952s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-672da2ed-2f89-494b-bda6-5cac421e6445 tempest-VolumesTestJSON-1756675815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d5286c56-4fad-486d-99fa-014479397156 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:55 devstack sudo[90855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d5286c56-4fad-486d-99fa-014479397156 Jul 08 01:33:55 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:33:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:33:55 devstack sudo[90855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:33:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:55 devstack sudo[90857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:33:55 devstack sudo[90857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:55 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-3bd9bd94-0a43-4946-b52e-8aec740559c8 tempest-GroupSnapshotsTest-313287482 None] Update group completed successfully. Jul 08 01:33:55 devstack sudo[90855]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-672da2ed-2f89-494b-bda6-5cac421e6445 tempest-VolumesTestJSON-1756675815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d5286c56-4fad-486d-99fa-014479397156" returned: 0 in 0.685s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-672da2ed-2f89-494b-bda6-5cac421e6445 tempest-VolumesTestJSON-1756675815 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:33:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-672da2ed-2f89-494b-bda6-5cac421e6445 tempest-VolumesTestJSON-1756675815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.690s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-672da2ed-2f89-494b-bda6-5cac421e6445 tempest-VolumesTestJSON-1756675815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb2d1ea7-dafc-4923-a248-8f250b4ae680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5286c56-4fad-486d-99fa-014479397156', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-672da2ed-2f89-494b-bda6-5cac421e6445 tempest-VolumesTestJSON-1756675815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (543eea1d-9aed-4cd6-8876-65322279f041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:55 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-672da2ed-2f89-494b-bda6-5cac421e6445 tempest-VolumesTestJSON-1756675815 None] Volume volume-d5286c56-4fad-486d-99fa-014479397156 (d5286c56-4fad-486d-99fa-014479397156): created successfully Jul 08 01:33:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-672da2ed-2f89-494b-bda6-5cac421e6445 tempest-VolumesTestJSON-1756675815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (543eea1d-9aed-4cd6-8876-65322279f041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-672da2ed-2f89-494b-bda6-5cac421e6445 tempest-VolumesTestJSON-1756675815 None] Flow 'volume_create_manager' (861e2971-1195-44d1-b77c-9b2291035c57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:33:55 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-672da2ed-2f89-494b-bda6-5cac421e6445 tempest-VolumesTestJSON-1756675815 None] Created volume successfully. Jul 08 01:33:55 devstack sudo[90857]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.773s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:55 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:33:55 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager._thread_info {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:33:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread count: 8 {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:33:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread info: [<_MainThread(MainThread, started 127058402500736)>, , , , , , , ] {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:33:56 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-bf44e9fd-c64f-4e6a-8440-87431dde1fbd tempest-GroupSnapshotsTest-313287482 None] Update group completed successfully. Jul 08 01:33:57 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-429bf329-c32c-4180-8364-1aeab69d79ff tempest-VolumesTestJSON-1756675815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:33:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-429bf329-c32c-4180-8364-1aeab69d79ff tempest-VolumesTestJSON-1756675815 None] Flow 'volume_create_manager' (f4300030-a34a-431a-8195-aee8ce364b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:33:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-429bf329-c32c-4180-8364-1aeab69d79ff tempest-VolumesTestJSON-1756675815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c19a898b-0d6b-422c-b68d-c3a6877db384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-429bf329-c32c-4180-8364-1aeab69d79ff tempest-VolumesTestJSON-1756675815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c19a898b-0d6b-422c-b68d-c3a6877db384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:33:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1815733985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bb761e3-0347-4afc-bfd7-03727e93d50f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='499650424f61461a93431d39a7b206ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:33:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:33:58Z,use_quota=True,user_id='7110f3443c764cadad7929411ac7caaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-429bf329-c32c-4180-8364-1aeab69d79ff tempest-VolumesTestJSON-1756675815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5580ad0-e69d-4cb3-ad36-06c66d9d3bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-429bf329-c32c-4180-8364-1aeab69d79ff tempest-VolumesTestJSON-1756675815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5580ad0-e69d-4cb3-ad36-06c66d9d3bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-429bf329-c32c-4180-8364-1aeab69d79ff tempest-VolumesTestJSON-1756675815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5be3588-4044-4566-a38b-696de2d46167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-429bf329-c32c-4180-8364-1aeab69d79ff tempest-VolumesTestJSON-1756675815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5be3588-4044-4566-a38b-696de2d46167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bb761e3-0347-4afc-bfd7-03727e93d50f', 'volume_name': 'volume-8bb761e3-0347-4afc-bfd7-03727e93d50f', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-429bf329-c32c-4180-8364-1aeab69d79ff tempest-VolumesTestJSON-1756675815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe87131-9612-4a20-a417-8d02dc9be570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-429bf329-c32c-4180-8364-1aeab69d79ff tempest-VolumesTestJSON-1756675815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe87131-9612-4a20-a417-8d02dc9be570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-429bf329-c32c-4180-8364-1aeab69d79ff tempest-VolumesTestJSON-1756675815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c175bfd0-c9d4-4a63-af3c-b90844fcd6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:57 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-429bf329-c32c-4180-8364-1aeab69d79ff tempest-VolumesTestJSON-1756675815 None] Volume 8bb761e3-0347-4afc-bfd7-03727e93d50f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bb761e3-0347-4afc-bfd7-03727e93d50f', 'volume_size': 1} Jul 08 01:33:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-429bf329-c32c-4180-8364-1aeab69d79ff tempest-VolumesTestJSON-1756675815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-429bf329-c32c-4180-8364-1aeab69d79ff tempest-VolumesTestJSON-1756675815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-429bf329-c32c-4180-8364-1aeab69d79ff tempest-VolumesTestJSON-1756675815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:33:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1815733985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bb761e3-0347-4afc-bfd7-03727e93d50f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='499650424f61461a93431d39a7b206ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:33:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:33:58Z,use_quota=True,user_id='7110f3443c764cadad7929411ac7caaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:33:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-429bf329-c32c-4180-8364-1aeab69d79ff tempest-VolumesTestJSON-1756675815 None] Creating volume 8bb761e3-0347-4afc-bfd7-03727e93d50f {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:33:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-429bf329-c32c-4180-8364-1aeab69d79ff tempest-VolumesTestJSON-1756675815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-429bf329-c32c-4180-8364-1aeab69d79ff tempest-VolumesTestJSON-1756675815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-429bf329-c32c-4180-8364-1aeab69d79ff tempest-VolumesTestJSON-1756675815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:33:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-429bf329-c32c-4180-8364-1aeab69d79ff tempest-VolumesTestJSON-1756675815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:33:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-429bf329-c32c-4180-8364-1aeab69d79ff tempest-VolumesTestJSON-1756675815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-429bf329-c32c-4180-8364-1aeab69d79ff tempest-VolumesTestJSON-1756675815 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:33:57 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-429bf329-c32c-4180-8364-1aeab69d79ff tempest-VolumesTestJSON-1756675815 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:33:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-429bf329-c32c-4180-8364-1aeab69d79ff tempest-VolumesTestJSON-1756675815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8bb761e3-0347-4afc-bfd7-03727e93d50f 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:57 devstack sudo[90868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8bb761e3-0347-4afc-bfd7-03727e93d50f 1073741824 Jul 08 01:33:57 devstack sudo[90868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:57 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-8a1ab795-5374-48d3-b6f5-a99064e4a41a tempest-GroupSnapshotsTest-313287482 None] Update group completed successfully. Jul 08 01:33:58 devstack sudo[90868]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-429bf329-c32c-4180-8364-1aeab69d79ff tempest-VolumesTestJSON-1756675815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8bb761e3-0347-4afc-bfd7-03727e93d50f 1073741824" returned: 0 in 0.951s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-429bf329-c32c-4180-8364-1aeab69d79ff tempest-VolumesTestJSON-1756675815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8bb761e3-0347-4afc-bfd7-03727e93d50f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:58 devstack sudo[90877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8bb761e3-0347-4afc-bfd7-03727e93d50f Jul 08 01:33:58 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:33:58 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-31294e19-0993-48d8-a940-c345228cc652 tempest-GroupSnapshotsTest-313287482 None] Update group completed successfully. Jul 08 01:33:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-0ee93f7c-8732-4fbc-aa33-b84c702e4a65 req-af479701-5eae-4d61-a278-2d94c2ae5cdc tempest-ServerActionsTestOtherA-84188968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:33:59 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root Jul 08 01:33:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-429bf329-c32c-4180-8364-1aeab69d79ff tempest-VolumesTestJSON-1756675815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8bb761e3-0347-4afc-bfd7-03727e93d50f" returned: 0 in 0.674s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:33:59 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-429bf329-c32c-4180-8364-1aeab69d79ff tempest-VolumesTestJSON-1756675815 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:33:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-429bf329-c32c-4180-8364-1aeab69d79ff tempest-VolumesTestJSON-1756675815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:33:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-0ee93f7c-8732-4fbc-aa33-b84c702e4a65 req-af479701-5eae-4d61-a278-2d94c2ae5cdc tempest-ServerActionsTestOtherA-84188968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.113s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:33:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-429bf329-c32c-4180-8364-1aeab69d79ff tempest-VolumesTestJSON-1756675815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c175bfd0-c9d4-4a63-af3c-b90844fcd6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bb761e3-0347-4afc-bfd7-03727e93d50f', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-429bf329-c32c-4180-8364-1aeab69d79ff tempest-VolumesTestJSON-1756675815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12f395db-3f60-43ab-b2fd-ef3021baa7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:33:59 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ab66bc-1346-4165-9732-9dc716fa9de7]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:33:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-0ee93f7c-8732-4fbc-aa33-b84c702e4a65 req-af479701-5eae-4d61-a278-2d94c2ae5cdc tempest-ServerActionsTestOtherA-84188968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3322ae6d-a22f-4ba5-8937-23a1c1066cb7 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:33:59 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-429bf329-c32c-4180-8364-1aeab69d79ff tempest-VolumesTestJSON-1756675815 None] Volume volume-8bb761e3-0347-4afc-bfd7-03727e93d50f (8bb761e3-0347-4afc-bfd7-03727e93d50f): created successfully Jul 08 01:33:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-429bf329-c32c-4180-8364-1aeab69d79ff tempest-VolumesTestJSON-1756675815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12f395db-3f60-43ab-b2fd-ef3021baa7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:33:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-429bf329-c32c-4180-8364-1aeab69d79ff tempest-VolumesTestJSON-1756675815 None] Flow 'volume_create_manager' (f4300030-a34a-431a-8195-aee8ce364b8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:33:59 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-429bf329-c32c-4180-8364-1aeab69d79ff tempest-VolumesTestJSON-1756675815 None] Created volume successfully. Jul 08 01:33:59 devstack sudo[90888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3322ae6d-a22f-4ba5-8937-23a1c1066cb7 Jul 08 01:33:59 devstack sudo[90888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:00 devstack sudo[90888]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-0ee93f7c-8732-4fbc-aa33-b84c702e4a65 req-af479701-5eae-4d61-a278-2d94c2ae5cdc tempest-ServerActionsTestOtherA-84188968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3322ae6d-a22f-4ba5-8937-23a1c1066cb7" returned: 0 in 0.864s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-0ee93f7c-8732-4fbc-aa33-b84c702e4a65 req-af479701-5eae-4d61-a278-2d94c2ae5cdc tempest-ServerActionsTestOtherA-84188968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.889s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:34:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-0ee93f7c-8732-4fbc-aa33-b84c702e4a65 req-af479701-5eae-4d61-a278-2d94c2ae5cdc tempest-ServerActionsTestOtherA-84188968 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96', 'name': 'volume-3322ae6d-a22f-4ba5-8937-23a1c1066cb7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd8bd89be-5e49-4316-8993-46fdeeaf22ec', 'enforce_multipath': True} {{(pid=87284) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:34:00 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-0ee93f7c-8732-4fbc-aa33-b84c702e4a65 req-af479701-5eae-4d61-a278-2d94c2ae5cdc tempest-ServerActionsTestOtherA-84188968 None] attachment_update completed successfully. Jul 08 01:34:00 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-3b24d5b7-50da-4dd5-a217-ca67ce32db13 tempest-GroupSnapshotsTest-313287482 None] GroupSnapshot e5304453-f3ea-4cdd-840f-ff06fc9ed2a7: creating. Jul 08 01:34:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3b24d5b7-50da-4dd5-a217-ca67ce32db13 tempest-GroupSnapshotsTest-313287482 None] Group snapshot e5304453-f3ea-4cdd-840f-ff06fc9ed2a7: creating. {{(pid=87284) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 01:34:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3b24d5b7-50da-4dd5-a217-ca67ce32db13 tempest-GroupSnapshotsTest-313287482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:34:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3b24d5b7-50da-4dd5-a217-ca67ce32db13 tempest-GroupSnapshotsTest-313287482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:34:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-3b24d5b7-50da-4dd5-a217-ca67ce32db13 tempest-GroupSnapshotsTest-313287482 None] Creating offline snapshot 4e48a5f0-0b87-40ea-90a6-5f8f3f0defba of volume ef2469b2-50bd-4124-930c-75a1207542af {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:34:00 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8195d1c-a411-4f0f-8d7c-c36a40630e12]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:34:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3b24d5b7-50da-4dd5-a217-ca67ce32db13 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:00 devstack sudo[90893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af Jul 08 01:34:00 devstack sudo[90893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:01 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3a6ee51c-50fb-482d-942a-f33ea3ee4da8 tempest-VolumesTestJSON-1756675815 None] Acquiring lock "cinder-8bb761e3-0347-4afc-bfd7-03727e93d50f-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:34:01 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3a6ee51c-50fb-482d-942a-f33ea3ee4da8 tempest-VolumesTestJSON-1756675815 None] Lock "cinder-8bb761e3-0347-4afc-bfd7-03727e93d50f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:34:01 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3a6ee51c-50fb-482d-942a-f33ea3ee4da8 tempest-VolumesTestJSON-1756675815 None] Acquiring lock "cinder-quobyte-8bb761e3-0347-4afc-bfd7-03727e93d50f" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:34:01 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3a6ee51c-50fb-482d-942a-f33ea3ee4da8 tempest-VolumesTestJSON-1756675815 None] Lock "cinder-quobyte-8bb761e3-0347-4afc-bfd7-03727e93d50f" acquired by "delete_volume" :: waited 0.031s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:34:01 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82930ea-185b-46ee-837d-6bcfaa1ef846]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:34:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3a6ee51c-50fb-482d-942a-f33ea3ee4da8 tempest-VolumesTestJSON-1756675815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8bb761e3-0347-4afc-bfd7-03727e93d50f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:01 devstack sudo[90963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8bb761e3-0347-4afc-bfd7-03727e93d50f Jul 08 01:34:01 devstack sudo[90963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:01 devstack sudo[90893]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3b24d5b7-50da-4dd5-a217-ca67ce32db13 tempest-GroupSnapshotsTest-313287482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af" returned: 0 in 0.960s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3b24d5b7-50da-4dd5-a217-ca67ce32db13 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af.4e48a5f0-0b87-40ea-90a6-5f8f3f0defba 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:01 devstack sudo[90969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af.4e48a5f0-0b87-40ea-90a6-5f8f3f0defba 1G Jul 08 01:34:01 devstack sudo[90969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:02 devstack sudo[90963]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3a6ee51c-50fb-482d-942a-f33ea3ee4da8 tempest-VolumesTestJSON-1756675815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8bb761e3-0347-4afc-bfd7-03727e93d50f" returned: 0 in 0.856s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3a6ee51c-50fb-482d-942a-f33ea3ee4da8 tempest-VolumesTestJSON-1756675815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8bb761e3-0347-4afc-bfd7-03727e93d50f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:02 devstack sudo[91290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8bb761e3-0347-4afc-bfd7-03727e93d50f Jul 08 01:34:02 devstack sudo[91290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:02 devstack sudo[90969]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3b24d5b7-50da-4dd5-a217-ca67ce32db13 tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af.4e48a5f0-0b87-40ea-90a6-5f8f3f0defba 1G" returned: 0 in 0.905s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3b24d5b7-50da-4dd5-a217-ca67ce32db13 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef2469b2-50bd-4124-930c-75a1207542af -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af.4e48a5f0-0b87-40ea-90a6-5f8f3f0defba {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:02 devstack sudo[91295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef2469b2-50bd-4124-930c-75a1207542af -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af.4e48a5f0-0b87-40ea-90a6-5f8f3f0defba Jul 08 01:34:02 devstack sudo[91295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:02 devstack sudo[91290]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3a6ee51c-50fb-482d-942a-f33ea3ee4da8 tempest-VolumesTestJSON-1756675815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8bb761e3-0347-4afc-bfd7-03727e93d50f" returned: 0 in 0.709s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:02 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3a6ee51c-50fb-482d-942a-f33ea3ee4da8 tempest-VolumesTestJSON-1756675815 None] Lock "cinder-quobyte-8bb761e3-0347-4afc-bfd7-03727e93d50f" released by "delete_volume" :: held 1.611s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:34:02 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-3a6ee51c-50fb-482d-942a-f33ea3ee4da8 tempest-VolumesTestJSON-1756675815 None] Created reservations ['6bbf0902-805b-4ab1-a918-86a4b8607c37', '4925c6c5-c993-407e-a22e-9ef52dc41e32', 'df74df8c-6549-4054-8469-685ba69bf775', '9a2d39cc-8f52-4838-89bd-d47a13f0593b'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:34:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3a6ee51c-50fb-482d-942a-f33ea3ee4da8 tempest-VolumesTestJSON-1756675815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:34:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3a6ee51c-50fb-482d-942a-f33ea3ee4da8 tempest-VolumesTestJSON-1756675815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:34:03 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3a6ee51c-50fb-482d-942a-f33ea3ee4da8 tempest-VolumesTestJSON-1756675815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:34:03 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3a6ee51c-50fb-482d-942a-f33ea3ee4da8 tempest-VolumesTestJSON-1756675815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:34:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3a6ee51c-50fb-482d-942a-f33ea3ee4da8 tempest-VolumesTestJSON-1756675815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:34:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3a6ee51c-50fb-482d-942a-f33ea3ee4da8 tempest-VolumesTestJSON-1756675815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:03 devstack sudo[91298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:34:03 devstack sudo[91298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:03 devstack sudo[91295]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3b24d5b7-50da-4dd5-a217-ca67ce32db13 tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef2469b2-50bd-4124-930c-75a1207542af -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af.4e48a5f0-0b87-40ea-90a6-5f8f3f0defba" returned: 0 in 0.739s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:03 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-3b24d5b7-50da-4dd5-a217-ca67ce32db13 tempest-GroupSnapshotsTest-313287482 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af.4e48a5f0-0b87-40ea-90a6-5f8f3f0defba is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:34:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3b24d5b7-50da-4dd5-a217-ca67ce32db13 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af.4e48a5f0-0b87-40ea-90a6-5f8f3f0defba {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:03 devstack sudo[91303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af.4e48a5f0-0b87-40ea-90a6-5f8f3f0defba Jul 08 01:34:03 devstack sudo[91303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:03 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-070740a9-c5c5-4016-be85-09365ce79490 tempest-VolumesTestJSON-1756675815 None] Acquiring lock "cinder-d5286c56-4fad-486d-99fa-014479397156-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:34:03 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-070740a9-c5c5-4016-be85-09365ce79490 tempest-VolumesTestJSON-1756675815 None] Lock "cinder-d5286c56-4fad-486d-99fa-014479397156-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:34:03 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-070740a9-c5c5-4016-be85-09365ce79490 tempest-VolumesTestJSON-1756675815 None] Acquiring lock "cinder-quobyte-d5286c56-4fad-486d-99fa-014479397156" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:34:03 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-070740a9-c5c5-4016-be85-09365ce79490 tempest-VolumesTestJSON-1756675815 None] Lock "cinder-quobyte-d5286c56-4fad-486d-99fa-014479397156" acquired by "delete_volume" :: waited 0.016s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:34:03 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[45731935-8e48-4d99-b429-bd7c9ec8238f]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:34:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-070740a9-c5c5-4016-be85-09365ce79490 tempest-VolumesTestJSON-1756675815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d5286c56-4fad-486d-99fa-014479397156 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:03 devstack sudo[91305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d5286c56-4fad-486d-99fa-014479397156 Jul 08 01:34:03 devstack sudo[91305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:03 devstack sudo[91298]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3a6ee51c-50fb-482d-942a-f33ea3ee4da8 tempest-VolumesTestJSON-1756675815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.701s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:03 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-3a6ee51c-50fb-482d-942a-f33ea3ee4da8 tempest-VolumesTestJSON-1756675815 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:34:03 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-3a6ee51c-50fb-482d-942a-f33ea3ee4da8 tempest-VolumesTestJSON-1756675815 None] Deleted volume successfully. Jul 08 01:34:03 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3a6ee51c-50fb-482d-942a-f33ea3ee4da8 tempest-VolumesTestJSON-1756675815 None] Lock "cinder-8bb761e3-0347-4afc-bfd7-03727e93d50f-delete_volume" released by "delete_volume" :: held 2.586s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:34:03 devstack sudo[91303]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3b24d5b7-50da-4dd5-a217-ca67ce32db13 tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af.4e48a5f0-0b87-40ea-90a6-5f8f3f0defba" returned: 0 in 0.670s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3b24d5b7-50da-4dd5-a217-ca67ce32db13 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:04 devstack sudo[91309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af.info Jul 08 01:34:04 devstack sudo[91309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:04 devstack sudo[91305]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-070740a9-c5c5-4016-be85-09365ce79490 tempest-VolumesTestJSON-1756675815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d5286c56-4fad-486d-99fa-014479397156" returned: 0 in 0.757s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-070740a9-c5c5-4016-be85-09365ce79490 tempest-VolumesTestJSON-1756675815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d5286c56-4fad-486d-99fa-014479397156 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:04 devstack sudo[91314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d5286c56-4fad-486d-99fa-014479397156 Jul 08 01:34:04 devstack sudo[91314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:04 devstack sudo[91309]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3b24d5b7-50da-4dd5-a217-ca67ce32db13 tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af.info" returned: 0 in 0.666s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:04 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-3b24d5b7-50da-4dd5-a217-ca67ce32db13 tempest-GroupSnapshotsTest-313287482 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:34:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3b24d5b7-50da-4dd5-a217-ca67ce32db13 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:04 devstack sudo[91318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af.info Jul 08 01:34:04 devstack sudo[91318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:04 devstack sudo[91314]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-070740a9-c5c5-4016-be85-09365ce79490 tempest-VolumesTestJSON-1756675815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d5286c56-4fad-486d-99fa-014479397156" returned: 0 in 0.682s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:05 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-070740a9-c5c5-4016-be85-09365ce79490 tempest-VolumesTestJSON-1756675815 None] Lock "cinder-quobyte-d5286c56-4fad-486d-99fa-014479397156" released by "delete_volume" :: held 1.481s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:34:05 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-070740a9-c5c5-4016-be85-09365ce79490 tempest-VolumesTestJSON-1756675815 None] Created reservations ['74daf551-93e3-4308-b1fa-cc95bd784c35', '0670d0a5-a6c4-4fcf-ac1d-79462bda4fed', '9bb7d227-a06c-4a0f-8a4f-c4c4399e886b', 'f225db58-fc29-47e7-ba99-53ac8e845868'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:34:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-070740a9-c5c5-4016-be85-09365ce79490 tempest-VolumesTestJSON-1756675815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:34:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-070740a9-c5c5-4016-be85-09365ce79490 tempest-VolumesTestJSON-1756675815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:34:05 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-070740a9-c5c5-4016-be85-09365ce79490 tempest-VolumesTestJSON-1756675815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:34:05 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-070740a9-c5c5-4016-be85-09365ce79490 tempest-VolumesTestJSON-1756675815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:34:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-070740a9-c5c5-4016-be85-09365ce79490 tempest-VolumesTestJSON-1756675815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:34:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-070740a9-c5c5-4016-be85-09365ce79490 tempest-VolumesTestJSON-1756675815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:05 devstack sudo[91323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:34:05 devstack sudo[91323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:05 devstack sudo[91318]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3b24d5b7-50da-4dd5-a217-ca67ce32db13 tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af.info" returned: 0 in 0.702s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3b24d5b7-50da-4dd5-a217-ca67ce32db13 tempest-GroupSnapshotsTest-313287482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.763s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:34:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3b24d5b7-50da-4dd5-a217-ca67ce32db13 tempest-GroupSnapshotsTest-313287482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:34:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3b24d5b7-50da-4dd5-a217-ca67ce32db13 tempest-GroupSnapshotsTest-313287482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:34:05 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-3b24d5b7-50da-4dd5-a217-ca67ce32db13 tempest-GroupSnapshotsTest-313287482 None] Creating offline snapshot fe0a9ef2-efbd-4577-bd17-f3b3a6136ee9 of volume 1fd195a6-ac27-47e8-862f-17e7d3569810 {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:34:05 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87fbf01-3cd1-4331-a44b-dc4dd8133d02]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:34:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3b24d5b7-50da-4dd5-a217-ca67ce32db13 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:05 devstack sudo[91328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810 Jul 08 01:34:05 devstack sudo[91328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:05 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3857a7dc-0d54-4b52-86a1-2ab5715f2c94 tempest-VolumesTestJSON-1756675815 None] Acquiring lock "cinder-5c83a41e-ae87-4f1d-a5a8-e1291d16e7b3-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:34:05 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3857a7dc-0d54-4b52-86a1-2ab5715f2c94 tempest-VolumesTestJSON-1756675815 None] Lock "cinder-5c83a41e-ae87-4f1d-a5a8-e1291d16e7b3-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:34:05 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3857a7dc-0d54-4b52-86a1-2ab5715f2c94 tempest-VolumesTestJSON-1756675815 None] Acquiring lock "cinder-quobyte-5c83a41e-ae87-4f1d-a5a8-e1291d16e7b3" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:34:05 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3857a7dc-0d54-4b52-86a1-2ab5715f2c94 tempest-VolumesTestJSON-1756675815 None] Lock "cinder-quobyte-5c83a41e-ae87-4f1d-a5a8-e1291d16e7b3" acquired by "delete_volume" :: waited 0.036s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:34:05 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[47313c4d-0668-47b5-9246-0f92c9dd7dc8]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:34:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3857a7dc-0d54-4b52-86a1-2ab5715f2c94 tempest-VolumesTestJSON-1756675815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5c83a41e-ae87-4f1d-a5a8-e1291d16e7b3 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:06 devstack sudo[91323]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-070740a9-c5c5-4016-be85-09365ce79490 tempest-VolumesTestJSON-1756675815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.817s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:06 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-070740a9-c5c5-4016-be85-09365ce79490 tempest-VolumesTestJSON-1756675815 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:34:06 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-070740a9-c5c5-4016-be85-09365ce79490 tempest-VolumesTestJSON-1756675815 None] Deleted volume successfully. Jul 08 01:34:06 devstack sudo[91333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5c83a41e-ae87-4f1d-a5a8-e1291d16e7b3 Jul 08 01:34:06 devstack sudo[91333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:06 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-070740a9-c5c5-4016-be85-09365ce79490 tempest-VolumesTestJSON-1756675815 None] Lock "cinder-d5286c56-4fad-486d-99fa-014479397156-delete_volume" released by "delete_volume" :: held 2.634s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:34:06 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-6230d49b-9936-4de1-8431-ad4e5605f867 tempest-AttachVolumeTestJSON-1425049151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:34:06 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6230d49b-9936-4de1-8431-ad4e5605f867 tempest-AttachVolumeTestJSON-1425049151 None] Flow 'volume_create_manager' (39a3c113-3fcc-49c2-95a0-d4f9070bcb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:34:06 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6230d49b-9936-4de1-8431-ad4e5605f867 tempest-AttachVolumeTestJSON-1425049151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97c39291-6a4d-4af6-9c90-4b37d48e27ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:06 devstack sudo[91328]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3b24d5b7-50da-4dd5-a217-ca67ce32db13 tempest-GroupSnapshotsTest-313287482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810" returned: 0 in 1.015s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3b24d5b7-50da-4dd5-a217-ca67ce32db13 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810.fe0a9ef2-efbd-4577-bd17-f3b3a6136ee9 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:06 devstack sudo[91339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810.fe0a9ef2-efbd-4577-bd17-f3b3a6136ee9 1G Jul 08 01:34:06 devstack sudo[91339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:06 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6230d49b-9936-4de1-8431-ad4e5605f867 tempest-AttachVolumeTestJSON-1425049151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97c39291-6a4d-4af6-9c90-4b37d48e27ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1055150716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68b3c324-a6de-4211-8f85-4bc60c11bbe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edad54f26b864ce99af045441a7ccb6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:34:06Z,use_quota=True,user_id='7eab7814fdd44227a113508d610b1fd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:06 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6230d49b-9936-4de1-8431-ad4e5605f867 tempest-AttachVolumeTestJSON-1425049151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d9da1c9-0e95-402b-a37d-d9a386f584ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:06 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6230d49b-9936-4de1-8431-ad4e5605f867 tempest-AttachVolumeTestJSON-1425049151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d9da1c9-0e95-402b-a37d-d9a386f584ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:06 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6230d49b-9936-4de1-8431-ad4e5605f867 tempest-AttachVolumeTestJSON-1425049151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1add9d91-b417-45d8-b396-78e5c8dee82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:06 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6230d49b-9936-4de1-8431-ad4e5605f867 tempest-AttachVolumeTestJSON-1425049151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1add9d91-b417-45d8-b396-78e5c8dee82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68b3c324-a6de-4211-8f85-4bc60c11bbe6', 'volume_name': 'volume-68b3c324-a6de-4211-8f85-4bc60c11bbe6', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:06 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6230d49b-9936-4de1-8431-ad4e5605f867 tempest-AttachVolumeTestJSON-1425049151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (401c327b-7a8d-4bab-9bbe-cc997da11ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:06 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6230d49b-9936-4de1-8431-ad4e5605f867 tempest-AttachVolumeTestJSON-1425049151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (401c327b-7a8d-4bab-9bbe-cc997da11ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:06 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6230d49b-9936-4de1-8431-ad4e5605f867 tempest-AttachVolumeTestJSON-1425049151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d066f95-4305-47f7-80cb-10556fa006eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:06 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-6230d49b-9936-4de1-8431-ad4e5605f867 tempest-AttachVolumeTestJSON-1425049151 None] Volume 68b3c324-a6de-4211-8f85-4bc60c11bbe6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68b3c324-a6de-4211-8f85-4bc60c11bbe6', 'volume_size': 1} Jul 08 01:34:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6230d49b-9936-4de1-8431-ad4e5605f867 tempest-AttachVolumeTestJSON-1425049151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:34:06 devstack sudo[91333]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3857a7dc-0d54-4b52-86a1-2ab5715f2c94 tempest-VolumesTestJSON-1756675815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5c83a41e-ae87-4f1d-a5a8-e1291d16e7b3" returned: 0 in 1.056s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3857a7dc-0d54-4b52-86a1-2ab5715f2c94 tempest-VolumesTestJSON-1756675815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5c83a41e-ae87-4f1d-a5a8-e1291d16e7b3 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:07 devstack sudo[91347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5c83a41e-ae87-4f1d-a5a8-e1291d16e7b3 Jul 08 01:34:07 devstack sudo[91347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:07 devstack sudo[91339]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3b24d5b7-50da-4dd5-a217-ca67ce32db13 tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810.fe0a9ef2-efbd-4577-bd17-f3b3a6136ee9 1G" returned: 0 in 0.910s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3b24d5b7-50da-4dd5-a217-ca67ce32db13 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fd195a6-ac27-47e8-862f-17e7d3569810 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810.fe0a9ef2-efbd-4577-bd17-f3b3a6136ee9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:07 devstack sudo[91352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fd195a6-ac27-47e8-862f-17e7d3569810 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810.fe0a9ef2-efbd-4577-bd17-f3b3a6136ee9 Jul 08 01:34:07 devstack sudo[91352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:07 devstack sudo[91347]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3857a7dc-0d54-4b52-86a1-2ab5715f2c94 tempest-VolumesTestJSON-1756675815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5c83a41e-ae87-4f1d-a5a8-e1291d16e7b3" returned: 0 in 0.671s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:07 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3857a7dc-0d54-4b52-86a1-2ab5715f2c94 tempest-VolumesTestJSON-1756675815 None] Lock "cinder-quobyte-5c83a41e-ae87-4f1d-a5a8-e1291d16e7b3" released by "delete_volume" :: held 1.795s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:34:07 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-3857a7dc-0d54-4b52-86a1-2ab5715f2c94 tempest-VolumesTestJSON-1756675815 None] Created reservations ['ddc57fd4-962d-4265-bf04-49b744bc5e17', '2986646e-8f0c-4b01-9f84-67d1a8775553', 'd4bfaca5-9734-4eac-9acd-6b85308115c8', '5864090c-9d00-4d1e-bf68-ddfa11cf3ad4'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:34:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3857a7dc-0d54-4b52-86a1-2ab5715f2c94 tempest-VolumesTestJSON-1756675815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:34:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3857a7dc-0d54-4b52-86a1-2ab5715f2c94 tempest-VolumesTestJSON-1756675815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:34:07 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3857a7dc-0d54-4b52-86a1-2ab5715f2c94 tempest-VolumesTestJSON-1756675815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:34:07 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3857a7dc-0d54-4b52-86a1-2ab5715f2c94 tempest-VolumesTestJSON-1756675815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:34:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3857a7dc-0d54-4b52-86a1-2ab5715f2c94 tempest-VolumesTestJSON-1756675815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:34:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3857a7dc-0d54-4b52-86a1-2ab5715f2c94 tempest-VolumesTestJSON-1756675815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:07 devstack sudo[91355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:34:07 devstack sudo[91355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:08 devstack sudo[91352]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3b24d5b7-50da-4dd5-a217-ca67ce32db13 tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fd195a6-ac27-47e8-862f-17e7d3569810 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810.fe0a9ef2-efbd-4577-bd17-f3b3a6136ee9" returned: 0 in 0.829s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:08 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-3b24d5b7-50da-4dd5-a217-ca67ce32db13 tempest-GroupSnapshotsTest-313287482 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810.fe0a9ef2-efbd-4577-bd17-f3b3a6136ee9 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:34:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3b24d5b7-50da-4dd5-a217-ca67ce32db13 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810.fe0a9ef2-efbd-4577-bd17-f3b3a6136ee9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:08 devstack sudo[91360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810.fe0a9ef2-efbd-4577-bd17-f3b3a6136ee9 Jul 08 01:34:08 devstack sudo[91360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:08 devstack sudo[91355]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3857a7dc-0d54-4b52-86a1-2ab5715f2c94 tempest-VolumesTestJSON-1756675815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.737s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:08 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-3857a7dc-0d54-4b52-86a1-2ab5715f2c94 tempest-VolumesTestJSON-1756675815 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:34:08 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-3857a7dc-0d54-4b52-86a1-2ab5715f2c94 tempest-VolumesTestJSON-1756675815 None] Deleted volume successfully. Jul 08 01:34:08 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3857a7dc-0d54-4b52-86a1-2ab5715f2c94 tempest-VolumesTestJSON-1756675815 None] Lock "cinder-5c83a41e-ae87-4f1d-a5a8-e1291d16e7b3-delete_volume" released by "delete_volume" :: held 2.795s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:34:08 devstack sudo[91360]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3b24d5b7-50da-4dd5-a217-ca67ce32db13 tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810.fe0a9ef2-efbd-4577-bd17-f3b3a6136ee9" returned: 0 in 0.769s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3b24d5b7-50da-4dd5-a217-ca67ce32db13 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:09 devstack sudo[91372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810.info Jul 08 01:34:09 devstack sudo[91372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:09 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-b98a8568-78e5-4f7b-b54d-631ac802c98d req-20488b4d-eeb6-435e-91d7-21738dd7f0ae tempest-ServerActionsTestOtherA-84188968 None] Terminate volume connection completed successfully. Jul 08 01:34:09 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-b98a8568-78e5-4f7b-b54d-631ac802c98d req-20488b4d-eeb6-435e-91d7-21738dd7f0ae tempest-ServerActionsTestOtherA-84188968 None] Deleting attachment d8bd89be-5e49-4316-8993-46fdeeaf22ec. {{(pid=87284) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:34:09 devstack sudo[91372]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3b24d5b7-50da-4dd5-a217-ca67ce32db13 tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810.info" returned: 0 in 0.852s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:09 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-3b24d5b7-50da-4dd5-a217-ca67ce32db13 tempest-GroupSnapshotsTest-313287482 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:34:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3b24d5b7-50da-4dd5-a217-ca67ce32db13 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:09 devstack sudo[91401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810.info Jul 08 01:34:09 devstack sudo[91401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:10 devstack sudo[91401]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3b24d5b7-50da-4dd5-a217-ca67ce32db13 tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810.info" returned: 0 in 0.952s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3b24d5b7-50da-4dd5-a217-ca67ce32db13 tempest-GroupSnapshotsTest-313287482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.434s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:34:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6230d49b-9936-4de1-8431-ad4e5605f867 tempest-AttachVolumeTestJSON-1425049151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.286s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:34:10 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-6230d49b-9936-4de1-8431-ad4e5605f867 tempest-AttachVolumeTestJSON-1425049151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1055150716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68b3c324-a6de-4211-8f85-4bc60c11bbe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edad54f26b864ce99af045441a7ccb6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:34:06Z,use_quota=True,user_id='7eab7814fdd44227a113508d610b1fd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:34:10 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-6230d49b-9936-4de1-8431-ad4e5605f867 tempest-AttachVolumeTestJSON-1425049151 None] Creating volume 68b3c324-a6de-4211-8f85-4bc60c11bbe6 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:34:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6230d49b-9936-4de1-8431-ad4e5605f867 tempest-AttachVolumeTestJSON-1425049151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:34:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6230d49b-9936-4de1-8431-ad4e5605f867 tempest-AttachVolumeTestJSON-1425049151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:34:10 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-6230d49b-9936-4de1-8431-ad4e5605f867 tempest-AttachVolumeTestJSON-1425049151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:34:10 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-6230d49b-9936-4de1-8431-ad4e5605f867 tempest-AttachVolumeTestJSON-1425049151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:34:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6230d49b-9936-4de1-8431-ad4e5605f867 tempest-AttachVolumeTestJSON-1425049151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:34:10 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-6230d49b-9936-4de1-8431-ad4e5605f867 tempest-AttachVolumeTestJSON-1425049151 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:34:10 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-6230d49b-9936-4de1-8431-ad4e5605f867 tempest-AttachVolumeTestJSON-1425049151 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:34:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6230d49b-9936-4de1-8431-ad4e5605f867 tempest-AttachVolumeTestJSON-1425049151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68b3c324-a6de-4211-8f85-4bc60c11bbe6 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:10 devstack sudo[91423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68b3c324-a6de-4211-8f85-4bc60c11bbe6 1073741824 Jul 08 01:34:10 devstack sudo[91423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:11 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-3b24d5b7-50da-4dd5-a217-ca67ce32db13 tempest-GroupSnapshotsTest-313287482 None] group_snapshot e5304453-f3ea-4cdd-840f-ff06fc9ed2a7: created successfully Jul 08 01:34:11 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-ebc4723e-ee9b-428e-a239-dd55cfa13c07 tempest-GroupSnapshotsTest-313287482 None] group_snapshot e5304453-f3ea-4cdd-840f-ff06fc9ed2a7: deleting Jul 08 01:34:11 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ebc4723e-ee9b-428e-a239-dd55cfa13c07 tempest-GroupSnapshotsTest-313287482 None] group_snapshot e5304453-f3ea-4cdd-840f-ff06fc9ed2a7: deleting {{(pid=87284) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 01:34:11 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ebc4723e-ee9b-428e-a239-dd55cfa13c07 tempest-GroupSnapshotsTest-313287482 None] Acquiring lock "cinder-quobyte-ef2469b2-50bd-4124-930c-75a1207542af" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:34:11 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ebc4723e-ee9b-428e-a239-dd55cfa13c07 tempest-GroupSnapshotsTest-313287482 None] Lock "cinder-quobyte-ef2469b2-50bd-4124-930c-75a1207542af" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:34:11 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ebc4723e-ee9b-428e-a239-dd55cfa13c07 tempest-GroupSnapshotsTest-313287482 None] Acquiring lock "cinder-quobyte-4e48a5f0-0b87-40ea-90a6-5f8f3f0defba" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:34:11 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ebc4723e-ee9b-428e-a239-dd55cfa13c07 tempest-GroupSnapshotsTest-313287482 None] Lock "cinder-quobyte-4e48a5f0-0b87-40ea-90a6-5f8f3f0defba" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:34:11 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-ebc4723e-ee9b-428e-a239-dd55cfa13c07 tempest-GroupSnapshotsTest-313287482 None] Deleting offline snapshot 4e48a5f0-0b87-40ea-90a6-5f8f3f0defba of volume ef2469b2-50bd-4124-930c-75a1207542af {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:34:11 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-ebc4723e-ee9b-428e-a239-dd55cfa13c07 tempest-GroupSnapshotsTest-313287482 None] snapshot_file for this snap is: volume-ef2469b2-50bd-4124-930c-75a1207542af.4e48a5f0-0b87-40ea-90a6-5f8f3f0defba {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:34:11 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[41286f44-ff12-48c1-93a4-7a60d4ea61b5]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:34:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ebc4723e-ee9b-428e-a239-dd55cfa13c07 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af.4e48a5f0-0b87-40ea-90a6-5f8f3f0defba {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:11 devstack sudo[91433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af.4e48a5f0-0b87-40ea-90a6-5f8f3f0defba Jul 08 01:34:11 devstack sudo[91433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-b98a8568-78e5-4f7b-b54d-631ac802c98d req-1db78529-90e4-4521-af1f-50ec1017d4fb tempest-ServerActionsTestOtherA-84188968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:34:12 devstack sudo[91423]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6230d49b-9936-4de1-8431-ad4e5605f867 tempest-AttachVolumeTestJSON-1425049151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68b3c324-a6de-4211-8f85-4bc60c11bbe6 1073741824" returned: 0 in 1.257s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6230d49b-9936-4de1-8431-ad4e5605f867 tempest-AttachVolumeTestJSON-1425049151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68b3c324-a6de-4211-8f85-4bc60c11bbe6 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:12 devstack sudo[91440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68b3c324-a6de-4211-8f85-4bc60c11bbe6 Jul 08 01:34:12 devstack sudo[91440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:12 devstack sudo[91433]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ebc4723e-ee9b-428e-a239-dd55cfa13c07 tempest-GroupSnapshotsTest-313287482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af.4e48a5f0-0b87-40ea-90a6-5f8f3f0defba" returned: 0 in 0.951s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:12 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-ebc4723e-ee9b-428e-a239-dd55cfa13c07 tempest-GroupSnapshotsTest-313287482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef2469b2-50bd-4124-930c-75a1207542af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:34:12 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a505f7-e78b-47cb-8c94-783c16d00f46]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:34:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ebc4723e-ee9b-428e-a239-dd55cfa13c07 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:12 devstack sudo[91445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af Jul 08 01:34:12 devstack sudo[91445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:12 devstack sudo[91440]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6230d49b-9936-4de1-8431-ad4e5605f867 tempest-AttachVolumeTestJSON-1425049151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68b3c324-a6de-4211-8f85-4bc60c11bbe6" returned: 0 in 0.711s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:12 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-6230d49b-9936-4de1-8431-ad4e5605f867 tempest-AttachVolumeTestJSON-1425049151 None] <== create_volume: return (2025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:34:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6230d49b-9936-4de1-8431-ad4e5605f867 tempest-AttachVolumeTestJSON-1425049151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.029s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:34:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-b98a8568-78e5-4f7b-b54d-631ac802c98d req-1db78529-90e4-4521-af1f-50ec1017d4fb tempest-ServerActionsTestOtherA-84188968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.099s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:34:12 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6230d49b-9936-4de1-8431-ad4e5605f867 tempest-AttachVolumeTestJSON-1425049151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d066f95-4305-47f7-80cb-10556fa006eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68b3c324-a6de-4211-8f85-4bc60c11bbe6', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:12 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6230d49b-9936-4de1-8431-ad4e5605f867 tempest-AttachVolumeTestJSON-1425049151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db5a2236-160c-49cf-a7e6-38ba6d50fbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:12 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[4289c3d9-09c5-421b-8a82-e7a138b17714]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:34:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-b98a8568-78e5-4f7b-b54d-631ac802c98d req-1db78529-90e4-4521-af1f-50ec1017d4fb tempest-ServerActionsTestOtherA-84188968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3322ae6d-a22f-4ba5-8937-23a1c1066cb7 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:12 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-6230d49b-9936-4de1-8431-ad4e5605f867 tempest-AttachVolumeTestJSON-1425049151 None] Volume volume-68b3c324-a6de-4211-8f85-4bc60c11bbe6 (68b3c324-a6de-4211-8f85-4bc60c11bbe6): created successfully Jul 08 01:34:12 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6230d49b-9936-4de1-8431-ad4e5605f867 tempest-AttachVolumeTestJSON-1425049151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db5a2236-160c-49cf-a7e6-38ba6d50fbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:12 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6230d49b-9936-4de1-8431-ad4e5605f867 tempest-AttachVolumeTestJSON-1425049151 None] Flow 'volume_create_manager' (39a3c113-3fcc-49c2-95a0-d4f9070bcb06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:34:12 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-6230d49b-9936-4de1-8431-ad4e5605f867 tempest-AttachVolumeTestJSON-1425049151 None] Created volume successfully. Jul 08 01:34:13 devstack sudo[91448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3322ae6d-a22f-4ba5-8937-23a1c1066cb7 Jul 08 01:34:13 devstack sudo[91448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:13 devstack sudo[91445]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ebc4723e-ee9b-428e-a239-dd55cfa13c07 tempest-GroupSnapshotsTest-313287482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af" returned: 0 in 0.823s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ebc4723e-ee9b-428e-a239-dd55cfa13c07 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af.4e48a5f0-0b87-40ea-90a6-5f8f3f0defba {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:13 devstack sudo[91453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af.4e48a5f0-0b87-40ea-90a6-5f8f3f0defba Jul 08 01:34:13 devstack sudo[91453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:13 devstack sudo[91448]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-b98a8568-78e5-4f7b-b54d-631ac802c98d req-1db78529-90e4-4521-af1f-50ec1017d4fb tempest-ServerActionsTestOtherA-84188968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3322ae6d-a22f-4ba5-8937-23a1c1066cb7" returned: 0 in 0.854s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-b98a8568-78e5-4f7b-b54d-631ac802c98d req-1db78529-90e4-4521-af1f-50ec1017d4fb tempest-ServerActionsTestOtherA-84188968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.894s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:34:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-b98a8568-78e5-4f7b-b54d-631ac802c98d req-1db78529-90e4-4521-af1f-50ec1017d4fb tempest-ServerActionsTestOtherA-84188968 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96', 'name': 'volume-3322ae6d-a22f-4ba5-8937-23a1c1066cb7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3e5340ae-f168-4e2f-8940-e7bdfe5266c6', 'enforce_multipath': True} {{(pid=87284) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:34:13 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-b98a8568-78e5-4f7b-b54d-631ac802c98d req-1db78529-90e4-4521-af1f-50ec1017d4fb tempest-ServerActionsTestOtherA-84188968 None] attachment_update completed successfully. Jul 08 01:34:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d7172e53-c281-4fe5-a251-5bf8b51e5376 tempest-BackendsCapabilitiesAdminTestsJSON-1074990609 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6908683776855, 'free_capacity_gb': 1775.6908683776855, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87284) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 01:34:14 devstack sudo[91453]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ebc4723e-ee9b-428e-a239-dd55cfa13c07 tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af.4e48a5f0-0b87-40ea-90a6-5f8f3f0defba" returned: 0 in 0.782s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ebc4723e-ee9b-428e-a239-dd55cfa13c07 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af.4e48a5f0-0b87-40ea-90a6-5f8f3f0defba {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:14 devstack sudo[91465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af.4e48a5f0-0b87-40ea-90a6-5f8f3f0defba Jul 08 01:34:14 devstack sudo[91465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:14 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8506da11-e395-4d18-a1db-654f9c510943 tempest-BackendsCapabilitiesAdminTestsJSON-1074990609 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6908683776855, 'free_capacity_gb': 1775.6908683776855, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87284) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 01:34:14 devstack sudo[91465]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ebc4723e-ee9b-428e-a239-dd55cfa13c07 tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af.4e48a5f0-0b87-40ea-90a6-5f8f3f0defba" returned: 0 in 0.650s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:14 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ebc4723e-ee9b-428e-a239-dd55cfa13c07 tempest-GroupSnapshotsTest-313287482 None] Lock "cinder-quobyte-4e48a5f0-0b87-40ea-90a6-5f8f3f0defba" released by "_delete_snapshot" :: held 3.359s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:34:14 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ebc4723e-ee9b-428e-a239-dd55cfa13c07 tempest-GroupSnapshotsTest-313287482 None] Lock "cinder-quobyte-ef2469b2-50bd-4124-930c-75a1207542af" released by "delete_snapshot" :: held 3.397s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:34:14 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ebc4723e-ee9b-428e-a239-dd55cfa13c07 tempest-GroupSnapshotsTest-313287482 None] Acquiring lock "cinder-quobyte-1fd195a6-ac27-47e8-862f-17e7d3569810" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:34:14 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ebc4723e-ee9b-428e-a239-dd55cfa13c07 tempest-GroupSnapshotsTest-313287482 None] Lock "cinder-quobyte-1fd195a6-ac27-47e8-862f-17e7d3569810" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:34:14 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ebc4723e-ee9b-428e-a239-dd55cfa13c07 tempest-GroupSnapshotsTest-313287482 None] Acquiring lock "cinder-quobyte-fe0a9ef2-efbd-4577-bd17-f3b3a6136ee9" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:34:14 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ebc4723e-ee9b-428e-a239-dd55cfa13c07 tempest-GroupSnapshotsTest-313287482 None] Lock "cinder-quobyte-fe0a9ef2-efbd-4577-bd17-f3b3a6136ee9" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:34:14 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-ebc4723e-ee9b-428e-a239-dd55cfa13c07 tempest-GroupSnapshotsTest-313287482 None] Deleting offline snapshot fe0a9ef2-efbd-4577-bd17-f3b3a6136ee9 of volume 1fd195a6-ac27-47e8-862f-17e7d3569810 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:34:14 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-ebc4723e-ee9b-428e-a239-dd55cfa13c07 tempest-GroupSnapshotsTest-313287482 None] snapshot_file for this snap is: volume-1fd195a6-ac27-47e8-862f-17e7d3569810.fe0a9ef2-efbd-4577-bd17-f3b3a6136ee9 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:34:14 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[6611dc35-4335-45ee-8992-f45b8a109d58]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:34:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ebc4723e-ee9b-428e-a239-dd55cfa13c07 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810.fe0a9ef2-efbd-4577-bd17-f3b3a6136ee9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:15 devstack sudo[91469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810.fe0a9ef2-efbd-4577-bd17-f3b3a6136ee9 Jul 08 01:34:15 devstack sudo[91469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:15 devstack sudo[91469]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ebc4723e-ee9b-428e-a239-dd55cfa13c07 tempest-GroupSnapshotsTest-313287482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810.fe0a9ef2-efbd-4577-bd17-f3b3a6136ee9" returned: 0 in 0.834s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:15 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-ebc4723e-ee9b-428e-a239-dd55cfa13c07 tempest-GroupSnapshotsTest-313287482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fd195a6-ac27-47e8-862f-17e7d3569810(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:34:15 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[cacbe124-a323-42d1-906a-8eff5f6ccc39]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:34:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ebc4723e-ee9b-428e-a239-dd55cfa13c07 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:15 devstack sudo[91474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810 Jul 08 01:34:15 devstack sudo[91474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:16 devstack sudo[91474]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ebc4723e-ee9b-428e-a239-dd55cfa13c07 tempest-GroupSnapshotsTest-313287482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810" returned: 0 in 1.142s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ebc4723e-ee9b-428e-a239-dd55cfa13c07 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810.fe0a9ef2-efbd-4577-bd17-f3b3a6136ee9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:16 devstack sudo[91505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810.fe0a9ef2-efbd-4577-bd17-f3b3a6136ee9 Jul 08 01:34:16 devstack sudo[91505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-10e17a9f-417f-4adf-b7c2-d72cf3147e47 req-fa6a5c56-2fbe-494c-a264-2e7657837fc1 tempest-AttachVolumeTestJSON-1425049151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:34:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-10e17a9f-417f-4adf-b7c2-d72cf3147e47 req-fa6a5c56-2fbe-494c-a264-2e7657837fc1 tempest-AttachVolumeTestJSON-1425049151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:34:17 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca03f6a-9410-433f-be0c-ab29de25d5de]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:34:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-10e17a9f-417f-4adf-b7c2-d72cf3147e47 req-fa6a5c56-2fbe-494c-a264-2e7657837fc1 tempest-AttachVolumeTestJSON-1425049151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68b3c324-a6de-4211-8f85-4bc60c11bbe6 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:17 devstack sudo[91507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68b3c324-a6de-4211-8f85-4bc60c11bbe6 Jul 08 01:34:17 devstack sudo[91507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:18 devstack sudo[91505]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ebc4723e-ee9b-428e-a239-dd55cfa13c07 tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810.fe0a9ef2-efbd-4577-bd17-f3b3a6136ee9" returned: 0 in 1.066s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ebc4723e-ee9b-428e-a239-dd55cfa13c07 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810.fe0a9ef2-efbd-4577-bd17-f3b3a6136ee9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:18 devstack sudo[91583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810.fe0a9ef2-efbd-4577-bd17-f3b3a6136ee9 Jul 08 01:34:18 devstack sudo[91583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:18 devstack sudo[91507]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-10e17a9f-417f-4adf-b7c2-d72cf3147e47 req-fa6a5c56-2fbe-494c-a264-2e7657837fc1 tempest-AttachVolumeTestJSON-1425049151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68b3c324-a6de-4211-8f85-4bc60c11bbe6" returned: 0 in 1.114s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-10e17a9f-417f-4adf-b7c2-d72cf3147e47 req-fa6a5c56-2fbe-494c-a264-2e7657837fc1 tempest-AttachVolumeTestJSON-1425049151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.138s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:34:18 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:UPDATE=84,cinder:SELECT=91,cinder:INSERT=16,cinder:DELETE=7 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:34:18 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-10e17a9f-417f-4adf-b7c2-d72cf3147e47 req-fa6a5c56-2fbe-494c-a264-2e7657837fc1 tempest-AttachVolumeTestJSON-1425049151 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96', 'name': 'volume-68b3c324-a6de-4211-8f85-4bc60c11bbe6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ca10dce3-9848-4c75-b274-9262b6fa35f1', 'enforce_multipath': True} {{(pid=87284) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:34:18 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-10e17a9f-417f-4adf-b7c2-d72cf3147e47 req-fa6a5c56-2fbe-494c-a264-2e7657837fc1 tempest-AttachVolumeTestJSON-1425049151 None] attachment_update completed successfully. Jul 08 01:34:19 devstack sudo[91583]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ebc4723e-ee9b-428e-a239-dd55cfa13c07 tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810.fe0a9ef2-efbd-4577-bd17-f3b3a6136ee9" returned: 0 in 1.052s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:19 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ebc4723e-ee9b-428e-a239-dd55cfa13c07 tempest-GroupSnapshotsTest-313287482 None] Lock "cinder-quobyte-fe0a9ef2-efbd-4577-bd17-f3b3a6136ee9" released by "_delete_snapshot" :: held 4.211s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:34:19 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ebc4723e-ee9b-428e-a239-dd55cfa13c07 tempest-GroupSnapshotsTest-313287482 None] Lock "cinder-quobyte-1fd195a6-ac27-47e8-862f-17e7d3569810" released by "delete_snapshot" :: held 4.245s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:34:19 devstack cinder-volume[87284]: WARNING cinder.quota [None req-ebc4723e-ee9b-428e-a239-dd55cfa13c07 tempest-GroupSnapshotsTest-313287482 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1114232137 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1114232137, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:34:19 devstack cinder-volume[87284]: WARNING cinder.quota [None req-ebc4723e-ee9b-428e-a239-dd55cfa13c07 tempest-GroupSnapshotsTest-313287482 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1114232137 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1114232137, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:34:19 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-ebc4723e-ee9b-428e-a239-dd55cfa13c07 tempest-GroupSnapshotsTest-313287482 None] Created reservations ['2b10635a-fc40-4fde-acef-e64223aad5b6', '970e3737-2797-4826-ba40-42f108b696dd', 'c94940d9-965f-4d62-ae0d-f361b2a22ea4', '444383d5-98b9-474f-b144-635c468dff11'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:34:19 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-ebc4723e-ee9b-428e-a239-dd55cfa13c07 tempest-GroupSnapshotsTest-313287482 None] Created reservations ['e178c611-758f-40b1-91be-e4a4b4caffc5', '33c6f0f3-6abd-40d6-aa37-630ec8b0e43e', '95208a65-ade1-4553-9263-81d199a25741', 'daf6c0ef-131a-4a13-9617-4e1af004b1b2'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:34:19 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-ebc4723e-ee9b-428e-a239-dd55cfa13c07 tempest-GroupSnapshotsTest-313287482 None] group_snapshot e5304453-f3ea-4cdd-840f-ff06fc9ed2a7: deleted successfully Jul 08 01:34:20 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2b2cf0b3-388d-4ead-ba8f-58f2a22928d6 tempest-GroupSnapshotsTest-313287482 None] Acquiring lock "cinder-quobyte-1fd195a6-ac27-47e8-862f-17e7d3569810" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:34:20 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2b2cf0b3-388d-4ead-ba8f-58f2a22928d6 tempest-GroupSnapshotsTest-313287482 None] Lock "cinder-quobyte-1fd195a6-ac27-47e8-862f-17e7d3569810" acquired by "delete_volume" :: waited 0.020s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:34:20 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[c477a1b6-7db8-4038-9df0-c1443774bd1a]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:34:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2b2cf0b3-388d-4ead-ba8f-58f2a22928d6 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:20 devstack sudo[91938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810 Jul 08 01:34:20 devstack sudo[91938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:21 devstack sudo[91938]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2b2cf0b3-388d-4ead-ba8f-58f2a22928d6 tempest-GroupSnapshotsTest-313287482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810" returned: 0 in 0.999s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2b2cf0b3-388d-4ead-ba8f-58f2a22928d6 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:21 devstack sudo[91948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810 Jul 08 01:34:21 devstack sudo[91948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:22 devstack sudo[91948]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2b2cf0b3-388d-4ead-ba8f-58f2a22928d6 tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fd195a6-ac27-47e8-862f-17e7d3569810" returned: 0 in 1.032s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:22 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2b2cf0b3-388d-4ead-ba8f-58f2a22928d6 tempest-GroupSnapshotsTest-313287482 None] Lock "cinder-quobyte-1fd195a6-ac27-47e8-862f-17e7d3569810" released by "delete_volume" :: held 2.124s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:34:22 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2b2cf0b3-388d-4ead-ba8f-58f2a22928d6 tempest-GroupSnapshotsTest-313287482 None] Acquiring lock "cinder-quobyte-ef2469b2-50bd-4124-930c-75a1207542af" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:34:22 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2b2cf0b3-388d-4ead-ba8f-58f2a22928d6 tempest-GroupSnapshotsTest-313287482 None] Lock "cinder-quobyte-ef2469b2-50bd-4124-930c-75a1207542af" acquired by "delete_volume" :: waited 0.020s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:34:22 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf1d03e-0f92-4b08-9a8c-bb86c5488b70]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:34:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2b2cf0b3-388d-4ead-ba8f-58f2a22928d6 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:22 devstack sudo[91953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af Jul 08 01:34:22 devstack sudo[91953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:23 devstack sudo[91953]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2b2cf0b3-388d-4ead-ba8f-58f2a22928d6 tempest-GroupSnapshotsTest-313287482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af" returned: 0 in 1.008s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2b2cf0b3-388d-4ead-ba8f-58f2a22928d6 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:23 devstack sudo[91973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af Jul 08 01:34:23 devstack sudo[91973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:24 devstack sudo[91973]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2b2cf0b3-388d-4ead-ba8f-58f2a22928d6 tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ef2469b2-50bd-4124-930c-75a1207542af" returned: 0 in 1.377s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:24 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2b2cf0b3-388d-4ead-ba8f-58f2a22928d6 tempest-GroupSnapshotsTest-313287482 None] Lock "cinder-quobyte-ef2469b2-50bd-4124-930c-75a1207542af" released by "delete_volume" :: held 2.514s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:34:24 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-2b2cf0b3-388d-4ead-ba8f-58f2a22928d6 tempest-GroupSnapshotsTest-313287482 None] Created reservations ['66727334-b1c3-41b9-ba62-b95d1c796bcc'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:34:25 devstack cinder-volume[87284]: WARNING cinder.quota [None req-2b2cf0b3-388d-4ead-ba8f-58f2a22928d6 tempest-GroupSnapshotsTest-313287482 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1114232137 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1114232137, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:34:25 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-2b2cf0b3-388d-4ead-ba8f-58f2a22928d6 tempest-GroupSnapshotsTest-313287482 None] Created reservations ['088dace0-4032-45d6-a276-b330c3ab9e27', '22703b3b-8d19-40bc-8f6c-dfa223ffe83f', '0dc0471e-a61f-4888-90c2-5b645d1a6d06', 'afa82a96-237b-4cf9-9562-4670484b0943'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:34:25 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-2b2cf0b3-388d-4ead-ba8f-58f2a22928d6 tempest-GroupSnapshotsTest-313287482 None] Created reservations ['715f0688-1e0e-4fa2-a0e5-fb9cb9675284', '86273d8d-b472-48cc-bdde-e5a35bb7dc5c', 'faceac85-86f4-425a-ae00-6a44571f210c', '9a8ddc8f-6439-488d-9a00-2b3c83f52bd7'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:34:25 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:UPDATE=106,cinder:SELECT=112,cinder:INSERT=27,cinder:DELETE=2 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:34:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2b2cf0b3-388d-4ead-ba8f-58f2a22928d6 tempest-GroupSnapshotsTest-313287482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:34:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2b2cf0b3-388d-4ead-ba8f-58f2a22928d6 tempest-GroupSnapshotsTest-313287482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:34:25 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2b2cf0b3-388d-4ead-ba8f-58f2a22928d6 tempest-GroupSnapshotsTest-313287482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:34:25 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2b2cf0b3-388d-4ead-ba8f-58f2a22928d6 tempest-GroupSnapshotsTest-313287482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:34:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2b2cf0b3-388d-4ead-ba8f-58f2a22928d6 tempest-GroupSnapshotsTest-313287482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:34:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2b2cf0b3-388d-4ead-ba8f-58f2a22928d6 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:25 devstack sudo[92006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:34:25 devstack sudo[92006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:26 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-a79434b9-5648-494f-8e5a-5c0d8bc0b4f1 tempest-GroupSnapshotsTest-313287482 None] Group tempest-GroupSnapshotsTest-Group-2132129889: creating Jul 08 01:34:26 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-a79434b9-5648-494f-8e5a-5c0d8bc0b4f1 tempest-GroupSnapshotsTest-313287482 None] Group tempest-GroupSnapshotsTest-Group-2132129889: created successfully Jul 08 01:34:26 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-a79434b9-5648-494f-8e5a-5c0d8bc0b4f1 tempest-GroupSnapshotsTest-313287482 None] Create group completed successfully. Jul 08 01:34:26 devstack sudo[92006]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2b2cf0b3-388d-4ead-ba8f-58f2a22928d6 tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.372s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:26 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-2b2cf0b3-388d-4ead-ba8f-58f2a22928d6 tempest-GroupSnapshotsTest-313287482 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:34:26 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-2b2cf0b3-388d-4ead-ba8f-58f2a22928d6 tempest-GroupSnapshotsTest-313287482 None] Delete group completed successfully. Jul 08 01:34:28 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6918443-76a9-4a45-84da-25ecb5645c99 tempest-GroupSnapshotsTest-313287482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:34:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e6918443-76a9-4a45-84da-25ecb5645c99 tempest-GroupSnapshotsTest-313287482 None] Flow 'volume_create_manager' (0016b85e-1061-4a48-878e-0d2c1fd89b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:34:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e6918443-76a9-4a45-84da-25ecb5645c99 tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f0eb4f1-56ac-4dc7-a9dc-72d91c6a8d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e6918443-76a9-4a45-84da-25ecb5645c99 tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f0eb4f1-56ac-4dc7-a9dc-72d91c6a8d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1055858301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cff28e23-5de9-40d3-abb9-ab5e0c88b1e3,host='devstack@QuobyteHD#QuobyteHD',id=40fda050-34c4-48eb-933e-3a6b759b07e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7f7103321442c28889b646c417250e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:34:28Z,use_quota=True,user_id='e38df0a12e4041979038905b265e56c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36fb400-3bb0-4632-89ed-8351a08b9d90),volume_type_id=d36fb400-3bb0-4632-89ed-8351a08b9d90)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e6918443-76a9-4a45-84da-25ecb5645c99 tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eca08d64-85f8-4d84-bf50-d0f6ad11f571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e6918443-76a9-4a45-84da-25ecb5645c99 tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eca08d64-85f8-4d84-bf50-d0f6ad11f571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e6918443-76a9-4a45-84da-25ecb5645c99 tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e5700f-2666-4146-8b67-b2a551e6da6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e6918443-76a9-4a45-84da-25ecb5645c99 tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e5700f-2666-4146-8b67-b2a551e6da6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40fda050-34c4-48eb-933e-3a6b759b07e8', 'volume_name': 'volume-40fda050-34c4-48eb-933e-3a6b759b07e8', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e6918443-76a9-4a45-84da-25ecb5645c99 tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (259aee64-9d02-4640-8148-8b47045586d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e6918443-76a9-4a45-84da-25ecb5645c99 tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (259aee64-9d02-4640-8148-8b47045586d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e6918443-76a9-4a45-84da-25ecb5645c99 tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff9b3115-b473-424c-a5f9-41c0cf8e0ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:28 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-e6918443-76a9-4a45-84da-25ecb5645c99 tempest-GroupSnapshotsTest-313287482 None] Volume 40fda050-34c4-48eb-933e-3a6b759b07e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40fda050-34c4-48eb-933e-3a6b759b07e8', 'volume_size': 1} Jul 08 01:34:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e6918443-76a9-4a45-84da-25ecb5645c99 tempest-GroupSnapshotsTest-313287482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:34:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e6918443-76a9-4a45-84da-25ecb5645c99 tempest-GroupSnapshotsTest-313287482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:34:28 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e6918443-76a9-4a45-84da-25ecb5645c99 tempest-GroupSnapshotsTest-313287482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cff28e23-5de9-40d3-abb9-ab5e0c88b1e3,created_at=2026-07-07T23:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1055858301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cff28e23-5de9-40d3-abb9-ab5e0c88b1e3,host='devstack@QuobyteHD#QuobyteHD',id=40fda050-34c4-48eb-933e-3a6b759b07e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7f7103321442c28889b646c417250e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:34:28Z,use_quota=True,user_id='e38df0a12e4041979038905b265e56c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36fb400-3bb0-4632-89ed-8351a08b9d90),volume_type_id=d36fb400-3bb0-4632-89ed-8351a08b9d90)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:34:28 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-e6918443-76a9-4a45-84da-25ecb5645c99 tempest-GroupSnapshotsTest-313287482 None] Creating volume 40fda050-34c4-48eb-933e-3a6b759b07e8 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:34:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e6918443-76a9-4a45-84da-25ecb5645c99 tempest-GroupSnapshotsTest-313287482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:34:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e6918443-76a9-4a45-84da-25ecb5645c99 tempest-GroupSnapshotsTest-313287482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:34:28 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e6918443-76a9-4a45-84da-25ecb5645c99 tempest-GroupSnapshotsTest-313287482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:34:28 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e6918443-76a9-4a45-84da-25ecb5645c99 tempest-GroupSnapshotsTest-313287482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:34:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e6918443-76a9-4a45-84da-25ecb5645c99 tempest-GroupSnapshotsTest-313287482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:34:28 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e6918443-76a9-4a45-84da-25ecb5645c99 tempest-GroupSnapshotsTest-313287482 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:34:28 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-e6918443-76a9-4a45-84da-25ecb5645c99 tempest-GroupSnapshotsTest-313287482 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:34:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e6918443-76a9-4a45-84da-25ecb5645c99 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:28 devstack sudo[92015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8 1073741824 Jul 08 01:34:28 devstack sudo[92015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:29 devstack sudo[92015]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e6918443-76a9-4a45-84da-25ecb5645c99 tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8 1073741824" returned: 0 in 1.246s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e6918443-76a9-4a45-84da-25ecb5645c99 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:30 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-c874f8eb-39a9-4018-b0fa-8b11ba2437ad tempest-GroupsTest-480743010 None] Group tempest-Group1-1426292299: creating Jul 08 01:34:30 devstack sudo[92022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8 Jul 08 01:34:30 devstack sudo[92022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:30 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-c874f8eb-39a9-4018-b0fa-8b11ba2437ad tempest-GroupsTest-480743010 None] Group tempest-Group1-1426292299: created successfully Jul 08 01:34:30 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-c874f8eb-39a9-4018-b0fa-8b11ba2437ad tempest-GroupsTest-480743010 None] Create group completed successfully. Jul 08 01:34:30 devstack sudo[92022]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e6918443-76a9-4a45-84da-25ecb5645c99 tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8" returned: 0 in 0.801s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:30 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e6918443-76a9-4a45-84da-25ecb5645c99 tempest-GroupSnapshotsTest-313287482 None] <== create_volume: return (2128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:34:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e6918443-76a9-4a45-84da-25ecb5645c99 tempest-GroupSnapshotsTest-313287482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.131s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:34:30 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e6918443-76a9-4a45-84da-25ecb5645c99 tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff9b3115-b473-424c-a5f9-41c0cf8e0ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40fda050-34c4-48eb-933e-3a6b759b07e8', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:30 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e6918443-76a9-4a45-84da-25ecb5645c99 tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ba1ca6a-d471-4525-a770-1144135d24fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:30 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-e6918443-76a9-4a45-84da-25ecb5645c99 tempest-GroupSnapshotsTest-313287482 None] Volume volume-40fda050-34c4-48eb-933e-3a6b759b07e8 (40fda050-34c4-48eb-933e-3a6b759b07e8): created successfully Jul 08 01:34:30 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e6918443-76a9-4a45-84da-25ecb5645c99 tempest-GroupSnapshotsTest-313287482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ba1ca6a-d471-4525-a770-1144135d24fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:30 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e6918443-76a9-4a45-84da-25ecb5645c99 tempest-GroupSnapshotsTest-313287482 None] Flow 'volume_create_manager' (0016b85e-1061-4a48-878e-0d2c1fd89b57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:34:30 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-e6918443-76a9-4a45-84da-25ecb5645c99 tempest-GroupSnapshotsTest-313287482 None] Created volume successfully. Jul 08 01:34:31 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-a8a9bde2-b80c-4ec8-84f3-33900229645d tempest-GroupsTest-480743010 None] Group tempest-Group2-824537630: creating Jul 08 01:34:31 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-a8a9bde2-b80c-4ec8-84f3-33900229645d tempest-GroupsTest-480743010 None] Group tempest-Group2-824537630: created successfully Jul 08 01:34:31 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-a8a9bde2-b80c-4ec8-84f3-33900229645d tempest-GroupsTest-480743010 None] Create group completed successfully. Jul 08 01:34:32 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-d1ba2472-ebef-4fb5-a760-62b252c102af tempest-GroupSnapshotsTest-313287482 None] GroupSnapshot d16ef96b-d92e-4f95-970e-3cc545557846: creating. Jul 08 01:34:32 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d1ba2472-ebef-4fb5-a760-62b252c102af tempest-GroupSnapshotsTest-313287482 None] Group snapshot d16ef96b-d92e-4f95-970e-3cc545557846: creating. {{(pid=87284) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 01:34:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-d1ba2472-ebef-4fb5-a760-62b252c102af tempest-GroupSnapshotsTest-313287482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:34:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-d1ba2472-ebef-4fb5-a760-62b252c102af tempest-GroupSnapshotsTest-313287482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:34:32 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-d1ba2472-ebef-4fb5-a760-62b252c102af tempest-GroupSnapshotsTest-313287482 None] Creating offline snapshot fd52f8e1-f4f0-4c4d-a968-3d0509006bc6 of volume 40fda050-34c4-48eb-933e-3a6b759b07e8 {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:34:32 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c45226c-d5be-4f8a-8910-d92f7b6b95e5]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:34:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d1ba2472-ebef-4fb5-a760-62b252c102af tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:32 devstack sudo[92026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8 Jul 08 01:34:32 devstack sudo[92026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:33 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc778931-71c5-4d32-9fc0-b434376d876e tempest-GroupsTest-480743010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:34:33 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc778931-71c5-4d32-9fc0-b434376d876e tempest-GroupsTest-480743010 None] Flow 'volume_create_manager' (7c4f6cee-6fd3-4622-8aac-1f04f9bbe112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:34:33 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc778931-71c5-4d32-9fc0-b434376d876e tempest-GroupsTest-480743010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (379aafa1-d8ce-4f2d-aa4c-698f61645d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:33 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc778931-71c5-4d32-9fc0-b434376d876e tempest-GroupsTest-480743010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (379aafa1-d8ce-4f2d-aa4c-698f61645d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-192312282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=639445e5-1242-42bf-9a25-3d447d66f11c,host='devstack@QuobyteHD#QuobyteHD',id=2dababc5-e20a-4117-9c2a-606c5c36866c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ed3845c3b124357bd321f0e63223f8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:34:33Z,use_quota=True,user_id='20fa058a2cfc4f529799176832f543fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4ae9350-54a3-426f-82ad-f8285143780c),volume_type_id=a4ae9350-54a3-426f-82ad-f8285143780c)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:33 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc778931-71c5-4d32-9fc0-b434376d876e tempest-GroupsTest-480743010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc72e7a4-2691-4da9-a78f-67d27f9ca412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:33 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc778931-71c5-4d32-9fc0-b434376d876e tempest-GroupsTest-480743010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc72e7a4-2691-4da9-a78f-67d27f9ca412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:33 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc778931-71c5-4d32-9fc0-b434376d876e tempest-GroupsTest-480743010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ea4ad5f-7f07-4eb3-af68-8df75fac18bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:33 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc778931-71c5-4d32-9fc0-b434376d876e tempest-GroupsTest-480743010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ea4ad5f-7f07-4eb3-af68-8df75fac18bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dababc5-e20a-4117-9c2a-606c5c36866c', 'volume_name': 'volume-2dababc5-e20a-4117-9c2a-606c5c36866c', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:33 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc778931-71c5-4d32-9fc0-b434376d876e tempest-GroupsTest-480743010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6f2e6eb-d9c7-4c52-af84-cfb0e21188c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:33 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc778931-71c5-4d32-9fc0-b434376d876e tempest-GroupsTest-480743010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6f2e6eb-d9c7-4c52-af84-cfb0e21188c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:33 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc778931-71c5-4d32-9fc0-b434376d876e tempest-GroupsTest-480743010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07b17bdf-4096-4a4f-a25d-a75268c3a5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:33 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-cc778931-71c5-4d32-9fc0-b434376d876e tempest-GroupsTest-480743010 None] Volume 2dababc5-e20a-4117-9c2a-606c5c36866c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dababc5-e20a-4117-9c2a-606c5c36866c', 'volume_size': 1} Jul 08 01:34:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-cc778931-71c5-4d32-9fc0-b434376d876e tempest-GroupsTest-480743010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:34:33 devstack sudo[92026]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d1ba2472-ebef-4fb5-a760-62b252c102af tempest-GroupSnapshotsTest-313287482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8" returned: 0 in 1.119s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d1ba2472-ebef-4fb5-a760-62b252c102af tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8.fd52f8e1-f4f0-4c4d-a968-3d0509006bc6 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:33 devstack sudo[92047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8.fd52f8e1-f4f0-4c4d-a968-3d0509006bc6 1G Jul 08 01:34:33 devstack sudo[92047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:34 devstack sudo[92047]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d1ba2472-ebef-4fb5-a760-62b252c102af tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8.fd52f8e1-f4f0-4c4d-a968-3d0509006bc6 1G" returned: 0 in 1.204s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d1ba2472-ebef-4fb5-a760-62b252c102af tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40fda050-34c4-48eb-933e-3a6b759b07e8 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8.fd52f8e1-f4f0-4c4d-a968-3d0509006bc6 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:34 devstack sudo[92085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40fda050-34c4-48eb-933e-3a6b759b07e8 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8.fd52f8e1-f4f0-4c4d-a968-3d0509006bc6 Jul 08 01:34:34 devstack sudo[92085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:35 devstack sudo[92085]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d1ba2472-ebef-4fb5-a760-62b252c102af tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40fda050-34c4-48eb-933e-3a6b759b07e8 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8.fd52f8e1-f4f0-4c4d-a968-3d0509006bc6" returned: 0 in 0.890s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:35 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-d1ba2472-ebef-4fb5-a760-62b252c102af tempest-GroupSnapshotsTest-313287482 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8.fd52f8e1-f4f0-4c4d-a968-3d0509006bc6 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:34:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d1ba2472-ebef-4fb5-a760-62b252c102af tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8.fd52f8e1-f4f0-4c4d-a968-3d0509006bc6 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:35 devstack sudo[92110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8.fd52f8e1-f4f0-4c4d-a968-3d0509006bc6 Jul 08 01:34:35 devstack sudo[92110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:36 devstack sudo[92110]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d1ba2472-ebef-4fb5-a760-62b252c102af tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8.fd52f8e1-f4f0-4c4d-a968-3d0509006bc6" returned: 0 in 0.776s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d1ba2472-ebef-4fb5-a760-62b252c102af tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:36 devstack sudo[92122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8.info Jul 08 01:34:36 devstack sudo[92122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:37 devstack sudo[92122]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d1ba2472-ebef-4fb5-a760-62b252c102af tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8.info" returned: 0 in 1.028s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:37 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-d1ba2472-ebef-4fb5-a760-62b252c102af tempest-GroupSnapshotsTest-313287482 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:34:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d1ba2472-ebef-4fb5-a760-62b252c102af tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:37 devstack sudo[92203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8.info Jul 08 01:34:37 devstack sudo[92203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:38 devstack sudo[92203]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d1ba2472-ebef-4fb5-a760-62b252c102af tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8.info" returned: 0 in 0.866s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-d1ba2472-ebef-4fb5-a760-62b252c102af tempest-GroupSnapshotsTest-313287482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.013s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:34:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-cc778931-71c5-4d32-9fc0-b434376d876e tempest-GroupsTest-480743010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.185s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:34:38 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-cc778931-71c5-4d32-9fc0-b434376d876e tempest-GroupsTest-480743010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=639445e5-1242-42bf-9a25-3d447d66f11c,created_at=2026-07-07T23:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-192312282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=639445e5-1242-42bf-9a25-3d447d66f11c,host='devstack@QuobyteHD#QuobyteHD',id=2dababc5-e20a-4117-9c2a-606c5c36866c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ed3845c3b124357bd321f0e63223f8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:34:33Z,use_quota=True,user_id='20fa058a2cfc4f529799176832f543fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4ae9350-54a3-426f-82ad-f8285143780c),volume_type_id=a4ae9350-54a3-426f-82ad-f8285143780c)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:34:38 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-cc778931-71c5-4d32-9fc0-b434376d876e tempest-GroupsTest-480743010 None] Creating volume 2dababc5-e20a-4117-9c2a-606c5c36866c {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:34:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-cc778931-71c5-4d32-9fc0-b434376d876e tempest-GroupsTest-480743010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:34:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-cc778931-71c5-4d32-9fc0-b434376d876e tempest-GroupsTest-480743010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:34:38 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-cc778931-71c5-4d32-9fc0-b434376d876e tempest-GroupsTest-480743010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:34:38 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-cc778931-71c5-4d32-9fc0-b434376d876e tempest-GroupsTest-480743010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:34:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-cc778931-71c5-4d32-9fc0-b434376d876e tempest-GroupsTest-480743010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:34:38 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-cc778931-71c5-4d32-9fc0-b434376d876e tempest-GroupsTest-480743010 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:34:38 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-cc778931-71c5-4d32-9fc0-b434376d876e tempest-GroupsTest-480743010 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:34:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc778931-71c5-4d32-9fc0-b434376d876e tempest-GroupsTest-480743010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2dababc5-e20a-4117-9c2a-606c5c36866c 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:38 devstack sudo[92218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2dababc5-e20a-4117-9c2a-606c5c36866c 1073741824 Jul 08 01:34:38 devstack sudo[92218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:38 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-d1ba2472-ebef-4fb5-a760-62b252c102af tempest-GroupSnapshotsTest-313287482 None] group_snapshot d16ef96b-d92e-4f95-970e-3cc545557846: created successfully Jul 08 01:34:39 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-1d2f7230-44e6-4b4a-a6b1-f4104dd23c1b tempest-GroupSnapshotsTest-313287482 None] group_snapshot d16ef96b-d92e-4f95-970e-3cc545557846: deleting Jul 08 01:34:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1d2f7230-44e6-4b4a-a6b1-f4104dd23c1b tempest-GroupSnapshotsTest-313287482 None] group_snapshot d16ef96b-d92e-4f95-970e-3cc545557846: deleting {{(pid=87284) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 01:34:39 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1d2f7230-44e6-4b4a-a6b1-f4104dd23c1b tempest-GroupSnapshotsTest-313287482 None] Acquiring lock "cinder-quobyte-40fda050-34c4-48eb-933e-3a6b759b07e8" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:34:39 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1d2f7230-44e6-4b4a-a6b1-f4104dd23c1b tempest-GroupSnapshotsTest-313287482 None] Lock "cinder-quobyte-40fda050-34c4-48eb-933e-3a6b759b07e8" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:34:39 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1d2f7230-44e6-4b4a-a6b1-f4104dd23c1b tempest-GroupSnapshotsTest-313287482 None] Acquiring lock "cinder-quobyte-fd52f8e1-f4f0-4c4d-a968-3d0509006bc6" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:34:39 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1d2f7230-44e6-4b4a-a6b1-f4104dd23c1b tempest-GroupSnapshotsTest-313287482 None] Lock "cinder-quobyte-fd52f8e1-f4f0-4c4d-a968-3d0509006bc6" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:34:39 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-1d2f7230-44e6-4b4a-a6b1-f4104dd23c1b tempest-GroupSnapshotsTest-313287482 None] Deleting offline snapshot fd52f8e1-f4f0-4c4d-a968-3d0509006bc6 of volume 40fda050-34c4-48eb-933e-3a6b759b07e8 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:34:39 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-1d2f7230-44e6-4b4a-a6b1-f4104dd23c1b tempest-GroupSnapshotsTest-313287482 None] snapshot_file for this snap is: volume-40fda050-34c4-48eb-933e-3a6b759b07e8.fd52f8e1-f4f0-4c4d-a968-3d0509006bc6 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:34:39 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[665b14bd-411b-4bf9-bf4b-19d4bd7def45]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:34:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1d2f7230-44e6-4b4a-a6b1-f4104dd23c1b tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8.fd52f8e1-f4f0-4c4d-a968-3d0509006bc6 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:39 devstack sudo[92225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8.fd52f8e1-f4f0-4c4d-a968-3d0509006bc6 Jul 08 01:34:39 devstack sudo[92225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:39 devstack sudo[92218]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc778931-71c5-4d32-9fc0-b434376d876e tempest-GroupsTest-480743010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2dababc5-e20a-4117-9c2a-606c5c36866c 1073741824" returned: 0 in 1.138s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc778931-71c5-4d32-9fc0-b434376d876e tempest-GroupsTest-480743010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2dababc5-e20a-4117-9c2a-606c5c36866c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:39 devstack sudo[92228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2dababc5-e20a-4117-9c2a-606c5c36866c Jul 08 01:34:39 devstack sudo[92228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:40 devstack sudo[92225]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1d2f7230-44e6-4b4a-a6b1-f4104dd23c1b tempest-GroupSnapshotsTest-313287482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8.fd52f8e1-f4f0-4c4d-a968-3d0509006bc6" returned: 0 in 1.212s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:40 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-1d2f7230-44e6-4b4a-a6b1-f4104dd23c1b tempest-GroupSnapshotsTest-313287482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40fda050-34c4-48eb-933e-3a6b759b07e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:34:40 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d69132-6380-4270-a336-1945e0249299]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:34:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1d2f7230-44e6-4b4a-a6b1-f4104dd23c1b tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:40 devstack sudo[92228]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc778931-71c5-4d32-9fc0-b434376d876e tempest-GroupsTest-480743010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2dababc5-e20a-4117-9c2a-606c5c36866c" returned: 0 in 1.058s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:40 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-cc778931-71c5-4d32-9fc0-b434376d876e tempest-GroupsTest-480743010 None] <== create_volume: return (2255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:34:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-cc778931-71c5-4d32-9fc0-b434376d876e tempest-GroupsTest-480743010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.265s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:34:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc778931-71c5-4d32-9fc0-b434376d876e tempest-GroupsTest-480743010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07b17bdf-4096-4a4f-a25d-a75268c3a5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dababc5-e20a-4117-9c2a-606c5c36866c', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc778931-71c5-4d32-9fc0-b434376d876e tempest-GroupsTest-480743010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (742c3d04-e197-4ad3-be4f-2a853d5aaab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:40 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-cc778931-71c5-4d32-9fc0-b434376d876e tempest-GroupsTest-480743010 None] Volume volume-2dababc5-e20a-4117-9c2a-606c5c36866c (2dababc5-e20a-4117-9c2a-606c5c36866c): created successfully Jul 08 01:34:40 devstack sudo[92235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8 Jul 08 01:34:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc778931-71c5-4d32-9fc0-b434376d876e tempest-GroupsTest-480743010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (742c3d04-e197-4ad3-be4f-2a853d5aaab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:40 devstack sudo[92235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc778931-71c5-4d32-9fc0-b434376d876e tempest-GroupsTest-480743010 None] Flow 'volume_create_manager' (7c4f6cee-6fd3-4622-8aac-1f04f9bbe112) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:34:40 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-cc778931-71c5-4d32-9fc0-b434376d876e tempest-GroupsTest-480743010 None] Created volume successfully. Jul 08 01:34:41 devstack sudo[92235]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1d2f7230-44e6-4b4a-a6b1-f4104dd23c1b tempest-GroupSnapshotsTest-313287482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8" returned: 0 in 1.078s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1d2f7230-44e6-4b4a-a6b1-f4104dd23c1b tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8.fd52f8e1-f4f0-4c4d-a968-3d0509006bc6 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:41 devstack sudo[92240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8.fd52f8e1-f4f0-4c4d-a968-3d0509006bc6 Jul 08 01:34:41 devstack sudo[92240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:42 devstack sudo[92240]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1d2f7230-44e6-4b4a-a6b1-f4104dd23c1b tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8.fd52f8e1-f4f0-4c4d-a968-3d0509006bc6" returned: 0 in 0.865s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1d2f7230-44e6-4b4a-a6b1-f4104dd23c1b tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8.fd52f8e1-f4f0-4c4d-a968-3d0509006bc6 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:42 devstack sudo[92246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8.fd52f8e1-f4f0-4c4d-a968-3d0509006bc6 Jul 08 01:34:42 devstack sudo[92246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:42 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ab0cad01-4a35-4951-b6c3-58c53db5700d tempest-GroupsTest-480743010 None] Acquiring lock "cinder-quobyte-2dababc5-e20a-4117-9c2a-606c5c36866c" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:34:42 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ab0cad01-4a35-4951-b6c3-58c53db5700d tempest-GroupsTest-480743010 None] Lock "cinder-quobyte-2dababc5-e20a-4117-9c2a-606c5c36866c" acquired by "delete_volume" :: waited 0.034s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:34:42 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c953e1f-97b4-408b-87bd-254615f926b5]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:34:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ab0cad01-4a35-4951-b6c3-58c53db5700d tempest-GroupsTest-480743010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2dababc5-e20a-4117-9c2a-606c5c36866c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:42 devstack sudo[92248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2dababc5-e20a-4117-9c2a-606c5c36866c Jul 08 01:34:42 devstack sudo[92248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:43 devstack sudo[92246]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1d2f7230-44e6-4b4a-a6b1-f4104dd23c1b tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8.fd52f8e1-f4f0-4c4d-a968-3d0509006bc6" returned: 0 in 0.841s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:43 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1d2f7230-44e6-4b4a-a6b1-f4104dd23c1b tempest-GroupSnapshotsTest-313287482 None] Lock "cinder-quobyte-fd52f8e1-f4f0-4c4d-a968-3d0509006bc6" released by "_delete_snapshot" :: held 4.212s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:34:43 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1d2f7230-44e6-4b4a-a6b1-f4104dd23c1b tempest-GroupSnapshotsTest-313287482 None] Lock "cinder-quobyte-40fda050-34c4-48eb-933e-3a6b759b07e8" released by "delete_snapshot" :: held 4.261s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:34:43 devstack cinder-volume[87284]: WARNING cinder.quota [None req-1d2f7230-44e6-4b4a-a6b1-f4104dd23c1b tempest-GroupSnapshotsTest-313287482 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-146161080 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-146161080, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:34:43 devstack cinder-volume[87284]: WARNING cinder.quota [None req-1d2f7230-44e6-4b4a-a6b1-f4104dd23c1b tempest-GroupSnapshotsTest-313287482 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-146161080 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-146161080, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:34:43 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-1d2f7230-44e6-4b4a-a6b1-f4104dd23c1b tempest-GroupSnapshotsTest-313287482 None] Created reservations ['8e92a93d-b062-4a18-9023-391670f5bc54', 'cf0d1a78-2c1e-4fbe-9c4e-711e102bde51', 'f5c621cb-a74a-4955-9af9-c2d1dc532f9d', '9688d48c-34e3-477e-9fc5-872b77dd14d0'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:34:43 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-1d2f7230-44e6-4b4a-a6b1-f4104dd23c1b tempest-GroupSnapshotsTest-313287482 None] group_snapshot d16ef96b-d92e-4f95-970e-3cc545557846: deleted successfully Jul 08 01:34:43 devstack sudo[92248]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ab0cad01-4a35-4951-b6c3-58c53db5700d tempest-GroupsTest-480743010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2dababc5-e20a-4117-9c2a-606c5c36866c" returned: 0 in 0.966s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ab0cad01-4a35-4951-b6c3-58c53db5700d tempest-GroupsTest-480743010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2dababc5-e20a-4117-9c2a-606c5c36866c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:43 devstack sudo[92255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2dababc5-e20a-4117-9c2a-606c5c36866c Jul 08 01:34:43 devstack sudo[92255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:44 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-29ce30c3-466e-4920-a64a-ca48e3cd9f48 tempest-GroupSnapshotsTest-313287482 None] Acquiring lock "cinder-quobyte-40fda050-34c4-48eb-933e-3a6b759b07e8" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:34:44 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-29ce30c3-466e-4920-a64a-ca48e3cd9f48 tempest-GroupSnapshotsTest-313287482 None] Lock "cinder-quobyte-40fda050-34c4-48eb-933e-3a6b759b07e8" acquired by "delete_volume" :: waited 0.026s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:34:44 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5fd21e-6051-414f-80b2-0af7fde63e5e]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:34:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-29ce30c3-466e-4920-a64a-ca48e3cd9f48 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:44 devstack sudo[92257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8 Jul 08 01:34:44 devstack sudo[92257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:44 devstack sudo[92255]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ab0cad01-4a35-4951-b6c3-58c53db5700d tempest-GroupsTest-480743010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2dababc5-e20a-4117-9c2a-606c5c36866c" returned: 0 in 0.811s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:44 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ab0cad01-4a35-4951-b6c3-58c53db5700d tempest-GroupsTest-480743010 None] Lock "cinder-quobyte-2dababc5-e20a-4117-9c2a-606c5c36866c" released by "delete_volume" :: held 1.836s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:34:44 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-ab0cad01-4a35-4951-b6c3-58c53db5700d tempest-GroupsTest-480743010 None] Created reservations ['29e5af8d-ac80-4d8e-94ad-3e359c2df292'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:34:44 devstack cinder-volume[87284]: WARNING cinder.quota [None req-ab0cad01-4a35-4951-b6c3-58c53db5700d tempest-GroupsTest-480743010 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1492303800 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1492303800, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:34:44 devstack cinder-volume[87284]: WARNING cinder.quota [None req-ab0cad01-4a35-4951-b6c3-58c53db5700d tempest-GroupsTest-480743010 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1492303800 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1492303800, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:34:44 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-ab0cad01-4a35-4951-b6c3-58c53db5700d tempest-GroupsTest-480743010 None] Created reservations ['bdbc1e13-e39a-4591-9068-c3861c2a5e8e', '8277cd0c-4307-4b2e-86d7-2b269c4a429f', '6945b3d7-d0c0-43b3-a4b1-4ed50c39f608', 'b0939367-26b1-423b-9976-a5ef8ab78256'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:34:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ab0cad01-4a35-4951-b6c3-58c53db5700d tempest-GroupsTest-480743010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:34:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ab0cad01-4a35-4951-b6c3-58c53db5700d tempest-GroupsTest-480743010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:34:44 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-ab0cad01-4a35-4951-b6c3-58c53db5700d tempest-GroupsTest-480743010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:34:44 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-ab0cad01-4a35-4951-b6c3-58c53db5700d tempest-GroupsTest-480743010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:34:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ab0cad01-4a35-4951-b6c3-58c53db5700d tempest-GroupsTest-480743010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:34:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ab0cad01-4a35-4951-b6c3-58c53db5700d tempest-GroupsTest-480743010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:44 devstack sudo[92265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:34:44 devstack sudo[92265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:45 devstack sudo[92257]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-29ce30c3-466e-4920-a64a-ca48e3cd9f48 tempest-GroupSnapshotsTest-313287482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8" returned: 0 in 1.062s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-29ce30c3-466e-4920-a64a-ca48e3cd9f48 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:45 devstack sudo[92269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8 Jul 08 01:34:45 devstack sudo[92269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:45 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-64db5431-07b3-44ee-b019-cdefc2bfe62d tempest-GroupsTest-480743010 None] Created reservations ['ab964868-1c19-4475-8d53-96a91599eac9'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:34:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-64db5431-07b3-44ee-b019-cdefc2bfe62d tempest-GroupsTest-480743010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:34:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-64db5431-07b3-44ee-b019-cdefc2bfe62d tempest-GroupsTest-480743010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:34:45 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-64db5431-07b3-44ee-b019-cdefc2bfe62d tempest-GroupsTest-480743010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:34:45 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-64db5431-07b3-44ee-b019-cdefc2bfe62d tempest-GroupsTest-480743010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:34:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-64db5431-07b3-44ee-b019-cdefc2bfe62d tempest-GroupsTest-480743010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:34:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-64db5431-07b3-44ee-b019-cdefc2bfe62d tempest-GroupsTest-480743010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:45 devstack sudo[92271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:34:45 devstack sudo[92271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:46 devstack sudo[92265]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ab0cad01-4a35-4951-b6c3-58c53db5700d tempest-GroupsTest-480743010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.123s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:46 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-ab0cad01-4a35-4951-b6c3-58c53db5700d tempest-GroupsTest-480743010 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:34:46 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-ab0cad01-4a35-4951-b6c3-58c53db5700d tempest-GroupsTest-480743010 None] Delete group completed successfully. Jul 08 01:34:46 devstack sudo[92269]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-29ce30c3-466e-4920-a64a-ca48e3cd9f48 tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-40fda050-34c4-48eb-933e-3a6b759b07e8" returned: 0 in 1.142s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:46 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-29ce30c3-466e-4920-a64a-ca48e3cd9f48 tempest-GroupSnapshotsTest-313287482 None] Lock "cinder-quobyte-40fda050-34c4-48eb-933e-3a6b759b07e8" released by "delete_volume" :: held 2.273s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:34:46 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-29ce30c3-466e-4920-a64a-ca48e3cd9f48 tempest-GroupSnapshotsTest-313287482 None] Created reservations ['abdcf531-3c44-4444-9800-2650ca4c8eed'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:34:46 devstack cinder-volume[87284]: WARNING cinder.quota [None req-29ce30c3-466e-4920-a64a-ca48e3cd9f48 tempest-GroupSnapshotsTest-313287482 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-146161080 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-146161080, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:34:46 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-29ce30c3-466e-4920-a64a-ca48e3cd9f48 tempest-GroupSnapshotsTest-313287482 None] Created reservations ['4466e509-440e-46e1-aef1-cf7a49198035', 'f5a83638-8997-48d0-81b0-8e9f11861079', '143cead8-0c9f-4640-9e2e-e6ff08dc9df5', '11593009-2b2a-4319-946d-992bbc31fb05'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:34:46 devstack sudo[92271]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-64db5431-07b3-44ee-b019-cdefc2bfe62d tempest-GroupsTest-480743010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.972s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:46 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-64db5431-07b3-44ee-b019-cdefc2bfe62d tempest-GroupsTest-480743010 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:34:46 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-64db5431-07b3-44ee-b019-cdefc2bfe62d tempest-GroupsTest-480743010 None] Delete group completed successfully. Jul 08 01:34:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-29ce30c3-466e-4920-a64a-ca48e3cd9f48 tempest-GroupSnapshotsTest-313287482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:34:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-29ce30c3-466e-4920-a64a-ca48e3cd9f48 tempest-GroupSnapshotsTest-313287482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:34:46 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-29ce30c3-466e-4920-a64a-ca48e3cd9f48 tempest-GroupSnapshotsTest-313287482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:34:46 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-29ce30c3-466e-4920-a64a-ca48e3cd9f48 tempest-GroupSnapshotsTest-313287482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:34:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-29ce30c3-466e-4920-a64a-ca48e3cd9f48 tempest-GroupSnapshotsTest-313287482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:34:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-29ce30c3-466e-4920-a64a-ca48e3cd9f48 tempest-GroupSnapshotsTest-313287482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:46 devstack sudo[92277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:34:46 devstack sudo[92277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:47 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-966b4c16-b090-4860-9a24-938e38b806fe tempest-GroupsTest-480743010 None] Group tempest-GroupsTest-Group-1510658560: creating Jul 08 01:34:47 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-966b4c16-b090-4860-9a24-938e38b806fe tempest-GroupsTest-480743010 None] Group tempest-GroupsTest-Group-1510658560: created successfully Jul 08 01:34:47 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-966b4c16-b090-4860-9a24-938e38b806fe tempest-GroupsTest-480743010 None] Create group completed successfully. Jul 08 01:34:47 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-81c59a46-29ef-4b34-b5f5-37524a7cbdf5 req-c41963a8-72a2-422b-970e-dce3ca23bd06 tempest-ServerActionsTestOtherA-84188968 None] Terminate volume connection completed successfully. Jul 08 01:34:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-81c59a46-29ef-4b34-b5f5-37524a7cbdf5 req-c41963a8-72a2-422b-970e-dce3ca23bd06 tempest-ServerActionsTestOtherA-84188968 None] Deleting attachment 3e5340ae-f168-4e2f-8940-e7bdfe5266c6. {{(pid=87284) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:34:47 devstack sudo[92277]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-29ce30c3-466e-4920-a64a-ca48e3cd9f48 tempest-GroupSnapshotsTest-313287482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.186s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:47 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-29ce30c3-466e-4920-a64a-ca48e3cd9f48 tempest-GroupSnapshotsTest-313287482 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:34:47 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-29ce30c3-466e-4920-a64a-ca48e3cd9f48 tempest-GroupSnapshotsTest-313287482 None] Delete group completed successfully. Jul 08 01:34:49 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8018abd-d8d7-4c75-9e30-afbecb1d0595 tempest-GroupsTest-480743010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:34:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b8018abd-d8d7-4c75-9e30-afbecb1d0595 tempest-GroupsTest-480743010 None] Flow 'volume_create_manager' (a3ec6cf1-7886-4cd1-ac15-496f82808d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:34:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b8018abd-d8d7-4c75-9e30-afbecb1d0595 tempest-GroupsTest-480743010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1441b9b-71fc-4e26-96d1-2c0fcbbdb31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b8018abd-d8d7-4c75-9e30-afbecb1d0595 tempest-GroupsTest-480743010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1441b9b-71fc-4e26-96d1-2c0fcbbdb31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1118486115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cace2f76-4174-4861-aea1-8c4b5efa3df6,host='devstack@QuobyteHD#QuobyteHD',id=f4a2965e-5a8a-4509-8a4d-dcb471b11d82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ed3845c3b124357bd321f0e63223f8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:34:50Z,use_quota=True,user_id='20fa058a2cfc4f529799176832f543fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0491a14c-ab8a-4fbf-b435-b2b1f7a6afab),volume_type_id=0491a14c-ab8a-4fbf-b435-b2b1f7a6afab)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b8018abd-d8d7-4c75-9e30-afbecb1d0595 tempest-GroupsTest-480743010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f37898de-3f35-4e16-8465-b7572ce91f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b8018abd-d8d7-4c75-9e30-afbecb1d0595 tempest-GroupsTest-480743010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f37898de-3f35-4e16-8465-b7572ce91f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b8018abd-d8d7-4c75-9e30-afbecb1d0595 tempest-GroupsTest-480743010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4767c998-a048-41fa-a17d-f8fc22c01568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b8018abd-d8d7-4c75-9e30-afbecb1d0595 tempest-GroupsTest-480743010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4767c998-a048-41fa-a17d-f8fc22c01568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4a2965e-5a8a-4509-8a4d-dcb471b11d82', 'volume_name': 'volume-f4a2965e-5a8a-4509-8a4d-dcb471b11d82', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b8018abd-d8d7-4c75-9e30-afbecb1d0595 tempest-GroupsTest-480743010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (367424d5-5006-4640-b07b-83adf77e000b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b8018abd-d8d7-4c75-9e30-afbecb1d0595 tempest-GroupsTest-480743010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (367424d5-5006-4640-b07b-83adf77e000b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b8018abd-d8d7-4c75-9e30-afbecb1d0595 tempest-GroupsTest-480743010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82e39b96-b1b7-4166-9117-0ccb906cc088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:49 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-b8018abd-d8d7-4c75-9e30-afbecb1d0595 tempest-GroupsTest-480743010 None] Volume f4a2965e-5a8a-4509-8a4d-dcb471b11d82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4a2965e-5a8a-4509-8a4d-dcb471b11d82', 'volume_size': 1} Jul 08 01:34:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b8018abd-d8d7-4c75-9e30-afbecb1d0595 tempest-GroupsTest-480743010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:34:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b8018abd-d8d7-4c75-9e30-afbecb1d0595 tempest-GroupsTest-480743010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:34:49 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b8018abd-d8d7-4c75-9e30-afbecb1d0595 tempest-GroupsTest-480743010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cace2f76-4174-4861-aea1-8c4b5efa3df6,created_at=2026-07-07T23:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1118486115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cace2f76-4174-4861-aea1-8c4b5efa3df6,host='devstack@QuobyteHD#QuobyteHD',id=f4a2965e-5a8a-4509-8a4d-dcb471b11d82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ed3845c3b124357bd321f0e63223f8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:34:50Z,use_quota=True,user_id='20fa058a2cfc4f529799176832f543fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0491a14c-ab8a-4fbf-b435-b2b1f7a6afab),volume_type_id=0491a14c-ab8a-4fbf-b435-b2b1f7a6afab)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:34:49 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-b8018abd-d8d7-4c75-9e30-afbecb1d0595 tempest-GroupsTest-480743010 None] Creating volume f4a2965e-5a8a-4509-8a4d-dcb471b11d82 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:34:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b8018abd-d8d7-4c75-9e30-afbecb1d0595 tempest-GroupsTest-480743010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:34:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b8018abd-d8d7-4c75-9e30-afbecb1d0595 tempest-GroupsTest-480743010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:34:49 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b8018abd-d8d7-4c75-9e30-afbecb1d0595 tempest-GroupsTest-480743010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:34:49 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b8018abd-d8d7-4c75-9e30-afbecb1d0595 tempest-GroupsTest-480743010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:34:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b8018abd-d8d7-4c75-9e30-afbecb1d0595 tempest-GroupsTest-480743010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:34:49 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b8018abd-d8d7-4c75-9e30-afbecb1d0595 tempest-GroupsTest-480743010 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:34:49 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-b8018abd-d8d7-4c75-9e30-afbecb1d0595 tempest-GroupsTest-480743010 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:34:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b8018abd-d8d7-4c75-9e30-afbecb1d0595 tempest-GroupsTest-480743010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f4a2965e-5a8a-4509-8a4d-dcb471b11d82 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:49 devstack sudo[92282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f4a2965e-5a8a-4509-8a4d-dcb471b11d82 1073741824 Jul 08 01:34:49 devstack sudo[92282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:51 devstack sudo[92282]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b8018abd-d8d7-4c75-9e30-afbecb1d0595 tempest-GroupsTest-480743010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f4a2965e-5a8a-4509-8a4d-dcb471b11d82 1073741824" returned: 0 in 1.295s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b8018abd-d8d7-4c75-9e30-afbecb1d0595 tempest-GroupsTest-480743010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f4a2965e-5a8a-4509-8a4d-dcb471b11d82 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:51 devstack sudo[92290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f4a2965e-5a8a-4509-8a4d-dcb471b11d82 Jul 08 01:34:51 devstack sudo[92290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:51 devstack sudo[92290]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b8018abd-d8d7-4c75-9e30-afbecb1d0595 tempest-GroupsTest-480743010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f4a2965e-5a8a-4509-8a4d-dcb471b11d82" returned: 0 in 0.882s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:51 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b8018abd-d8d7-4c75-9e30-afbecb1d0595 tempest-GroupsTest-480743010 None] <== create_volume: return (2242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:34:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b8018abd-d8d7-4c75-9e30-afbecb1d0595 tempest-GroupsTest-480743010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.245s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:34:52 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b8018abd-d8d7-4c75-9e30-afbecb1d0595 tempest-GroupsTest-480743010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82e39b96-b1b7-4166-9117-0ccb906cc088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4a2965e-5a8a-4509-8a4d-dcb471b11d82', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:52 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b8018abd-d8d7-4c75-9e30-afbecb1d0595 tempest-GroupsTest-480743010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c4aea3e-a315-4bc6-bd54-efe36d552e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:52 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-b8018abd-d8d7-4c75-9e30-afbecb1d0595 tempest-GroupsTest-480743010 None] Volume volume-f4a2965e-5a8a-4509-8a4d-dcb471b11d82 (f4a2965e-5a8a-4509-8a4d-dcb471b11d82): created successfully Jul 08 01:34:52 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b8018abd-d8d7-4c75-9e30-afbecb1d0595 tempest-GroupsTest-480743010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c4aea3e-a315-4bc6-bd54-efe36d552e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:52 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b8018abd-d8d7-4c75-9e30-afbecb1d0595 tempest-GroupsTest-480743010 None] Flow 'volume_create_manager' (a3ec6cf1-7886-4cd1-ac15-496f82808d93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:34:52 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-b8018abd-d8d7-4c75-9e30-afbecb1d0595 tempest-GroupsTest-480743010 None] Created volume successfully. Jul 08 01:34:54 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-02c194c4-d9bf-4a1e-b848-2809244f10aa tempest-GroupsTest-480743010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:34:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-02c194c4-d9bf-4a1e-b848-2809244f10aa tempest-GroupsTest-480743010 None] Flow 'volume_create_manager' (d9bdb27b-87a8-4e27-b899-6bb0a006046b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:34:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-02c194c4-d9bf-4a1e-b848-2809244f10aa tempest-GroupsTest-480743010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34699228-1810-46a4-872d-318f156747ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-02c194c4-d9bf-4a1e-b848-2809244f10aa tempest-GroupsTest-480743010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34699228-1810-46a4-872d-318f156747ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1168303369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cace2f76-4174-4861-aea1-8c4b5efa3df6,host='devstack@QuobyteHD#QuobyteHD',id=87b3abd0-02a4-4569-912e-ab1f1078c42c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ed3845c3b124357bd321f0e63223f8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:34:54Z,use_quota=True,user_id='20fa058a2cfc4f529799176832f543fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0491a14c-ab8a-4fbf-b435-b2b1f7a6afab),volume_type_id=0491a14c-ab8a-4fbf-b435-b2b1f7a6afab)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-02c194c4-d9bf-4a1e-b848-2809244f10aa tempest-GroupsTest-480743010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5249adc-4704-4445-b464-941ca84a29a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-02c194c4-d9bf-4a1e-b848-2809244f10aa tempest-GroupsTest-480743010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5249adc-4704-4445-b464-941ca84a29a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-02c194c4-d9bf-4a1e-b848-2809244f10aa tempest-GroupsTest-480743010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a4943d-e1c1-4cf2-a61e-eb01dbf926fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-02c194c4-d9bf-4a1e-b848-2809244f10aa tempest-GroupsTest-480743010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a4943d-e1c1-4cf2-a61e-eb01dbf926fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87b3abd0-02a4-4569-912e-ab1f1078c42c', 'volume_name': 'volume-87b3abd0-02a4-4569-912e-ab1f1078c42c', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-02c194c4-d9bf-4a1e-b848-2809244f10aa tempest-GroupsTest-480743010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cc336b5-33f3-4568-8610-f310ee1b103e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-02c194c4-d9bf-4a1e-b848-2809244f10aa tempest-GroupsTest-480743010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cc336b5-33f3-4568-8610-f310ee1b103e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-02c194c4-d9bf-4a1e-b848-2809244f10aa tempest-GroupsTest-480743010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7335c02-d1d6-4278-82e4-70ffa3f1e9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:54 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-02c194c4-d9bf-4a1e-b848-2809244f10aa tempest-GroupsTest-480743010 None] Volume 87b3abd0-02a4-4569-912e-ab1f1078c42c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87b3abd0-02a4-4569-912e-ab1f1078c42c', 'volume_size': 1} Jul 08 01:34:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-02c194c4-d9bf-4a1e-b848-2809244f10aa tempest-GroupsTest-480743010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:34:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-02c194c4-d9bf-4a1e-b848-2809244f10aa tempest-GroupsTest-480743010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:34:54 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-02c194c4-d9bf-4a1e-b848-2809244f10aa tempest-GroupsTest-480743010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cace2f76-4174-4861-aea1-8c4b5efa3df6,created_at=2026-07-07T23:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1168303369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cace2f76-4174-4861-aea1-8c4b5efa3df6,host='devstack@QuobyteHD#QuobyteHD',id=87b3abd0-02a4-4569-912e-ab1f1078c42c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ed3845c3b124357bd321f0e63223f8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:34:54Z,use_quota=True,user_id='20fa058a2cfc4f529799176832f543fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0491a14c-ab8a-4fbf-b435-b2b1f7a6afab),volume_type_id=0491a14c-ab8a-4fbf-b435-b2b1f7a6afab)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:34:54 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-02c194c4-d9bf-4a1e-b848-2809244f10aa tempest-GroupsTest-480743010 None] Creating volume 87b3abd0-02a4-4569-912e-ab1f1078c42c {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:34:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-02c194c4-d9bf-4a1e-b848-2809244f10aa tempest-GroupsTest-480743010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:34:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-02c194c4-d9bf-4a1e-b848-2809244f10aa tempest-GroupsTest-480743010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:34:54 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-02c194c4-d9bf-4a1e-b848-2809244f10aa tempest-GroupsTest-480743010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:34:54 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-02c194c4-d9bf-4a1e-b848-2809244f10aa tempest-GroupsTest-480743010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:34:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-02c194c4-d9bf-4a1e-b848-2809244f10aa tempest-GroupsTest-480743010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:34:54 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-02c194c4-d9bf-4a1e-b848-2809244f10aa tempest-GroupsTest-480743010 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:34:54 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-02c194c4-d9bf-4a1e-b848-2809244f10aa tempest-GroupsTest-480743010 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:34:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-02c194c4-d9bf-4a1e-b848-2809244f10aa tempest-GroupsTest-480743010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-87b3abd0-02a4-4569-912e-ab1f1078c42c 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:54 devstack sudo[92333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-87b3abd0-02a4-4569-912e-ab1f1078c42c 1073741824 Jul 08 01:34:54 devstack sudo[92333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:54 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-9c46b6ed-a14d-45a4-809c-1f5481048486 tempest-GroupSnapshotsV319Test-1557558472 None] Group tempest-GroupSnapshotsV319Test-Group-1401354380: creating Jul 08 01:34:54 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-9c46b6ed-a14d-45a4-809c-1f5481048486 tempest-GroupSnapshotsV319Test-1557558472 None] Group tempest-GroupSnapshotsV319Test-Group-1401354380: created successfully Jul 08 01:34:54 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-9c46b6ed-a14d-45a4-809c-1f5481048486 tempest-GroupSnapshotsV319Test-1557558472 None] Create group completed successfully. Jul 08 01:34:55 devstack sudo[92333]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-02c194c4-d9bf-4a1e-b848-2809244f10aa tempest-GroupsTest-480743010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-87b3abd0-02a4-4569-912e-ab1f1078c42c 1073741824" returned: 0 in 0.911s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-02c194c4-d9bf-4a1e-b848-2809244f10aa tempest-GroupsTest-480743010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-87b3abd0-02a4-4569-912e-ab1f1078c42c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:55 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:34:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:34:55 devstack sudo[92340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-87b3abd0-02a4-4569-912e-ab1f1078c42c Jul 08 01:34:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:34:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:34:55 devstack sudo[92340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:34:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:34:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:55 devstack sudo[92342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:34:55 devstack sudo[92342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:56 devstack sudo[92340]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-02c194c4-d9bf-4a1e-b848-2809244f10aa tempest-GroupsTest-480743010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-87b3abd0-02a4-4569-912e-ab1f1078c42c" returned: 0 in 0.960s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:56 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-02c194c4-d9bf-4a1e-b848-2809244f10aa tempest-GroupsTest-480743010 None] <== create_volume: return (1914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:34:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-02c194c4-d9bf-4a1e-b848-2809244f10aa tempest-GroupsTest-480743010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.916s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:34:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-02c194c4-d9bf-4a1e-b848-2809244f10aa tempest-GroupsTest-480743010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7335c02-d1d6-4278-82e4-70ffa3f1e9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87b3abd0-02a4-4569-912e-ab1f1078c42c', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-02c194c4-d9bf-4a1e-b848-2809244f10aa tempest-GroupsTest-480743010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc68dd2f-a460-4b31-92c0-a1c8f91f18c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:56 devstack sudo[92342]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.968s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:56 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:34:56 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager._thread_info {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:34:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread count: 8 {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:34:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread info: [<_MainThread(MainThread, started 127058402500736)>, , , , , , , ] {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:34:56 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-02c194c4-d9bf-4a1e-b848-2809244f10aa tempest-GroupsTest-480743010 None] Volume volume-87b3abd0-02a4-4569-912e-ab1f1078c42c (87b3abd0-02a4-4569-912e-ab1f1078c42c): created successfully Jul 08 01:34:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-02c194c4-d9bf-4a1e-b848-2809244f10aa tempest-GroupsTest-480743010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc68dd2f-a460-4b31-92c0-a1c8f91f18c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-02c194c4-d9bf-4a1e-b848-2809244f10aa tempest-GroupsTest-480743010 None] Flow 'volume_create_manager' (d9bdb27b-87a8-4e27-b899-6bb0a006046b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:34:56 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-c985cc16-820c-47aa-8028-684f502ec21b tempest-GroupSnapshotsV319Test-1557558472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:34:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c985cc16-820c-47aa-8028-684f502ec21b tempest-GroupSnapshotsV319Test-1557558472 None] Flow 'volume_create_manager' (c6c9b97a-37f1-4c1f-82ea-c714da58a808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:34:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c985cc16-820c-47aa-8028-684f502ec21b tempest-GroupSnapshotsV319Test-1557558472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dba41eb-3af7-45ca-a839-2d5d62710cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:56 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-02c194c4-d9bf-4a1e-b848-2809244f10aa tempest-GroupsTest-480743010 None] Created volume successfully. Jul 08 01:34:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c985cc16-820c-47aa-8028-684f502ec21b tempest-GroupSnapshotsV319Test-1557558472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dba41eb-3af7-45ca-a839-2d5d62710cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2094924453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4b3eb9c2-584e-4748-93a5-579f6b1ad882,host='devstack@QuobyteHD#QuobyteHD',id=4c0f9842-dfb5-4c9b-872c-05aea5a713c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9feec17ce33f48c7b370b7b9817afae9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:34:56Z,use_quota=True,user_id='4d4328ffb2c34554a04eb8e6cef44c21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5868ae9f-b28a-44c2-a798-8385e17ec03d),volume_type_id=5868ae9f-b28a-44c2-a798-8385e17ec03d)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c985cc16-820c-47aa-8028-684f502ec21b tempest-GroupSnapshotsV319Test-1557558472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c504b6-73b7-47bc-9c3d-1542b0b9e540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c985cc16-820c-47aa-8028-684f502ec21b tempest-GroupSnapshotsV319Test-1557558472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c504b6-73b7-47bc-9c3d-1542b0b9e540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c985cc16-820c-47aa-8028-684f502ec21b tempest-GroupSnapshotsV319Test-1557558472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dbbc009-14e2-4591-ab6d-5346fb7a0eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c985cc16-820c-47aa-8028-684f502ec21b tempest-GroupSnapshotsV319Test-1557558472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dbbc009-14e2-4591-ab6d-5346fb7a0eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c0f9842-dfb5-4c9b-872c-05aea5a713c6', 'volume_name': 'volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c985cc16-820c-47aa-8028-684f502ec21b tempest-GroupSnapshotsV319Test-1557558472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (342f19bc-e8fb-47c0-8f71-c1fc2c9b19d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c985cc16-820c-47aa-8028-684f502ec21b tempest-GroupSnapshotsV319Test-1557558472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (342f19bc-e8fb-47c0-8f71-c1fc2c9b19d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c985cc16-820c-47aa-8028-684f502ec21b tempest-GroupSnapshotsV319Test-1557558472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b30ee7aa-3282-4a7e-a04e-941f4c920c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:56 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-c985cc16-820c-47aa-8028-684f502ec21b tempest-GroupSnapshotsV319Test-1557558472 None] Volume 4c0f9842-dfb5-4c9b-872c-05aea5a713c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6', 'volume_size': 1} Jul 08 01:34:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c985cc16-820c-47aa-8028-684f502ec21b tempest-GroupSnapshotsV319Test-1557558472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:34:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c985cc16-820c-47aa-8028-684f502ec21b tempest-GroupSnapshotsV319Test-1557558472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:34:56 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c985cc16-820c-47aa-8028-684f502ec21b tempest-GroupSnapshotsV319Test-1557558472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4b3eb9c2-584e-4748-93a5-579f6b1ad882,created_at=2026-07-07T23:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2094924453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4b3eb9c2-584e-4748-93a5-579f6b1ad882,host='devstack@QuobyteHD#QuobyteHD',id=4c0f9842-dfb5-4c9b-872c-05aea5a713c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9feec17ce33f48c7b370b7b9817afae9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:34:56Z,use_quota=True,user_id='4d4328ffb2c34554a04eb8e6cef44c21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5868ae9f-b28a-44c2-a798-8385e17ec03d),volume_type_id=5868ae9f-b28a-44c2-a798-8385e17ec03d)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:34:56 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-c985cc16-820c-47aa-8028-684f502ec21b tempest-GroupSnapshotsV319Test-1557558472 None] Creating volume 4c0f9842-dfb5-4c9b-872c-05aea5a713c6 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:34:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c985cc16-820c-47aa-8028-684f502ec21b tempest-GroupSnapshotsV319Test-1557558472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:34:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c985cc16-820c-47aa-8028-684f502ec21b tempest-GroupSnapshotsV319Test-1557558472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:34:56 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c985cc16-820c-47aa-8028-684f502ec21b tempest-GroupSnapshotsV319Test-1557558472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:34:56 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c985cc16-820c-47aa-8028-684f502ec21b tempest-GroupSnapshotsV319Test-1557558472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:34:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c985cc16-820c-47aa-8028-684f502ec21b tempest-GroupSnapshotsV319Test-1557558472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:34:56 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c985cc16-820c-47aa-8028-684f502ec21b tempest-GroupSnapshotsV319Test-1557558472 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:34:56 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-c985cc16-820c-47aa-8028-684f502ec21b tempest-GroupSnapshotsV319Test-1557558472 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:34:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c985cc16-820c-47aa-8028-684f502ec21b tempest-GroupSnapshotsV319Test-1557558472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:56 devstack sudo[92347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6 1073741824 Jul 08 01:34:56 devstack sudo[92347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:56 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-44b67cf5-0922-419e-94a0-ad06c016ece9 tempest-GroupsTest-480743010 None] Update group completed successfully. Jul 08 01:34:57 devstack sudo[92347]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c985cc16-820c-47aa-8028-684f502ec21b tempest-GroupSnapshotsV319Test-1557558472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6 1073741824" returned: 0 in 1.067s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c985cc16-820c-47aa-8028-684f502ec21b tempest-GroupSnapshotsV319Test-1557558472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:57 devstack sudo[92353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6 Jul 08 01:34:57 devstack sudo[92353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:58 devstack sudo[92353]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c985cc16-820c-47aa-8028-684f502ec21b tempest-GroupSnapshotsV319Test-1557558472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6" returned: 0 in 0.836s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:58 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c985cc16-820c-47aa-8028-684f502ec21b tempest-GroupSnapshotsV319Test-1557558472 None] <== create_volume: return (1967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:34:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c985cc16-820c-47aa-8028-684f502ec21b tempest-GroupSnapshotsV319Test-1557558472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.970s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:34:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c985cc16-820c-47aa-8028-684f502ec21b tempest-GroupSnapshotsV319Test-1557558472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b30ee7aa-3282-4a7e-a04e-941f4c920c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c985cc16-820c-47aa-8028-684f502ec21b tempest-GroupSnapshotsV319Test-1557558472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (428fe5ba-c8b8-47b6-a639-ba7be4418996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:34:58 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-c985cc16-820c-47aa-8028-684f502ec21b tempest-GroupSnapshotsV319Test-1557558472 None] Volume volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6 (4c0f9842-dfb5-4c9b-872c-05aea5a713c6): created successfully Jul 08 01:34:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c985cc16-820c-47aa-8028-684f502ec21b tempest-GroupSnapshotsV319Test-1557558472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (428fe5ba-c8b8-47b6-a639-ba7be4418996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:34:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c985cc16-820c-47aa-8028-684f502ec21b tempest-GroupSnapshotsV319Test-1557558472 None] Flow 'volume_create_manager' (c6c9b97a-37f1-4c1f-82ea-c714da58a808) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:34:58 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-3cafef3b-461f-4027-9c09-e301eb2aa3f1 tempest-GroupsTest-480743010 None] Update group completed successfully. Jul 08 01:34:58 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-c985cc16-820c-47aa-8028-684f502ec21b tempest-GroupSnapshotsV319Test-1557558472 None] Created volume successfully. Jul 08 01:34:58 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-29c27467-f5ce-4d42-9e0e-a98747cf7899 tempest-ServerActionsTestOtherA-84188968 None] Acquiring lock "cinder-3322ae6d-a22f-4ba5-8937-23a1c1066cb7-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:34:58 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-29c27467-f5ce-4d42-9e0e-a98747cf7899 tempest-ServerActionsTestOtherA-84188968 None] Lock "cinder-3322ae6d-a22f-4ba5-8937-23a1c1066cb7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:34:58 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-29c27467-f5ce-4d42-9e0e-a98747cf7899 tempest-ServerActionsTestOtherA-84188968 None] Acquiring lock "cinder-quobyte-3322ae6d-a22f-4ba5-8937-23a1c1066cb7" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:34:58 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-29c27467-f5ce-4d42-9e0e-a98747cf7899 tempest-ServerActionsTestOtherA-84188968 None] Lock "cinder-quobyte-3322ae6d-a22f-4ba5-8937-23a1c1066cb7" acquired by "delete_volume" :: waited 0.024s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:34:58 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[e944838f-7d23-406e-986e-b55c4dc05e24]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:34:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-29c27467-f5ce-4d42-9e0e-a98747cf7899 tempest-ServerActionsTestOtherA-84188968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3322ae6d-a22f-4ba5-8937-23a1c1066cb7 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:58 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-126b138a-2adb-419d-b9d2-40fa3270921a tempest-GroupSnapshotsV319Test-1557558472 None] GroupSnapshot 97a5875b-e0b1-4600-9671-893ac2cdf393: creating. Jul 08 01:34:58 devstack sudo[92358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3322ae6d-a22f-4ba5-8937-23a1c1066cb7 Jul 08 01:34:58 devstack sudo[92358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-126b138a-2adb-419d-b9d2-40fa3270921a tempest-GroupSnapshotsV319Test-1557558472 None] Group snapshot 97a5875b-e0b1-4600-9671-893ac2cdf393: creating. {{(pid=87284) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 01:34:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-126b138a-2adb-419d-b9d2-40fa3270921a tempest-GroupSnapshotsV319Test-1557558472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:34:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-126b138a-2adb-419d-b9d2-40fa3270921a tempest-GroupSnapshotsV319Test-1557558472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:34:58 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-126b138a-2adb-419d-b9d2-40fa3270921a tempest-GroupSnapshotsV319Test-1557558472 None] Creating offline snapshot 078fcc1c-a635-470b-96e5-e5b5d46fa248 of volume 4c0f9842-dfb5-4c9b-872c-05aea5a713c6 {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:34:58 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[3129d572-0a4a-4b40-a402-5e19992ae4b4]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:34:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-126b138a-2adb-419d-b9d2-40fa3270921a tempest-GroupSnapshotsV319Test-1557558472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:58 devstack sudo[92360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6 Jul 08 01:34:58 devstack sudo[92360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:59 devstack sudo[92358]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-29c27467-f5ce-4d42-9e0e-a98747cf7899 tempest-ServerActionsTestOtherA-84188968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3322ae6d-a22f-4ba5-8937-23a1c1066cb7" returned: 0 in 0.811s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-29c27467-f5ce-4d42-9e0e-a98747cf7899 tempest-ServerActionsTestOtherA-84188968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3322ae6d-a22f-4ba5-8937-23a1c1066cb7 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:59 devstack sudo[92365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3322ae6d-a22f-4ba5-8937-23a1c1066cb7 Jul 08 01:34:59 devstack sudo[92365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:59 devstack sudo[92360]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-126b138a-2adb-419d-b9d2-40fa3270921a tempest-GroupSnapshotsV319Test-1557558472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6" returned: 0 in 0.858s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-126b138a-2adb-419d-b9d2-40fa3270921a tempest-GroupSnapshotsV319Test-1557558472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6.078fcc1c-a635-470b-96e5-e5b5d46fa248 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:59 devstack sudo[92370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6.078fcc1c-a635-470b-96e5-e5b5d46fa248 1G Jul 08 01:34:59 devstack sudo[92370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:00 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b367e5d9-d0ca-446a-9ad3-e4925b2046bb tempest-GroupsTest-480743010 None] Acquiring lock "cinder-quobyte-87b3abd0-02a4-4569-912e-ab1f1078c42c" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:35:00 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b367e5d9-d0ca-446a-9ad3-e4925b2046bb tempest-GroupsTest-480743010 None] Lock "cinder-quobyte-87b3abd0-02a4-4569-912e-ab1f1078c42c" acquired by "delete_volume" :: waited 0.018s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:35:00 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf95aa0e-f4f5-44c0-a40e-368229d689b7]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:35:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b367e5d9-d0ca-446a-9ad3-e4925b2046bb tempest-GroupsTest-480743010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-87b3abd0-02a4-4569-912e-ab1f1078c42c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:00 devstack sudo[92372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-87b3abd0-02a4-4569-912e-ab1f1078c42c Jul 08 01:35:00 devstack sudo[92372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:00 devstack sudo[92365]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-29c27467-f5ce-4d42-9e0e-a98747cf7899 tempest-ServerActionsTestOtherA-84188968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3322ae6d-a22f-4ba5-8937-23a1c1066cb7" returned: 0 in 0.777s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:00 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-29c27467-f5ce-4d42-9e0e-a98747cf7899 tempest-ServerActionsTestOtherA-84188968 None] Lock "cinder-quobyte-3322ae6d-a22f-4ba5-8937-23a1c1066cb7" released by "delete_volume" :: held 1.638s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:35:00 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-29c27467-f5ce-4d42-9e0e-a98747cf7899 tempest-ServerActionsTestOtherA-84188968 None] Created reservations ['3d33f0cf-3081-42b7-bf36-717951290073', 'cbb106a5-af2e-4ef2-8f43-c0a500c788eb', '387fb7eb-ef79-4f2d-97ef-07ae3a169f7d', 'f9d33cbb-ea8b-44fe-92ee-61065646df66'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:35:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-29c27467-f5ce-4d42-9e0e-a98747cf7899 tempest-ServerActionsTestOtherA-84188968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:35:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-29c27467-f5ce-4d42-9e0e-a98747cf7899 tempest-ServerActionsTestOtherA-84188968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:35:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-29c27467-f5ce-4d42-9e0e-a98747cf7899 tempest-ServerActionsTestOtherA-84188968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:35:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-29c27467-f5ce-4d42-9e0e-a98747cf7899 tempest-ServerActionsTestOtherA-84188968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:35:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-29c27467-f5ce-4d42-9e0e-a98747cf7899 tempest-ServerActionsTestOtherA-84188968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:35:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-29c27467-f5ce-4d42-9e0e-a98747cf7899 tempest-ServerActionsTestOtherA-84188968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:00 devstack sudo[92378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:35:00 devstack sudo[92378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:00 devstack sudo[92370]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-126b138a-2adb-419d-b9d2-40fa3270921a tempest-GroupSnapshotsV319Test-1557558472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6.078fcc1c-a635-470b-96e5-e5b5d46fa248 1G" returned: 0 in 0.927s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-126b138a-2adb-419d-b9d2-40fa3270921a tempest-GroupSnapshotsV319Test-1557558472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6.078fcc1c-a635-470b-96e5-e5b5d46fa248 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:00 devstack sudo[92380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6.078fcc1c-a635-470b-96e5-e5b5d46fa248 Jul 08 01:35:00 devstack sudo[92380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:00 devstack sudo[92372]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b367e5d9-d0ca-446a-9ad3-e4925b2046bb tempest-GroupsTest-480743010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-87b3abd0-02a4-4569-912e-ab1f1078c42c" returned: 0 in 0.869s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b367e5d9-d0ca-446a-9ad3-e4925b2046bb tempest-GroupsTest-480743010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-87b3abd0-02a4-4569-912e-ab1f1078c42c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:00 devstack sudo[92385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-87b3abd0-02a4-4569-912e-ab1f1078c42c Jul 08 01:35:00 devstack sudo[92385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:01 devstack sudo[92378]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-29c27467-f5ce-4d42-9e0e-a98747cf7899 tempest-ServerActionsTestOtherA-84188968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.764s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:01 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-29c27467-f5ce-4d42-9e0e-a98747cf7899 tempest-ServerActionsTestOtherA-84188968 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:35:01 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-29c27467-f5ce-4d42-9e0e-a98747cf7899 tempest-ServerActionsTestOtherA-84188968 None] Deleted volume successfully. Jul 08 01:35:01 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-29c27467-f5ce-4d42-9e0e-a98747cf7899 tempest-ServerActionsTestOtherA-84188968 None] Lock "cinder-3322ae6d-a22f-4ba5-8937-23a1c1066cb7-delete_volume" released by "delete_volume" :: held 2.679s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:35:01 devstack sudo[92380]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-126b138a-2adb-419d-b9d2-40fa3270921a tempest-GroupSnapshotsV319Test-1557558472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6.078fcc1c-a635-470b-96e5-e5b5d46fa248" returned: 0 in 0.893s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:01 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-126b138a-2adb-419d-b9d2-40fa3270921a tempest-GroupSnapshotsV319Test-1557558472 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6.078fcc1c-a635-470b-96e5-e5b5d46fa248 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:35:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-126b138a-2adb-419d-b9d2-40fa3270921a tempest-GroupSnapshotsV319Test-1557558472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6.078fcc1c-a635-470b-96e5-e5b5d46fa248 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:01 devstack sudo[92399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6.078fcc1c-a635-470b-96e5-e5b5d46fa248 Jul 08 01:35:01 devstack sudo[92399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:01 devstack sudo[92385]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b367e5d9-d0ca-446a-9ad3-e4925b2046bb tempest-GroupsTest-480743010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-87b3abd0-02a4-4569-912e-ab1f1078c42c" returned: 0 in 0.937s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:01 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b367e5d9-d0ca-446a-9ad3-e4925b2046bb tempest-GroupsTest-480743010 None] Lock "cinder-quobyte-87b3abd0-02a4-4569-912e-ab1f1078c42c" released by "delete_volume" :: held 1.873s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:35:01 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b367e5d9-d0ca-446a-9ad3-e4925b2046bb tempest-GroupsTest-480743010 None] Acquiring lock "cinder-quobyte-f4a2965e-5a8a-4509-8a4d-dcb471b11d82" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:35:01 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b367e5d9-d0ca-446a-9ad3-e4925b2046bb tempest-GroupsTest-480743010 None] Lock "cinder-quobyte-f4a2965e-5a8a-4509-8a4d-dcb471b11d82" acquired by "delete_volume" :: waited 0.015s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:35:01 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d12f76-74c1-449f-8f41-9bf3cfbf0ef3]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:35:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b367e5d9-d0ca-446a-9ad3-e4925b2046bb tempest-GroupsTest-480743010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f4a2965e-5a8a-4509-8a4d-dcb471b11d82 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:02 devstack sudo[92403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f4a2965e-5a8a-4509-8a4d-dcb471b11d82 Jul 08 01:35:02 devstack sudo[92403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:02 devstack sudo[92399]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-126b138a-2adb-419d-b9d2-40fa3270921a tempest-GroupSnapshotsV319Test-1557558472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6.078fcc1c-a635-470b-96e5-e5b5d46fa248" returned: 0 in 0.775s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-126b138a-2adb-419d-b9d2-40fa3270921a tempest-GroupSnapshotsV319Test-1557558472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:02 devstack sudo[92412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6.info Jul 08 01:35:02 devstack sudo[92412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:02 devstack sudo[92403]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b367e5d9-d0ca-446a-9ad3-e4925b2046bb tempest-GroupsTest-480743010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f4a2965e-5a8a-4509-8a4d-dcb471b11d82" returned: 0 in 0.928s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b367e5d9-d0ca-446a-9ad3-e4925b2046bb tempest-GroupsTest-480743010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f4a2965e-5a8a-4509-8a4d-dcb471b11d82 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:02 devstack sudo[92423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f4a2965e-5a8a-4509-8a4d-dcb471b11d82 Jul 08 01:35:02 devstack sudo[92423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:03 devstack sudo[92412]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-126b138a-2adb-419d-b9d2-40fa3270921a tempest-GroupSnapshotsV319Test-1557558472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6.info" returned: 0 in 0.951s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:03 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-126b138a-2adb-419d-b9d2-40fa3270921a tempest-GroupSnapshotsV319Test-1557558472 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:35:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-126b138a-2adb-419d-b9d2-40fa3270921a tempest-GroupSnapshotsV319Test-1557558472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:03 devstack sudo[92436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6.info Jul 08 01:35:03 devstack sudo[92436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:03 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-4609ac59-91c9-4724-8429-b094c707f2fd req-1399d516-0c72-41f8-ab8b-6734852680a0 tempest-AttachVolumeTestJSON-1425049151 None] Terminate volume connection completed successfully. Jul 08 01:35:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-4609ac59-91c9-4724-8429-b094c707f2fd req-1399d516-0c72-41f8-ab8b-6734852680a0 tempest-AttachVolumeTestJSON-1425049151 None] Deleting attachment ca10dce3-9848-4c75-b274-9262b6fa35f1. {{(pid=87284) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:35:04 devstack sudo[92423]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b367e5d9-d0ca-446a-9ad3-e4925b2046bb tempest-GroupsTest-480743010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f4a2965e-5a8a-4509-8a4d-dcb471b11d82" returned: 0 in 1.178s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:04 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b367e5d9-d0ca-446a-9ad3-e4925b2046bb tempest-GroupsTest-480743010 None] Lock "cinder-quobyte-f4a2965e-5a8a-4509-8a4d-dcb471b11d82" released by "delete_volume" :: held 2.158s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:35:04 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-b367e5d9-d0ca-446a-9ad3-e4925b2046bb tempest-GroupsTest-480743010 None] Created reservations ['71d5341a-3480-4a8b-af57-671b98995a00'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:35:04 devstack cinder-volume[87284]: WARNING cinder.quota [None req-b367e5d9-d0ca-446a-9ad3-e4925b2046bb tempest-GroupsTest-480743010 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1218937919 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1218937919, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:35:04 devstack cinder-volume[87284]: WARNING cinder.quota [None req-b367e5d9-d0ca-446a-9ad3-e4925b2046bb tempest-GroupsTest-480743010 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1218937919 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1218937919, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:35:04 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-b367e5d9-d0ca-446a-9ad3-e4925b2046bb tempest-GroupsTest-480743010 None] Created reservations ['df86e8c2-6e04-44bd-a020-7da536f4c4ef', '2685a475-8707-4c53-b576-55476f480fbe', '1ac52fad-e583-43a9-a422-3693e0c6af98', '9d4a2052-e6fe-4fcc-851d-db51de38ce1d'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:35:04 devstack sudo[92436]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-126b138a-2adb-419d-b9d2-40fa3270921a tempest-GroupSnapshotsV319Test-1557558472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6.info" returned: 0 in 1.027s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-126b138a-2adb-419d-b9d2-40fa3270921a tempest-GroupSnapshotsV319Test-1557558472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.526s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:35:04 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-126b138a-2adb-419d-b9d2-40fa3270921a tempest-GroupSnapshotsV319Test-1557558472 None] group_snapshot 97a5875b-e0b1-4600-9671-893ac2cdf393: created successfully Jul 08 01:35:04 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-b367e5d9-d0ca-446a-9ad3-e4925b2046bb tempest-GroupsTest-480743010 None] Created reservations ['83f7b359-8290-4c39-bf09-b5c3b0f1c972', '907e4fc5-5e59-451e-84ff-df093fd41998', 'ed881fa2-20ec-47e0-b253-62817eff5823', '92d70bce-eb54-4c52-997a-2c7d6116adb3'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:35:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b367e5d9-d0ca-446a-9ad3-e4925b2046bb tempest-GroupsTest-480743010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:35:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b367e5d9-d0ca-446a-9ad3-e4925b2046bb tempest-GroupsTest-480743010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:35:04 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b367e5d9-d0ca-446a-9ad3-e4925b2046bb tempest-GroupsTest-480743010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:35:04 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b367e5d9-d0ca-446a-9ad3-e4925b2046bb tempest-GroupsTest-480743010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:35:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b367e5d9-d0ca-446a-9ad3-e4925b2046bb tempest-GroupsTest-480743010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:35:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b367e5d9-d0ca-446a-9ad3-e4925b2046bb tempest-GroupsTest-480743010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:04 devstack sudo[92446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:35:04 devstack sudo[92446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:05 devstack sudo[92446]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b367e5d9-d0ca-446a-9ad3-e4925b2046bb tempest-GroupsTest-480743010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.908s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:05 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-b367e5d9-d0ca-446a-9ad3-e4925b2046bb tempest-GroupsTest-480743010 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:35:05 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-b367e5d9-d0ca-446a-9ad3-e4925b2046bb tempest-GroupsTest-480743010 None] Delete group completed successfully. Jul 08 01:35:05 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-44338f62-938b-4b28-92f7-babbb73b0d42 tempest-GroupSnapshotsV319Test-1557558472 None] group_snapshot 97a5875b-e0b1-4600-9671-893ac2cdf393: deleting Jul 08 01:35:05 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-44338f62-938b-4b28-92f7-babbb73b0d42 tempest-GroupSnapshotsV319Test-1557558472 None] group_snapshot 97a5875b-e0b1-4600-9671-893ac2cdf393: deleting {{(pid=87284) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 01:35:05 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-44338f62-938b-4b28-92f7-babbb73b0d42 tempest-GroupSnapshotsV319Test-1557558472 None] Acquiring lock "cinder-quobyte-4c0f9842-dfb5-4c9b-872c-05aea5a713c6" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:35:05 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-44338f62-938b-4b28-92f7-babbb73b0d42 tempest-GroupSnapshotsV319Test-1557558472 None] Lock "cinder-quobyte-4c0f9842-dfb5-4c9b-872c-05aea5a713c6" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:35:05 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-44338f62-938b-4b28-92f7-babbb73b0d42 tempest-GroupSnapshotsV319Test-1557558472 None] Acquiring lock "cinder-quobyte-078fcc1c-a635-470b-96e5-e5b5d46fa248" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:35:05 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-44338f62-938b-4b28-92f7-babbb73b0d42 tempest-GroupSnapshotsV319Test-1557558472 None] Lock "cinder-quobyte-078fcc1c-a635-470b-96e5-e5b5d46fa248" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:35:05 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-44338f62-938b-4b28-92f7-babbb73b0d42 tempest-GroupSnapshotsV319Test-1557558472 None] Deleting offline snapshot 078fcc1c-a635-470b-96e5-e5b5d46fa248 of volume 4c0f9842-dfb5-4c9b-872c-05aea5a713c6 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:35:06 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-44338f62-938b-4b28-92f7-babbb73b0d42 tempest-GroupSnapshotsV319Test-1557558472 None] snapshot_file for this snap is: volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6.078fcc1c-a635-470b-96e5-e5b5d46fa248 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:35:06 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1251e30-486c-4c50-b55e-7cf03e88f52a]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:35:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-44338f62-938b-4b28-92f7-babbb73b0d42 tempest-GroupSnapshotsV319Test-1557558472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6.078fcc1c-a635-470b-96e5-e5b5d46fa248 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:06 devstack sudo[92450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6.078fcc1c-a635-470b-96e5-e5b5d46fa248 Jul 08 01:35:06 devstack sudo[92450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:07 devstack sudo[92450]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-44338f62-938b-4b28-92f7-babbb73b0d42 tempest-GroupSnapshotsV319Test-1557558472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6.078fcc1c-a635-470b-96e5-e5b5d46fa248" returned: 0 in 1.038s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:07 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-44338f62-938b-4b28-92f7-babbb73b0d42 tempest-GroupSnapshotsV319Test-1557558472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:35:07 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[d256935f-a6ad-4779-a431-b3d5aeef6122]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:35:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-44338f62-938b-4b28-92f7-babbb73b0d42 tempest-GroupSnapshotsV319Test-1557558472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:07 devstack sudo[92460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6 Jul 08 01:35:07 devstack sudo[92460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:08 devstack sudo[92460]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-44338f62-938b-4b28-92f7-babbb73b0d42 tempest-GroupSnapshotsV319Test-1557558472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6" returned: 0 in 1.043s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-44338f62-938b-4b28-92f7-babbb73b0d42 tempest-GroupSnapshotsV319Test-1557558472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6.078fcc1c-a635-470b-96e5-e5b5d46fa248 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:08 devstack sudo[92466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6.078fcc1c-a635-470b-96e5-e5b5d46fa248 Jul 08 01:35:08 devstack sudo[92466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:09 devstack sudo[92466]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-44338f62-938b-4b28-92f7-babbb73b0d42 tempest-GroupSnapshotsV319Test-1557558472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6.078fcc1c-a635-470b-96e5-e5b5d46fa248" returned: 0 in 0.869s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-44338f62-938b-4b28-92f7-babbb73b0d42 tempest-GroupSnapshotsV319Test-1557558472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6.078fcc1c-a635-470b-96e5-e5b5d46fa248 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:09 devstack sudo[92471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6.078fcc1c-a635-470b-96e5-e5b5d46fa248 Jul 08 01:35:09 devstack sudo[92471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:09 devstack sudo[92471]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-44338f62-938b-4b28-92f7-babbb73b0d42 tempest-GroupSnapshotsV319Test-1557558472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6.078fcc1c-a635-470b-96e5-e5b5d46fa248" returned: 0 in 0.791s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:09 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-44338f62-938b-4b28-92f7-babbb73b0d42 tempest-GroupSnapshotsV319Test-1557558472 None] Lock "cinder-quobyte-078fcc1c-a635-470b-96e5-e5b5d46fa248" released by "_delete_snapshot" :: held 3.910s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:35:09 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-44338f62-938b-4b28-92f7-babbb73b0d42 tempest-GroupSnapshotsV319Test-1557558472 None] Lock "cinder-quobyte-4c0f9842-dfb5-4c9b-872c-05aea5a713c6" released by "delete_snapshot" :: held 3.931s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:35:09 devstack cinder-volume[87284]: WARNING cinder.quota [None req-44338f62-938b-4b28-92f7-babbb73b0d42 tempest-GroupSnapshotsV319Test-1557558472 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1849970497 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1849970497, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:35:09 devstack cinder-volume[87284]: WARNING cinder.quota [None req-44338f62-938b-4b28-92f7-babbb73b0d42 tempest-GroupSnapshotsV319Test-1557558472 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1849970497 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1849970497, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:35:09 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-44338f62-938b-4b28-92f7-babbb73b0d42 tempest-GroupSnapshotsV319Test-1557558472 None] Created reservations ['1c772deb-fc70-41b9-9095-833af5bed252', '8f873e80-ee2c-403f-b458-2466a1ad4e48', 'a9430682-3939-40b2-9f27-01e6342557e4', '75269db8-da64-4b65-990f-bb915dd39f0c'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:35:10 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-44338f62-938b-4b28-92f7-babbb73b0d42 tempest-GroupSnapshotsV319Test-1557558472 None] group_snapshot 97a5875b-e0b1-4600-9671-893ac2cdf393: deleted successfully Jul 08 01:35:10 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b32320a3-e1bc-48f5-97c7-f55acbddfc2d tempest-GroupSnapshotsV319Test-1557558472 None] Acquiring lock "cinder-quobyte-4c0f9842-dfb5-4c9b-872c-05aea5a713c6" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:35:10 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b32320a3-e1bc-48f5-97c7-f55acbddfc2d tempest-GroupSnapshotsV319Test-1557558472 None] Lock "cinder-quobyte-4c0f9842-dfb5-4c9b-872c-05aea5a713c6" acquired by "delete_volume" :: waited 0.023s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:35:10 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2788e4-8ffd-4d9a-985a-77d74b183e92]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:35:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b32320a3-e1bc-48f5-97c7-f55acbddfc2d tempest-GroupSnapshotsV319Test-1557558472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:10 devstack sudo[92475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6 Jul 08 01:35:10 devstack sudo[92475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:11 devstack sudo[92475]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b32320a3-e1bc-48f5-97c7-f55acbddfc2d tempest-GroupSnapshotsV319Test-1557558472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6" returned: 0 in 1.072s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b32320a3-e1bc-48f5-97c7-f55acbddfc2d tempest-GroupSnapshotsV319Test-1557558472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:11 devstack sudo[92480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6 Jul 08 01:35:11 devstack sudo[92480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:12 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-eb38c1fd-6903-4469-a04b-d0c6287ea809 tempest-GroupsV314Test-254355112 None] Group tempest-GroupsV314Test-Group-453332127: creating Jul 08 01:35:12 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-eb38c1fd-6903-4469-a04b-d0c6287ea809 tempest-GroupsV314Test-254355112 None] Group tempest-GroupsV314Test-Group-453332127: created successfully Jul 08 01:35:12 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-eb38c1fd-6903-4469-a04b-d0c6287ea809 tempest-GroupsV314Test-254355112 None] Create group completed successfully. Jul 08 01:35:12 devstack sudo[92480]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b32320a3-e1bc-48f5-97c7-f55acbddfc2d tempest-GroupSnapshotsV319Test-1557558472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4c0f9842-dfb5-4c9b-872c-05aea5a713c6" returned: 0 in 0.786s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:12 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b32320a3-e1bc-48f5-97c7-f55acbddfc2d tempest-GroupSnapshotsV319Test-1557558472 None] Lock "cinder-quobyte-4c0f9842-dfb5-4c9b-872c-05aea5a713c6" released by "delete_volume" :: held 1.938s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:35:12 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-b32320a3-e1bc-48f5-97c7-f55acbddfc2d tempest-GroupSnapshotsV319Test-1557558472 None] Created reservations ['894a8623-5dc1-4d62-b43e-2f03c36d5aeb'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:35:12 devstack cinder-volume[87284]: WARNING cinder.quota [None req-b32320a3-e1bc-48f5-97c7-f55acbddfc2d tempest-GroupSnapshotsV319Test-1557558472 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1849970497 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1849970497, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:35:12 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-b32320a3-e1bc-48f5-97c7-f55acbddfc2d tempest-GroupSnapshotsV319Test-1557558472 None] Created reservations ['9bd51400-c8ac-4a20-a9eb-adb1aeaf5ca1', 'c5dcb722-af23-4cd6-b6b8-ce94e8d33759', 'e3ddf484-3d22-4c5b-8053-ad717998263e', 'dfbb197f-5f43-42ac-9257-c6bfabcf9eb2'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:35:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b32320a3-e1bc-48f5-97c7-f55acbddfc2d tempest-GroupSnapshotsV319Test-1557558472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:35:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b32320a3-e1bc-48f5-97c7-f55acbddfc2d tempest-GroupSnapshotsV319Test-1557558472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:35:12 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b32320a3-e1bc-48f5-97c7-f55acbddfc2d tempest-GroupSnapshotsV319Test-1557558472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:35:12 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b32320a3-e1bc-48f5-97c7-f55acbddfc2d tempest-GroupSnapshotsV319Test-1557558472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:35:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b32320a3-e1bc-48f5-97c7-f55acbddfc2d tempest-GroupSnapshotsV319Test-1557558472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:35:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b32320a3-e1bc-48f5-97c7-f55acbddfc2d tempest-GroupSnapshotsV319Test-1557558472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:12 devstack sudo[92485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:35:12 devstack sudo[92485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:14 devstack sudo[92485]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b32320a3-e1bc-48f5-97c7-f55acbddfc2d tempest-GroupSnapshotsV319Test-1557558472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.151s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:14 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-b32320a3-e1bc-48f5-97c7-f55acbddfc2d tempest-GroupSnapshotsV319Test-1557558472 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:35:14 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-b32320a3-e1bc-48f5-97c7-f55acbddfc2d tempest-GroupSnapshotsV319Test-1557558472 None] Delete group completed successfully. Jul 08 01:35:14 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-99e7ff77-650b-41db-8f8e-9f26edaf8cca tempest-GroupsV314Test-254355112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:35:14 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-99e7ff77-650b-41db-8f8e-9f26edaf8cca tempest-GroupsV314Test-254355112 None] Flow 'volume_create_manager' (926918f3-cedb-47c2-9bb7-d0f4c6848a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:35:14 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-99e7ff77-650b-41db-8f8e-9f26edaf8cca tempest-GroupsV314Test-254355112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2eaa3a4-3c14-450a-82b8-6bfbde9cde38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:14 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-99e7ff77-650b-41db-8f8e-9f26edaf8cca tempest-GroupsV314Test-254355112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2eaa3a4-3c14-450a-82b8-6bfbde9cde38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1283389676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cf09ff6a-353e-4837-ba4d-d098725efb9d,host='devstack@QuobyteHD#QuobyteHD',id=1fba4448-a3f7-4280-abd7-74dabae4a644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb23a7cfe6bc42f1904e4bfc09850864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:35:14Z,use_quota=True,user_id='ec6e660a369c4ba2a596b09a89a00c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dbe59a6b-9f6f-47fd-9618-d231165a438a),volume_type_id=dbe59a6b-9f6f-47fd-9618-d231165a438a)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:14 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-99e7ff77-650b-41db-8f8e-9f26edaf8cca tempest-GroupsV314Test-254355112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb3ea6e2-86b8-4f0c-bcc0-a6a315e644de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:14 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-99e7ff77-650b-41db-8f8e-9f26edaf8cca tempest-GroupsV314Test-254355112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb3ea6e2-86b8-4f0c-bcc0-a6a315e644de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:14 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-99e7ff77-650b-41db-8f8e-9f26edaf8cca tempest-GroupsV314Test-254355112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dccd3f89-37bc-4998-84ab-4682d5a46a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:14 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-99e7ff77-650b-41db-8f8e-9f26edaf8cca tempest-GroupsV314Test-254355112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dccd3f89-37bc-4998-84ab-4682d5a46a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fba4448-a3f7-4280-abd7-74dabae4a644', 'volume_name': 'volume-1fba4448-a3f7-4280-abd7-74dabae4a644', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:14 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-99e7ff77-650b-41db-8f8e-9f26edaf8cca tempest-GroupsV314Test-254355112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7333ace7-6722-4195-82cd-a899dbda42cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:14 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-99e7ff77-650b-41db-8f8e-9f26edaf8cca tempest-GroupsV314Test-254355112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7333ace7-6722-4195-82cd-a899dbda42cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:14 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-99e7ff77-650b-41db-8f8e-9f26edaf8cca tempest-GroupsV314Test-254355112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60705f2c-dbc5-4a91-bd4c-36770af4e813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:14 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-99e7ff77-650b-41db-8f8e-9f26edaf8cca tempest-GroupsV314Test-254355112 None] Volume 1fba4448-a3f7-4280-abd7-74dabae4a644: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fba4448-a3f7-4280-abd7-74dabae4a644', 'volume_size': 1} Jul 08 01:35:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-99e7ff77-650b-41db-8f8e-9f26edaf8cca tempest-GroupsV314Test-254355112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:35:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-99e7ff77-650b-41db-8f8e-9f26edaf8cca tempest-GroupsV314Test-254355112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:35:14 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-99e7ff77-650b-41db-8f8e-9f26edaf8cca tempest-GroupsV314Test-254355112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cf09ff6a-353e-4837-ba4d-d098725efb9d,created_at=2026-07-07T23:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1283389676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cf09ff6a-353e-4837-ba4d-d098725efb9d,host='devstack@QuobyteHD#QuobyteHD',id=1fba4448-a3f7-4280-abd7-74dabae4a644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb23a7cfe6bc42f1904e4bfc09850864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:35:14Z,use_quota=True,user_id='ec6e660a369c4ba2a596b09a89a00c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dbe59a6b-9f6f-47fd-9618-d231165a438a),volume_type_id=dbe59a6b-9f6f-47fd-9618-d231165a438a)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:35:14 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-99e7ff77-650b-41db-8f8e-9f26edaf8cca tempest-GroupsV314Test-254355112 None] Creating volume 1fba4448-a3f7-4280-abd7-74dabae4a644 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:35:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-99e7ff77-650b-41db-8f8e-9f26edaf8cca tempest-GroupsV314Test-254355112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:35:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-99e7ff77-650b-41db-8f8e-9f26edaf8cca tempest-GroupsV314Test-254355112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:35:14 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-99e7ff77-650b-41db-8f8e-9f26edaf8cca tempest-GroupsV314Test-254355112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:35:14 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-99e7ff77-650b-41db-8f8e-9f26edaf8cca tempest-GroupsV314Test-254355112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:35:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-99e7ff77-650b-41db-8f8e-9f26edaf8cca tempest-GroupsV314Test-254355112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:35:14 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-99e7ff77-650b-41db-8f8e-9f26edaf8cca tempest-GroupsV314Test-254355112 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:35:14 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-99e7ff77-650b-41db-8f8e-9f26edaf8cca tempest-GroupsV314Test-254355112 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:35:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-99e7ff77-650b-41db-8f8e-9f26edaf8cca tempest-GroupsV314Test-254355112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:14 devstack sudo[92507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644 1073741824 Jul 08 01:35:14 devstack sudo[92507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:15 devstack sudo[92507]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-99e7ff77-650b-41db-8f8e-9f26edaf8cca tempest-GroupsV314Test-254355112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644 1073741824" returned: 0 in 1.181s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-99e7ff77-650b-41db-8f8e-9f26edaf8cca tempest-GroupsV314Test-254355112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:15 devstack sudo[92521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644 Jul 08 01:35:15 devstack sudo[92521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:17 devstack sudo[92521]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-99e7ff77-650b-41db-8f8e-9f26edaf8cca tempest-GroupsV314Test-254355112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644" returned: 0 in 1.334s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:17 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-99e7ff77-650b-41db-8f8e-9f26edaf8cca tempest-GroupsV314Test-254355112 None] <== create_volume: return (2577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:35:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-99e7ff77-650b-41db-8f8e-9f26edaf8cca tempest-GroupsV314Test-254355112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.594s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:35:17 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-99e7ff77-650b-41db-8f8e-9f26edaf8cca tempest-GroupsV314Test-254355112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60705f2c-dbc5-4a91-bd4c-36770af4e813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fba4448-a3f7-4280-abd7-74dabae4a644', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:17 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-99e7ff77-650b-41db-8f8e-9f26edaf8cca tempest-GroupsV314Test-254355112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2375b7b5-68fb-4d67-8763-cada7df8c2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:17 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-99e7ff77-650b-41db-8f8e-9f26edaf8cca tempest-GroupsV314Test-254355112 None] Volume volume-1fba4448-a3f7-4280-abd7-74dabae4a644 (1fba4448-a3f7-4280-abd7-74dabae4a644): created successfully Jul 08 01:35:17 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-99e7ff77-650b-41db-8f8e-9f26edaf8cca tempest-GroupsV314Test-254355112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2375b7b5-68fb-4d67-8763-cada7df8c2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:17 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-99e7ff77-650b-41db-8f8e-9f26edaf8cca tempest-GroupsV314Test-254355112 None] Flow 'volume_create_manager' (926918f3-cedb-47c2-9bb7-d0f4c6848a68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:35:17 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-99e7ff77-650b-41db-8f8e-9f26edaf8cca tempest-GroupsV314Test-254355112 None] Created volume successfully. Jul 08 01:35:19 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:UPDATE=136,cinder:SELECT=130,cinder:INSERT=33,cinder:DELETE=4 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:35:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:35:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:35:19 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] Cloning volume 1fba4448-a3f7-4280-abd7-74dabae4a644 to volume 35785fe0-ce09-48f4-b993-c46731f3c0c6 Jul 08 01:35:20 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] Creating offline snapshot 8e80f0f9-f40d-4c15-8d29-b76c93faefe7 of volume 1fba4448-a3f7-4280-abd7-74dabae4a644 {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:35:20 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[837b5599-cb7d-4f89-98ee-0ef4d9788d98]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:35:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:20 devstack sudo[92599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644 Jul 08 01:35:20 devstack sudo[92599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:21 devstack sudo[92599]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644" returned: 0 in 1.156s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644.8e80f0f9-f40d-4c15-8d29-b76c93faefe7 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:21 devstack sudo[92604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644.8e80f0f9-f40d-4c15-8d29-b76c93faefe7 1G Jul 08 01:35:21 devstack sudo[92604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:22 devstack sudo[92604]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644.8e80f0f9-f40d-4c15-8d29-b76c93faefe7 1G" returned: 0 in 1.242s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fba4448-a3f7-4280-abd7-74dabae4a644 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644.8e80f0f9-f40d-4c15-8d29-b76c93faefe7 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:22 devstack sudo[92610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fba4448-a3f7-4280-abd7-74dabae4a644 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644.8e80f0f9-f40d-4c15-8d29-b76c93faefe7 Jul 08 01:35:22 devstack sudo[92610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:22 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [req-13d895c6-c469-4038-a26c-2b62676ce2b8 req-a9f9c76a-c342-4f42-ba7a-e423aa1e781c tempest-VolumesGetTestJSON-1781473134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:35:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-13d895c6-c469-4038-a26c-2b62676ce2b8 req-a9f9c76a-c342-4f42-ba7a-e423aa1e781c tempest-VolumesGetTestJSON-1781473134 None] Flow 'volume_create_manager' (85c760b1-b43a-4af5-99dc-d59a45cb99b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:35:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-13d895c6-c469-4038-a26c-2b62676ce2b8 req-a9f9c76a-c342-4f42-ba7a-e423aa1e781c tempest-VolumesGetTestJSON-1781473134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a449afab-e113-4b98-8053-d48e9d24d6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-13d895c6-c469-4038-a26c-2b62676ce2b8 req-a9f9c76a-c342-4f42-ba7a-e423aa1e781c tempest-VolumesGetTestJSON-1781473134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a449afab-e113-4b98-8053-d48e9d24d6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-68214535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f88c185c-d75f-41a5-a28f-bd6585a19831,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='da6ef1fae70845189d5205d52237d649',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:35:23Z,use_quota=True,user_id='f3aef07d908245f5b104be8f27b17530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-13d895c6-c469-4038-a26c-2b62676ce2b8 req-a9f9c76a-c342-4f42-ba7a-e423aa1e781c tempest-VolumesGetTestJSON-1781473134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f748bf75-5748-495b-988d-846fc5790abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-13d895c6-c469-4038-a26c-2b62676ce2b8 req-a9f9c76a-c342-4f42-ba7a-e423aa1e781c tempest-VolumesGetTestJSON-1781473134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f748bf75-5748-495b-988d-846fc5790abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-13d895c6-c469-4038-a26c-2b62676ce2b8 req-a9f9c76a-c342-4f42-ba7a-e423aa1e781c tempest-VolumesGetTestJSON-1781473134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55d215ef-0953-4fee-aa8e-f680f59b1f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-13d895c6-c469-4038-a26c-2b62676ce2b8 req-a9f9c76a-c342-4f42-ba7a-e423aa1e781c tempest-VolumesGetTestJSON-1781473134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55d215ef-0953-4fee-aa8e-f680f59b1f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f88c185c-d75f-41a5-a28f-bd6585a19831', 'volume_name': 'volume-f88c185c-d75f-41a5-a28f-bd6585a19831', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-13d895c6-c469-4038-a26c-2b62676ce2b8 req-a9f9c76a-c342-4f42-ba7a-e423aa1e781c tempest-VolumesGetTestJSON-1781473134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fdbc262-42a0-4e8c-988a-734236ec2188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-13d895c6-c469-4038-a26c-2b62676ce2b8 req-a9f9c76a-c342-4f42-ba7a-e423aa1e781c tempest-VolumesGetTestJSON-1781473134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fdbc262-42a0-4e8c-988a-734236ec2188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-13d895c6-c469-4038-a26c-2b62676ce2b8 req-a9f9c76a-c342-4f42-ba7a-e423aa1e781c tempest-VolumesGetTestJSON-1781473134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40700a2a-3b6f-4c1e-bf74-feb335992415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:22 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [req-13d895c6-c469-4038-a26c-2b62676ce2b8 req-a9f9c76a-c342-4f42-ba7a-e423aa1e781c tempest-VolumesGetTestJSON-1781473134 None] Volume f88c185c-d75f-41a5-a28f-bd6585a19831: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f88c185c-d75f-41a5-a28f-bd6585a19831', 'volume_size': 1} Jul 08 01:35:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-13d895c6-c469-4038-a26c-2b62676ce2b8 req-a9f9c76a-c342-4f42-ba7a-e423aa1e781c tempest-VolumesGetTestJSON-1781473134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:35:23 devstack sudo[92610]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fba4448-a3f7-4280-abd7-74dabae4a644 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644.8e80f0f9-f40d-4c15-8d29-b76c93faefe7" returned: 0 in 1.019s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:23 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644.8e80f0f9-f40d-4c15-8d29-b76c93faefe7 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:35:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644.8e80f0f9-f40d-4c15-8d29-b76c93faefe7 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:23 devstack sudo[92615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644.8e80f0f9-f40d-4c15-8d29-b76c93faefe7 Jul 08 01:35:23 devstack sudo[92615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:24 devstack sudo[92615]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644.8e80f0f9-f40d-4c15-8d29-b76c93faefe7" returned: 0 in 0.724s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:24 devstack sudo[92618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644.info Jul 08 01:35:24 devstack sudo[92618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:25 devstack sudo[92618]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644.info" returned: 0 in 0.889s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:25 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:35:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:25 devstack sudo[92664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644.info Jul 08 01:35:25 devstack sudo[92664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:26 devstack sudo[92664]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644.info" returned: 0 in 0.851s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:26 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] Acquiring lock "cinder-quobyte-35785fe0-ce09-48f4-b993-c46731f3c0c6" by "_copy_volume_from_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:35:26 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] Lock "cinder-quobyte-35785fe0-ce09-48f4-b993-c46731f3c0c6" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:35:26 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] snapshot: 8e80f0f9-f40d-4c15-8d29-b76c93faefe7, volume: 35785fe0-ce09-48f4-b993-c46731f3c0c6, {{(pid=87284) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:35:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:35:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:35:26 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:35:26 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:35:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:35:26 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd3fe5f-863f-4f34-8684-47f66405f135]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:35:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644.8e80f0f9-f40d-4c15-8d29-b76c93faefe7 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:26 devstack sudo[92667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644.8e80f0f9-f40d-4c15-8d29-b76c93faefe7 Jul 08 01:35:26 devstack sudo[92667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:27 devstack sudo[92667]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644.8e80f0f9-f40d-4c15-8d29-b76c93faefe7" returned: 0 in 0.929s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:27 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fba4448-a3f7-4280-abd7-74dabae4a644(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:35:27 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644 {{(pid=87284) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:35:27 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] Creating direct copy from snapshot {{(pid=87284) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:35:27 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c59ad43-44ba-44b5-b031-11578d9fea4a]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:35:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:27 devstack sudo[92673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644 Jul 08 01:35:27 devstack sudo[92673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:28 devstack sudo[92673]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644" returned: 0 in 0.960s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:28 devstack cinder-volume[87284]: DEBUG cinder.utils [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] Path /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-35785fe0-ce09-48f4-b993-c46731f3c0c6 not found in is_blk_device check {{(pid=87284) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:35:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-35785fe0-ce09-48f4-b993-c46731f3c0c6 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:28 devstack sudo[92678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-35785fe0-ce09-48f4-b993-c46731f3c0c6 Jul 08 01:35:28 devstack sudo[92678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:33 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:UPDATE=112,cinder:SELECT=105,cinder:DELETE=3,cinder:INSERT=20 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:35:33 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbfd0b40-1ece-49cd-8006-ae5bf6211436 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:35:33 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-dbfd0b40-1ece-49cd-8006-ae5bf6211436 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Flow 'volume_create_manager' (bf6a1a3b-f508-4835-bac8-c7cf86a427c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:35:33 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-dbfd0b40-1ece-49cd-8006-ae5bf6211436 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c276a4-cbe4-434b-a04c-3824de5e168c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:33 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-dbfd0b40-1ece-49cd-8006-ae5bf6211436 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c276a4-cbe4-434b-a04c-3824de5e168c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1947753917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ff9ecdc-403d-4960-8335-023a1433e4cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2990ff3e6443462da7141c013a0de22d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:35:34Z,use_quota=True,user_id='9cdc4842fafb4a1f9b10995a4f9f4171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:33 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-dbfd0b40-1ece-49cd-8006-ae5bf6211436 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85e0085f-76e3-424a-9c7b-c1fa14faba07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:33 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-dbfd0b40-1ece-49cd-8006-ae5bf6211436 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85e0085f-76e3-424a-9c7b-c1fa14faba07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:33 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-dbfd0b40-1ece-49cd-8006-ae5bf6211436 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6a3e312-4f7b-4afd-a11f-6ee1b536cb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:33 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-dbfd0b40-1ece-49cd-8006-ae5bf6211436 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6a3e312-4f7b-4afd-a11f-6ee1b536cb2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ff9ecdc-403d-4960-8335-023a1433e4cc', 'volume_name': 'volume-5ff9ecdc-403d-4960-8335-023a1433e4cc', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:33 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-dbfd0b40-1ece-49cd-8006-ae5bf6211436 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e738c6b5-f971-480e-b727-ccd2287b8b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:33 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-dbfd0b40-1ece-49cd-8006-ae5bf6211436 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e738c6b5-f971-480e-b727-ccd2287b8b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:33 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-dbfd0b40-1ece-49cd-8006-ae5bf6211436 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a80404d-7fc6-4f8b-acd9-6d6c63639f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:33 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-dbfd0b40-1ece-49cd-8006-ae5bf6211436 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Volume 5ff9ecdc-403d-4960-8335-023a1433e4cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ff9ecdc-403d-4960-8335-023a1433e4cc', 'volume_size': 1} Jul 08 01:35:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-dbfd0b40-1ece-49cd-8006-ae5bf6211436 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:35:34 devstack sudo[92678]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-35785fe0-ce09-48f4-b993-c46731f3c0c6" returned: 0 in 6.301s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:34 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdd2936-0597-416b-b1c1-f387fb40ad1a]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:35:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:34 devstack sudo[92694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644 Jul 08 01:35:34 devstack sudo[92694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:35 devstack sudo[92694]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644" returned: 0 in 1.028s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:35 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] Image conversion details: src /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644, size 1024.00 MB, duration 6.30 sec, destination /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-35785fe0-ce09-48f4-b993-c46731f3c0c6 {{(pid=87284) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:35:35 devstack cinder-volume[87284]: INFO cinder.image.image_utils [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] Converted 1024.00 MB image at 162.49 MB/s Jul 08 01:35:35 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-35785fe0-ce09-48f4-b993-c46731f3c0c6 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:35:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-35785fe0-ce09-48f4-b993-c46731f3c0c6 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:35 devstack sudo[92701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-35785fe0-ce09-48f4-b993-c46731f3c0c6 Jul 08 01:35:35 devstack sudo[92701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:36 devstack sudo[92701]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-35785fe0-ce09-48f4-b993-c46731f3c0c6" returned: 0 in 0.674s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:36 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] Lock "cinder-quobyte-35785fe0-ce09-48f4-b993-c46731f3c0c6" released by "_copy_volume_from_snapshot" :: held 10.018s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:35:36 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] Acquiring lock "cinder-quobyte-8e80f0f9-f40d-4c15-8d29-b76c93faefe7" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:35:36 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] Lock "cinder-quobyte-8e80f0f9-f40d-4c15-8d29-b76c93faefe7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:35:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] Deleting offline snapshot 8e80f0f9-f40d-4c15-8d29-b76c93faefe7 of volume 1fba4448-a3f7-4280-abd7-74dabae4a644 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:35:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] snapshot_file for this snap is: volume-1fba4448-a3f7-4280-abd7-74dabae4a644.8e80f0f9-f40d-4c15-8d29-b76c93faefe7 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:35:36 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[813c270c-6a8f-4c2a-8b33-1396ee2321e7]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:35:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644.8e80f0f9-f40d-4c15-8d29-b76c93faefe7 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:36 devstack sudo[92708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644.8e80f0f9-f40d-4c15-8d29-b76c93faefe7 Jul 08 01:35:36 devstack sudo[92708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:37 devstack sudo[92708]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644.8e80f0f9-f40d-4c15-8d29-b76c93faefe7" returned: 0 in 0.843s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:37 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fba4448-a3f7-4280-abd7-74dabae4a644(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:35:37 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[7791bffd-ac29-441a-ba0c-1f8a005c4e11]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:35:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:37 devstack sudo[92716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644 Jul 08 01:35:37 devstack sudo[92716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:37 devstack sudo[92716]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644" returned: 0 in 0.809s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644.8e80f0f9-f40d-4c15-8d29-b76c93faefe7 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:37 devstack sudo[92721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644.8e80f0f9-f40d-4c15-8d29-b76c93faefe7 Jul 08 01:35:37 devstack sudo[92721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:38 devstack sudo[92721]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644.8e80f0f9-f40d-4c15-8d29-b76c93faefe7" returned: 0 in 0.872s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644.8e80f0f9-f40d-4c15-8d29-b76c93faefe7 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:38 devstack sudo[92726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644.8e80f0f9-f40d-4c15-8d29-b76c93faefe7 Jul 08 01:35:38 devstack sudo[92726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:39 devstack sudo[92726]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644.8e80f0f9-f40d-4c15-8d29-b76c93faefe7" returned: 0 in 0.682s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:39 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] Lock "cinder-quobyte-8e80f0f9-f40d-4c15-8d29-b76c93faefe7" released by "_delete_snapshot" :: held 3.313s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:35:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.529s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:35:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-13d895c6-c469-4038-a26c-2b62676ce2b8 req-a9f9c76a-c342-4f42-ba7a-e423aa1e781c tempest-VolumesGetTestJSON-1781473134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.638s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:35:39 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [req-13d895c6-c469-4038-a26c-2b62676ce2b8 req-a9f9c76a-c342-4f42-ba7a-e423aa1e781c tempest-VolumesGetTestJSON-1781473134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-68214535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f88c185c-d75f-41a5-a28f-bd6585a19831,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='da6ef1fae70845189d5205d52237d649',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:35:23Z,use_quota=True,user_id='f3aef07d908245f5b104be8f27b17530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:35:39 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [req-13d895c6-c469-4038-a26c-2b62676ce2b8 req-a9f9c76a-c342-4f42-ba7a-e423aa1e781c tempest-VolumesGetTestJSON-1781473134 None] Creating volume f88c185c-d75f-41a5-a28f-bd6585a19831 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:35:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-13d895c6-c469-4038-a26c-2b62676ce2b8 req-a9f9c76a-c342-4f42-ba7a-e423aa1e781c tempest-VolumesGetTestJSON-1781473134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:35:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-13d895c6-c469-4038-a26c-2b62676ce2b8 req-a9f9c76a-c342-4f42-ba7a-e423aa1e781c tempest-VolumesGetTestJSON-1781473134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:35:39 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [req-13d895c6-c469-4038-a26c-2b62676ce2b8 req-a9f9c76a-c342-4f42-ba7a-e423aa1e781c tempest-VolumesGetTestJSON-1781473134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:35:39 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [req-13d895c6-c469-4038-a26c-2b62676ce2b8 req-a9f9c76a-c342-4f42-ba7a-e423aa1e781c tempest-VolumesGetTestJSON-1781473134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:35:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-13d895c6-c469-4038-a26c-2b62676ce2b8 req-a9f9c76a-c342-4f42-ba7a-e423aa1e781c tempest-VolumesGetTestJSON-1781473134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:35:39 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [req-13d895c6-c469-4038-a26c-2b62676ce2b8 req-a9f9c76a-c342-4f42-ba7a-e423aa1e781c tempest-VolumesGetTestJSON-1781473134 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:35:39 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [req-13d895c6-c469-4038-a26c-2b62676ce2b8 req-a9f9c76a-c342-4f42-ba7a-e423aa1e781c tempest-VolumesGetTestJSON-1781473134 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:35:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-13d895c6-c469-4038-a26c-2b62676ce2b8 req-a9f9c76a-c342-4f42-ba7a-e423aa1e781c tempest-VolumesGetTestJSON-1781473134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f88c185c-d75f-41a5-a28f-bd6585a19831 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:39 devstack sudo[92729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f88c185c-d75f-41a5-a28f-bd6585a19831 1073741824 Jul 08 01:35:39 devstack sudo[92729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:39 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-ae2b1765-c4b0-45fb-80f3-14d0738b3a7f tempest-GroupsV314Test-254355112 None] Create group from source-group-cf09ff6a-353e-4837-ba4d-d098725efb9d completed successfully. Jul 08 01:35:40 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-a36062d9-96a2-4874-9998-0acab7ee5b69 tempest-GroupsV314Test-254355112 None] Acquiring lock "cinder-quobyte-35785fe0-ce09-48f4-b993-c46731f3c0c6" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:35:40 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-a36062d9-96a2-4874-9998-0acab7ee5b69 tempest-GroupsV314Test-254355112 None] Lock "cinder-quobyte-35785fe0-ce09-48f4-b993-c46731f3c0c6" acquired by "delete_volume" :: waited 0.019s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:35:40 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c00f39a-29cc-4f2d-87e0-2d4774f1bf1b]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:35:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a36062d9-96a2-4874-9998-0acab7ee5b69 tempest-GroupsV314Test-254355112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-35785fe0-ce09-48f4-b993-c46731f3c0c6 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:40 devstack sudo[92734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-35785fe0-ce09-48f4-b993-c46731f3c0c6 Jul 08 01:35:40 devstack sudo[92734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:40 devstack sudo[92729]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-13d895c6-c469-4038-a26c-2b62676ce2b8 req-a9f9c76a-c342-4f42-ba7a-e423aa1e781c tempest-VolumesGetTestJSON-1781473134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f88c185c-d75f-41a5-a28f-bd6585a19831 1073741824" returned: 0 in 0.995s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-13d895c6-c469-4038-a26c-2b62676ce2b8 req-a9f9c76a-c342-4f42-ba7a-e423aa1e781c tempest-VolumesGetTestJSON-1781473134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f88c185c-d75f-41a5-a28f-bd6585a19831 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:40 devstack sudo[92737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f88c185c-d75f-41a5-a28f-bd6585a19831 Jul 08 01:35:40 devstack sudo[92737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:41 devstack sudo[92734]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a36062d9-96a2-4874-9998-0acab7ee5b69 tempest-GroupsV314Test-254355112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-35785fe0-ce09-48f4-b993-c46731f3c0c6" returned: 0 in 0.887s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a36062d9-96a2-4874-9998-0acab7ee5b69 tempest-GroupsV314Test-254355112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-35785fe0-ce09-48f4-b993-c46731f3c0c6 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:41 devstack sudo[92743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-35785fe0-ce09-48f4-b993-c46731f3c0c6 Jul 08 01:35:41 devstack sudo[92743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:41 devstack sudo[92737]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-13d895c6-c469-4038-a26c-2b62676ce2b8 req-a9f9c76a-c342-4f42-ba7a-e423aa1e781c tempest-VolumesGetTestJSON-1781473134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f88c185c-d75f-41a5-a28f-bd6585a19831" returned: 0 in 0.652s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:41 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [req-13d895c6-c469-4038-a26c-2b62676ce2b8 req-a9f9c76a-c342-4f42-ba7a-e423aa1e781c tempest-VolumesGetTestJSON-1781473134 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:35:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-13d895c6-c469-4038-a26c-2b62676ce2b8 req-a9f9c76a-c342-4f42-ba7a-e423aa1e781c tempest-VolumesGetTestJSON-1781473134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:35:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-dbfd0b40-1ece-49cd-8006-ae5bf6211436 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.464s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:35:41 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-dbfd0b40-1ece-49cd-8006-ae5bf6211436 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1947753917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ff9ecdc-403d-4960-8335-023a1433e4cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2990ff3e6443462da7141c013a0de22d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:35:34Z,use_quota=True,user_id='9cdc4842fafb4a1f9b10995a4f9f4171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:35:41 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-dbfd0b40-1ece-49cd-8006-ae5bf6211436 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Creating volume 5ff9ecdc-403d-4960-8335-023a1433e4cc {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:35:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-dbfd0b40-1ece-49cd-8006-ae5bf6211436 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:35:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-dbfd0b40-1ece-49cd-8006-ae5bf6211436 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:35:41 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-dbfd0b40-1ece-49cd-8006-ae5bf6211436 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:35:41 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-dbfd0b40-1ece-49cd-8006-ae5bf6211436 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:35:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-dbfd0b40-1ece-49cd-8006-ae5bf6211436 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:35:41 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-dbfd0b40-1ece-49cd-8006-ae5bf6211436 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:35:41 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-dbfd0b40-1ece-49cd-8006-ae5bf6211436 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:35:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-dbfd0b40-1ece-49cd-8006-ae5bf6211436 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5ff9ecdc-403d-4960-8335-023a1433e4cc 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:41 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-13d895c6-c469-4038-a26c-2b62676ce2b8 req-a9f9c76a-c342-4f42-ba7a-e423aa1e781c tempest-VolumesGetTestJSON-1781473134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40700a2a-3b6f-4c1e-bf74-feb335992415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f88c185c-d75f-41a5-a28f-bd6585a19831', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:41 devstack sudo[92745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5ff9ecdc-403d-4960-8335-023a1433e4cc 1073741824 Jul 08 01:35:41 devstack sudo[92745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:41 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-13d895c6-c469-4038-a26c-2b62676ce2b8 req-a9f9c76a-c342-4f42-ba7a-e423aa1e781c tempest-VolumesGetTestJSON-1781473134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b722a23-a857-4c96-b098-1b4d7835192c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:41 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [req-13d895c6-c469-4038-a26c-2b62676ce2b8 req-a9f9c76a-c342-4f42-ba7a-e423aa1e781c tempest-VolumesGetTestJSON-1781473134 None] Volume volume-f88c185c-d75f-41a5-a28f-bd6585a19831 (f88c185c-d75f-41a5-a28f-bd6585a19831): created successfully Jul 08 01:35:41 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-13d895c6-c469-4038-a26c-2b62676ce2b8 req-a9f9c76a-c342-4f42-ba7a-e423aa1e781c tempest-VolumesGetTestJSON-1781473134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b722a23-a857-4c96-b098-1b4d7835192c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:41 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-13d895c6-c469-4038-a26c-2b62676ce2b8 req-a9f9c76a-c342-4f42-ba7a-e423aa1e781c tempest-VolumesGetTestJSON-1781473134 None] Flow 'volume_create_manager' (85c760b1-b43a-4af5-99dc-d59a45cb99b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:35:41 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-13d895c6-c469-4038-a26c-2b62676ce2b8 req-a9f9c76a-c342-4f42-ba7a-e423aa1e781c tempest-VolumesGetTestJSON-1781473134 None] Created volume successfully. Jul 08 01:35:41 devstack sudo[92743]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a36062d9-96a2-4874-9998-0acab7ee5b69 tempest-GroupsV314Test-254355112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-35785fe0-ce09-48f4-b993-c46731f3c0c6" returned: 0 in 0.785s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:41 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-a36062d9-96a2-4874-9998-0acab7ee5b69 tempest-GroupsV314Test-254355112 None] Lock "cinder-quobyte-35785fe0-ce09-48f4-b993-c46731f3c0c6" released by "delete_volume" :: held 1.719s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:35:41 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-a36062d9-96a2-4874-9998-0acab7ee5b69 tempest-GroupsV314Test-254355112 None] Created reservations ['ae7e18a9-23c9-4918-ae7a-8a7f3ca13397'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:35:42 devstack cinder-volume[87284]: WARNING cinder.quota [None req-a36062d9-96a2-4874-9998-0acab7ee5b69 tempest-GroupsV314Test-254355112 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-343280564 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-343280564, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:35:42 devstack cinder-volume[87284]: WARNING cinder.quota [None req-a36062d9-96a2-4874-9998-0acab7ee5b69 tempest-GroupsV314Test-254355112 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-343280564 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-343280564, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:35:42 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-a36062d9-96a2-4874-9998-0acab7ee5b69 tempest-GroupsV314Test-254355112 None] Created reservations ['0744e149-985b-46e6-8c80-4352047af6d0', '6d5b9478-bf92-4034-b9b1-c46f83feb0cf', '90d4ba96-d801-4f55-85bf-44e425912528', '64e32b94-381d-47f9-88f9-6fbc7167df65'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:35:42 devstack sudo[92745]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-dbfd0b40-1ece-49cd-8006-ae5bf6211436 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5ff9ecdc-403d-4960-8335-023a1433e4cc 1073741824" returned: 0 in 0.947s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a36062d9-96a2-4874-9998-0acab7ee5b69 tempest-GroupsV314Test-254355112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:35:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a36062d9-96a2-4874-9998-0acab7ee5b69 tempest-GroupsV314Test-254355112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:35:42 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a36062d9-96a2-4874-9998-0acab7ee5b69 tempest-GroupsV314Test-254355112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:35:42 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a36062d9-96a2-4874-9998-0acab7ee5b69 tempest-GroupsV314Test-254355112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:35:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a36062d9-96a2-4874-9998-0acab7ee5b69 tempest-GroupsV314Test-254355112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:35:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a36062d9-96a2-4874-9998-0acab7ee5b69 tempest-GroupsV314Test-254355112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:42 devstack sudo[92754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:35:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-dbfd0b40-1ece-49cd-8006-ae5bf6211436 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5ff9ecdc-403d-4960-8335-023a1433e4cc {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:42 devstack sudo[92754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:42 devstack sudo[92756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5ff9ecdc-403d-4960-8335-023a1433e4cc Jul 08 01:35:42 devstack sudo[92756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:42 devstack cinder-volume[87284]: DEBUG cinder.coordination [req-84f6f5b6-a485-4429-a438-c5870d7564e6 req-2db9fb60-a9af-4a60-89e3-d4bf37ed1981 tempest-VolumesGetTestJSON-1781473134 None] Acquiring lock "cinder-f88c185c-d75f-41a5-a28f-bd6585a19831-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:35:42 devstack cinder-volume[87284]: DEBUG cinder.coordination [req-84f6f5b6-a485-4429-a438-c5870d7564e6 req-2db9fb60-a9af-4a60-89e3-d4bf37ed1981 tempest-VolumesGetTestJSON-1781473134 None] Lock "cinder-f88c185c-d75f-41a5-a28f-bd6585a19831-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:35:42 devstack cinder-volume[87284]: DEBUG cinder.coordination [req-84f6f5b6-a485-4429-a438-c5870d7564e6 req-2db9fb60-a9af-4a60-89e3-d4bf37ed1981 tempest-VolumesGetTestJSON-1781473134 None] Acquiring lock "cinder-quobyte-f88c185c-d75f-41a5-a28f-bd6585a19831" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:35:42 devstack cinder-volume[87284]: DEBUG cinder.coordination [req-84f6f5b6-a485-4429-a438-c5870d7564e6 req-2db9fb60-a9af-4a60-89e3-d4bf37ed1981 tempest-VolumesGetTestJSON-1781473134 None] Lock "cinder-quobyte-f88c185c-d75f-41a5-a28f-bd6585a19831" acquired by "delete_volume" :: waited 0.017s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:35:42 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[450d984f-8959-4a81-8ebc-346cff4e4d5e]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:35:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-84f6f5b6-a485-4429-a438-c5870d7564e6 req-2db9fb60-a9af-4a60-89e3-d4bf37ed1981 tempest-VolumesGetTestJSON-1781473134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f88c185c-d75f-41a5-a28f-bd6585a19831 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:43 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-69caa453-f93f-4b5a-864e-cf5bac77948e tempest-GroupsV314Test-254355112 None] Acquiring lock "cinder-quobyte-1fba4448-a3f7-4280-abd7-74dabae4a644" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:35:43 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-69caa453-f93f-4b5a-864e-cf5bac77948e tempest-GroupsV314Test-254355112 None] Lock "cinder-quobyte-1fba4448-a3f7-4280-abd7-74dabae4a644" acquired by "delete_volume" :: waited 0.027s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:35:43 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b2a1c8-4254-4c8a-b57e-ab56cce739b1]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:35:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-69caa453-f93f-4b5a-864e-cf5bac77948e tempest-GroupsV314Test-254355112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:43 devstack sudo[92759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f88c185c-d75f-41a5-a28f-bd6585a19831 Jul 08 01:35:43 devstack sudo[92759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:43 devstack sudo[92754]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a36062d9-96a2-4874-9998-0acab7ee5b69 tempest-GroupsV314Test-254355112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.065s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:43 devstack sudo[92756]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:43 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-a36062d9-96a2-4874-9998-0acab7ee5b69 tempest-GroupsV314Test-254355112 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:35:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-dbfd0b40-1ece-49cd-8006-ae5bf6211436 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5ff9ecdc-403d-4960-8335-023a1433e4cc" returned: 0 in 1.038s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:43 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-dbfd0b40-1ece-49cd-8006-ae5bf6211436 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] <== create_volume: return (2052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:35:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-dbfd0b40-1ece-49cd-8006-ae5bf6211436 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.056s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:35:43 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-a36062d9-96a2-4874-9998-0acab7ee5b69 tempest-GroupsV314Test-254355112 None] Delete group completed successfully. Jul 08 01:35:43 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-dbfd0b40-1ece-49cd-8006-ae5bf6211436 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a80404d-7fc6-4f8b-acd9-6d6c63639f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ff9ecdc-403d-4960-8335-023a1433e4cc', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:43 devstack sudo[92762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644 Jul 08 01:35:43 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-dbfd0b40-1ece-49cd-8006-ae5bf6211436 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40b9cb61-d92f-4fdc-aac9-0fe9d2f8c8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:43 devstack sudo[92762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:43 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-dbfd0b40-1ece-49cd-8006-ae5bf6211436 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Volume volume-5ff9ecdc-403d-4960-8335-023a1433e4cc (5ff9ecdc-403d-4960-8335-023a1433e4cc): created successfully Jul 08 01:35:43 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-dbfd0b40-1ece-49cd-8006-ae5bf6211436 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40b9cb61-d92f-4fdc-aac9-0fe9d2f8c8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:43 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-dbfd0b40-1ece-49cd-8006-ae5bf6211436 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Flow 'volume_create_manager' (bf6a1a3b-f508-4835-bac8-c7cf86a427c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:35:43 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-dbfd0b40-1ece-49cd-8006-ae5bf6211436 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Created volume successfully. Jul 08 01:35:43 devstack sudo[92759]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-84f6f5b6-a485-4429-a438-c5870d7564e6 req-2db9fb60-a9af-4a60-89e3-d4bf37ed1981 tempest-VolumesGetTestJSON-1781473134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f88c185c-d75f-41a5-a28f-bd6585a19831" returned: 0 in 0.933s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-84f6f5b6-a485-4429-a438-c5870d7564e6 req-2db9fb60-a9af-4a60-89e3-d4bf37ed1981 tempest-VolumesGetTestJSON-1781473134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f88c185c-d75f-41a5-a28f-bd6585a19831 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:43 devstack sudo[92775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f88c185c-d75f-41a5-a28f-bd6585a19831 Jul 08 01:35:43 devstack sudo[92775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:44 devstack sudo[92762]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-69caa453-f93f-4b5a-864e-cf5bac77948e tempest-GroupsV314Test-254355112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644" returned: 0 in 1.026s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-69caa453-f93f-4b5a-864e-cf5bac77948e tempest-GroupsV314Test-254355112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:44 devstack sudo[92779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644 Jul 08 01:35:44 devstack sudo[92779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:44 devstack sudo[92775]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-84f6f5b6-a485-4429-a438-c5870d7564e6 req-2db9fb60-a9af-4a60-89e3-d4bf37ed1981 tempest-VolumesGetTestJSON-1781473134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f88c185c-d75f-41a5-a28f-bd6585a19831" returned: 0 in 1.010s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:44 devstack cinder-volume[87284]: DEBUG cinder.coordination [req-84f6f5b6-a485-4429-a438-c5870d7564e6 req-2db9fb60-a9af-4a60-89e3-d4bf37ed1981 tempest-VolumesGetTestJSON-1781473134 None] Lock "cinder-quobyte-f88c185c-d75f-41a5-a28f-bd6585a19831" released by "delete_volume" :: held 2.052s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:35:45 devstack cinder-volume[87284]: DEBUG cinder.quota [req-84f6f5b6-a485-4429-a438-c5870d7564e6 req-2db9fb60-a9af-4a60-89e3-d4bf37ed1981 tempest-VolumesGetTestJSON-1781473134 None] Created reservations ['ddbfce7a-6a8d-4732-9ec9-85bad2055afd', 'cc119c9c-3380-4fb7-84c8-e28fe8ed2055', '338387dc-f011-4c00-be5b-9a6547ce24a2', '232ca96f-b205-4816-a320-3b2beec30e0f'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:35:45 devstack sudo[92779]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-69caa453-f93f-4b5a-864e-cf5bac77948e tempest-GroupsV314Test-254355112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1fba4448-a3f7-4280-abd7-74dabae4a644" returned: 0 in 1.049s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:45 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-69caa453-f93f-4b5a-864e-cf5bac77948e tempest-GroupsV314Test-254355112 None] Lock "cinder-quobyte-1fba4448-a3f7-4280-abd7-74dabae4a644" released by "delete_volume" :: held 2.179s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:35:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-84f6f5b6-a485-4429-a438-c5870d7564e6 req-2db9fb60-a9af-4a60-89e3-d4bf37ed1981 tempest-VolumesGetTestJSON-1781473134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:35:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-84f6f5b6-a485-4429-a438-c5870d7564e6 req-2db9fb60-a9af-4a60-89e3-d4bf37ed1981 tempest-VolumesGetTestJSON-1781473134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:35:45 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [req-84f6f5b6-a485-4429-a438-c5870d7564e6 req-2db9fb60-a9af-4a60-89e3-d4bf37ed1981 tempest-VolumesGetTestJSON-1781473134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:35:45 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [req-84f6f5b6-a485-4429-a438-c5870d7564e6 req-2db9fb60-a9af-4a60-89e3-d4bf37ed1981 tempest-VolumesGetTestJSON-1781473134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:35:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-84f6f5b6-a485-4429-a438-c5870d7564e6 req-2db9fb60-a9af-4a60-89e3-d4bf37ed1981 tempest-VolumesGetTestJSON-1781473134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:35:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-84f6f5b6-a485-4429-a438-c5870d7564e6 req-2db9fb60-a9af-4a60-89e3-d4bf37ed1981 tempest-VolumesGetTestJSON-1781473134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:45 devstack sudo[92800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:35:45 devstack sudo[92800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:45 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-69caa453-f93f-4b5a-864e-cf5bac77948e tempest-GroupsV314Test-254355112 None] Created reservations ['f3362ff2-650b-4e9d-9a2a-27bcdf8aa2d3'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:35:45 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-69caa453-f93f-4b5a-864e-cf5bac77948e tempest-GroupsV314Test-254355112 None] Created reservations ['81343897-ab47-470d-ac49-fff0cab7bc03', 'd130af97-ee80-4628-b4fa-8bc9a3a322a4', 'b0351b91-e03d-4e36-9ef6-ab3bed9b4336', 'fe3a7521-1c6a-4a87-ab52-9d09cc4ac472'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:35:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-69caa453-f93f-4b5a-864e-cf5bac77948e tempest-GroupsV314Test-254355112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:35:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-69caa453-f93f-4b5a-864e-cf5bac77948e tempest-GroupsV314Test-254355112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:35:45 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-69caa453-f93f-4b5a-864e-cf5bac77948e tempest-GroupsV314Test-254355112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:35:45 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-69caa453-f93f-4b5a-864e-cf5bac77948e tempest-GroupsV314Test-254355112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:35:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-69caa453-f93f-4b5a-864e-cf5bac77948e tempest-GroupsV314Test-254355112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:35:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-69caa453-f93f-4b5a-864e-cf5bac77948e tempest-GroupsV314Test-254355112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:45 devstack sudo[92803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:35:45 devstack sudo[92803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:45 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3c279799-d56f-4b36-85d3-7ceccd164eb2 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Acquiring lock "cinder-5ff9ecdc-403d-4960-8335-023a1433e4cc-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:35:45 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3c279799-d56f-4b36-85d3-7ceccd164eb2 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Lock "cinder-5ff9ecdc-403d-4960-8335-023a1433e4cc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:35:45 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3c279799-d56f-4b36-85d3-7ceccd164eb2 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Acquiring lock "cinder-quobyte-5ff9ecdc-403d-4960-8335-023a1433e4cc" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:35:46 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3c279799-d56f-4b36-85d3-7ceccd164eb2 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Lock "cinder-quobyte-5ff9ecdc-403d-4960-8335-023a1433e4cc" acquired by "delete_volume" :: waited 0.027s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:35:46 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[388fc252-365b-4a98-9717-9b578b28ac51]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:35:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3c279799-d56f-4b36-85d3-7ceccd164eb2 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5ff9ecdc-403d-4960-8335-023a1433e4cc {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:46 devstack sudo[92805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5ff9ecdc-403d-4960-8335-023a1433e4cc Jul 08 01:35:46 devstack sudo[92805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:46 devstack sudo[92800]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-84f6f5b6-a485-4429-a438-c5870d7564e6 req-2db9fb60-a9af-4a60-89e3-d4bf37ed1981 tempest-VolumesGetTestJSON-1781473134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.102s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:46 devstack cinder-volume[87284]: DEBUG cinder.manager [req-84f6f5b6-a485-4429-a438-c5870d7564e6 req-2db9fb60-a9af-4a60-89e3-d4bf37ed1981 tempest-VolumesGetTestJSON-1781473134 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:35:46 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-84f6f5b6-a485-4429-a438-c5870d7564e6 req-2db9fb60-a9af-4a60-89e3-d4bf37ed1981 tempest-VolumesGetTestJSON-1781473134 None] Deleted volume successfully. Jul 08 01:35:46 devstack cinder-volume[87284]: DEBUG cinder.coordination [req-84f6f5b6-a485-4429-a438-c5870d7564e6 req-2db9fb60-a9af-4a60-89e3-d4bf37ed1981 tempest-VolumesGetTestJSON-1781473134 None] Lock "cinder-f88c185c-d75f-41a5-a28f-bd6585a19831-delete_volume" released by "delete_volume" :: held 3.599s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:35:46 devstack sudo[92803]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-69caa453-f93f-4b5a-864e-cf5bac77948e tempest-GroupsV314Test-254355112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.845s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:46 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-69caa453-f93f-4b5a-864e-cf5bac77948e tempest-GroupsV314Test-254355112 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:35:46 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-69caa453-f93f-4b5a-864e-cf5bac77948e tempest-GroupsV314Test-254355112 None] Delete group completed successfully. Jul 08 01:35:47 devstack sudo[92805]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3c279799-d56f-4b36-85d3-7ceccd164eb2 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5ff9ecdc-403d-4960-8335-023a1433e4cc" returned: 0 in 1.122s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3c279799-d56f-4b36-85d3-7ceccd164eb2 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5ff9ecdc-403d-4960-8335-023a1433e4cc {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:47 devstack sudo[92814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5ff9ecdc-403d-4960-8335-023a1433e4cc Jul 08 01:35:47 devstack sudo[92814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:47 devstack sudo[92814]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3c279799-d56f-4b36-85d3-7ceccd164eb2 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5ff9ecdc-403d-4960-8335-023a1433e4cc" returned: 0 in 0.815s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:48 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3c279799-d56f-4b36-85d3-7ceccd164eb2 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Lock "cinder-quobyte-5ff9ecdc-403d-4960-8335-023a1433e4cc" released by "delete_volume" :: held 2.008s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:35:48 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-3c279799-d56f-4b36-85d3-7ceccd164eb2 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Created reservations ['e6e7090d-6fe6-4075-a31f-68a450206ee6', '76e8f1d9-b1f5-437d-9c17-1ce6790585b5', '6335580e-6d7e-445d-9954-b3a013002dc5', '14319f18-0eb2-4fe1-8214-798712d157b4'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:35:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3c279799-d56f-4b36-85d3-7ceccd164eb2 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:35:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3c279799-d56f-4b36-85d3-7ceccd164eb2 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:35:48 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3c279799-d56f-4b36-85d3-7ceccd164eb2 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:35:48 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3c279799-d56f-4b36-85d3-7ceccd164eb2 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:35:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3c279799-d56f-4b36-85d3-7ceccd164eb2 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:35:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3c279799-d56f-4b36-85d3-7ceccd164eb2 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:48 devstack sudo[92817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:35:48 devstack sudo[92817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:49 devstack sudo[92817]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3c279799-d56f-4b36-85d3-7ceccd164eb2 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.861s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:49 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-3c279799-d56f-4b36-85d3-7ceccd164eb2 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:35:49 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-3c279799-d56f-4b36-85d3-7ceccd164eb2 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Deleted volume successfully. Jul 08 01:35:49 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3c279799-d56f-4b36-85d3-7ceccd164eb2 tempest-VolumeQuotasNegativeTestJSON-1708411164 None] Lock "cinder-5ff9ecdc-403d-4960-8335-023a1433e4cc-delete_volume" released by "delete_volume" :: held 3.266s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:35:54 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-65ed2d74-1f05-4c15-a16c-a8370594228a tempest-SnapshotsActionsTest-2012801752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:35:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-65ed2d74-1f05-4c15-a16c-a8370594228a tempest-SnapshotsActionsTest-2012801752 None] Flow 'volume_create_manager' (2734c1ca-7113-4060-b308-4d7d7d0e8f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:35:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-65ed2d74-1f05-4c15-a16c-a8370594228a tempest-SnapshotsActionsTest-2012801752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7609ed9f-9bf9-4b7c-9a52-f58cf9697027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-65ed2d74-1f05-4c15-a16c-a8370594228a tempest-SnapshotsActionsTest-2012801752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7609ed9f-9bf9-4b7c-9a52-f58cf9697027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1930494185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=678fcb9f-5ef4-4cb4-8549-c1294d6e87e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5314c8cd3a3543f1950afa9771d5bd39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:35:54Z,use_quota=True,user_id='3a4b1ea8420045839779c68a0c917ab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-65ed2d74-1f05-4c15-a16c-a8370594228a tempest-SnapshotsActionsTest-2012801752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fb7ad09-281d-41f3-a1b5-1c667db9965c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-65ed2d74-1f05-4c15-a16c-a8370594228a tempest-SnapshotsActionsTest-2012801752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fb7ad09-281d-41f3-a1b5-1c667db9965c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-65ed2d74-1f05-4c15-a16c-a8370594228a tempest-SnapshotsActionsTest-2012801752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4ae977f-3d76-4233-9b21-73b3ca1651dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-65ed2d74-1f05-4c15-a16c-a8370594228a tempest-SnapshotsActionsTest-2012801752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4ae977f-3d76-4233-9b21-73b3ca1651dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '678fcb9f-5ef4-4cb4-8549-c1294d6e87e5', 'volume_name': 'volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-65ed2d74-1f05-4c15-a16c-a8370594228a tempest-SnapshotsActionsTest-2012801752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52b1ac5f-b508-46e6-9806-7c4d17373d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-65ed2d74-1f05-4c15-a16c-a8370594228a tempest-SnapshotsActionsTest-2012801752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52b1ac5f-b508-46e6-9806-7c4d17373d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-65ed2d74-1f05-4c15-a16c-a8370594228a tempest-SnapshotsActionsTest-2012801752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24888f6c-d830-4879-80c9-494e3fc64020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:54 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-65ed2d74-1f05-4c15-a16c-a8370594228a tempest-SnapshotsActionsTest-2012801752 None] Volume 678fcb9f-5ef4-4cb4-8549-c1294d6e87e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5', 'volume_size': 1} Jul 08 01:35:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-65ed2d74-1f05-4c15-a16c-a8370594228a tempest-SnapshotsActionsTest-2012801752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:35:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-65ed2d74-1f05-4c15-a16c-a8370594228a tempest-SnapshotsActionsTest-2012801752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:35:54 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-65ed2d74-1f05-4c15-a16c-a8370594228a tempest-SnapshotsActionsTest-2012801752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1930494185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=678fcb9f-5ef4-4cb4-8549-c1294d6e87e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5314c8cd3a3543f1950afa9771d5bd39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:35:54Z,use_quota=True,user_id='3a4b1ea8420045839779c68a0c917ab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:35:54 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-65ed2d74-1f05-4c15-a16c-a8370594228a tempest-SnapshotsActionsTest-2012801752 None] Creating volume 678fcb9f-5ef4-4cb4-8549-c1294d6e87e5 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:35:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-65ed2d74-1f05-4c15-a16c-a8370594228a tempest-SnapshotsActionsTest-2012801752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:35:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-65ed2d74-1f05-4c15-a16c-a8370594228a tempest-SnapshotsActionsTest-2012801752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:35:54 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-65ed2d74-1f05-4c15-a16c-a8370594228a tempest-SnapshotsActionsTest-2012801752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:35:54 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-65ed2d74-1f05-4c15-a16c-a8370594228a tempest-SnapshotsActionsTest-2012801752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:35:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-65ed2d74-1f05-4c15-a16c-a8370594228a tempest-SnapshotsActionsTest-2012801752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:35:54 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-65ed2d74-1f05-4c15-a16c-a8370594228a tempest-SnapshotsActionsTest-2012801752 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:35:54 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-65ed2d74-1f05-4c15-a16c-a8370594228a tempest-SnapshotsActionsTest-2012801752 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:35:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-65ed2d74-1f05-4c15-a16c-a8370594228a tempest-SnapshotsActionsTest-2012801752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:54 devstack sudo[92821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5 1073741824 Jul 08 01:35:54 devstack sudo[92821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:55 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:35:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:35:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:35:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:35:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:35:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:35:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:55 devstack sudo[92825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:35:55 devstack sudo[92825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:55 devstack sudo[92821]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-65ed2d74-1f05-4c15-a16c-a8370594228a tempest-SnapshotsActionsTest-2012801752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5 1073741824" returned: 0 in 1.245s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-65ed2d74-1f05-4c15-a16c-a8370594228a tempest-SnapshotsActionsTest-2012801752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:55 devstack sudo[92829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5 Jul 08 01:35:55 devstack sudo[92829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:56 devstack sudo[92825]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.030s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:56 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:35:56 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager._thread_info {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:35:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread count: 8 {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:35:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread info: [<_MainThread(MainThread, started 127058402500736)>, , , , , , , ] {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:35:56 devstack sudo[92829]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-65ed2d74-1f05-4c15-a16c-a8370594228a tempest-SnapshotsActionsTest-2012801752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5" returned: 0 in 1.031s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:56 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-65ed2d74-1f05-4c15-a16c-a8370594228a tempest-SnapshotsActionsTest-2012801752 None] <== create_volume: return (2352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:35:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-65ed2d74-1f05-4c15-a16c-a8370594228a tempest-SnapshotsActionsTest-2012801752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.358s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:35:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-65ed2d74-1f05-4c15-a16c-a8370594228a tempest-SnapshotsActionsTest-2012801752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24888f6c-d830-4879-80c9-494e3fc64020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-65ed2d74-1f05-4c15-a16c-a8370594228a tempest-SnapshotsActionsTest-2012801752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f531807-52b3-4cb0-9ef2-f061be314b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:56 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-65ed2d74-1f05-4c15-a16c-a8370594228a tempest-SnapshotsActionsTest-2012801752 None] Volume volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5 (678fcb9f-5ef4-4cb4-8549-c1294d6e87e5): created successfully Jul 08 01:35:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-65ed2d74-1f05-4c15-a16c-a8370594228a tempest-SnapshotsActionsTest-2012801752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f531807-52b3-4cb0-9ef2-f061be314b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-65ed2d74-1f05-4c15-a16c-a8370594228a tempest-SnapshotsActionsTest-2012801752 None] Flow 'volume_create_manager' (2734c1ca-7113-4060-b308-4d7d7d0e8f32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:35:56 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-65ed2d74-1f05-4c15-a16c-a8370594228a tempest-SnapshotsActionsTest-2012801752 None] Created volume successfully. Jul 08 01:35:56 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-9053bcc6-1183-4612-ac03-f2230b161300 tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:35:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9053bcc6-1183-4612-ac03-f2230b161300 tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Flow 'volume_create_manager' (e04e4da0-f14d-43af-8399-f428baa69997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:35:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9053bcc6-1183-4612-ac03-f2230b161300 tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d4b074-da55-4223-abd7-0ca6c4b5ac2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9053bcc6-1183-4612-ac03-f2230b161300 tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d4b074-da55-4223-abd7-0ca6c4b5ac2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1969961632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d43aff7-cc87-4bff-b230-a2a3501d041e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe986eaaa1141c9a11348aa01d48423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:35:57Z,use_quota=True,user_id='58d555c83bd54b429f6950490abd868c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(77bc2eb4-91c9-42d7-a73b-fee659458541),volume_type_id=77bc2eb4-91c9-42d7-a73b-fee659458541)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9053bcc6-1183-4612-ac03-f2230b161300 tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a3fae4f-db61-456b-8db7-4e158828e0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9053bcc6-1183-4612-ac03-f2230b161300 tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a3fae4f-db61-456b-8db7-4e158828e0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9053bcc6-1183-4612-ac03-f2230b161300 tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d0b653-e1db-4f34-a5d0-de06b7ad12d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9053bcc6-1183-4612-ac03-f2230b161300 tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d0b653-e1db-4f34-a5d0-de06b7ad12d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d43aff7-cc87-4bff-b230-a2a3501d041e', 'volume_name': 'volume-4d43aff7-cc87-4bff-b230-a2a3501d041e', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9053bcc6-1183-4612-ac03-f2230b161300 tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a207e9f-08c9-47ed-99cb-98ddf2a830e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9053bcc6-1183-4612-ac03-f2230b161300 tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a207e9f-08c9-47ed-99cb-98ddf2a830e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9053bcc6-1183-4612-ac03-f2230b161300 tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdc4427c-6e72-45f8-8407-44ae8a8e0d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:57 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-9053bcc6-1183-4612-ac03-f2230b161300 tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Volume 4d43aff7-cc87-4bff-b230-a2a3501d041e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d43aff7-cc87-4bff-b230-a2a3501d041e', 'volume_size': 1} Jul 08 01:35:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-9053bcc6-1183-4612-ac03-f2230b161300 tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:35:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-9053bcc6-1183-4612-ac03-f2230b161300 tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:35:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-9053bcc6-1183-4612-ac03-f2230b161300 tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1969961632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d43aff7-cc87-4bff-b230-a2a3501d041e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe986eaaa1141c9a11348aa01d48423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:35:57Z,use_quota=True,user_id='58d555c83bd54b429f6950490abd868c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(77bc2eb4-91c9-42d7-a73b-fee659458541),volume_type_id=77bc2eb4-91c9-42d7-a73b-fee659458541)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:35:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-9053bcc6-1183-4612-ac03-f2230b161300 tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Creating volume 4d43aff7-cc87-4bff-b230-a2a3501d041e {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:35:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-9053bcc6-1183-4612-ac03-f2230b161300 tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:35:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-9053bcc6-1183-4612-ac03-f2230b161300 tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:35:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-9053bcc6-1183-4612-ac03-f2230b161300 tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:35:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-9053bcc6-1183-4612-ac03-f2230b161300 tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:35:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-9053bcc6-1183-4612-ac03-f2230b161300 tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:35:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-9053bcc6-1183-4612-ac03-f2230b161300 tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:35:57 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-9053bcc6-1183-4612-ac03-f2230b161300 tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:35:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9053bcc6-1183-4612-ac03-f2230b161300 tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4d43aff7-cc87-4bff-b230-a2a3501d041e 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:57 devstack sudo[92836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4d43aff7-cc87-4bff-b230-a2a3501d041e 1073741824 Jul 08 01:35:57 devstack sudo[92836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4c597bef-31f8-4505-b8aa-d74db5df56ec tempest-SnapshotsActionsTest-2012801752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:35:58 devstack sudo[92836]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9053bcc6-1183-4612-ac03-f2230b161300 tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4d43aff7-cc87-4bff-b230-a2a3501d041e 1073741824" returned: 0 in 1.072s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9053bcc6-1183-4612-ac03-f2230b161300 tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4d43aff7-cc87-4bff-b230-a2a3501d041e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:58 devstack sudo[92846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4d43aff7-cc87-4bff-b230-a2a3501d041e Jul 08 01:35:58 devstack sudo[92846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:58 devstack sudo[92846]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9053bcc6-1183-4612-ac03-f2230b161300 tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4d43aff7-cc87-4bff-b230-a2a3501d041e" returned: 0 in 0.734s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:58 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-9053bcc6-1183-4612-ac03-f2230b161300 tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] <== create_volume: return (1853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:35:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-9053bcc6-1183-4612-ac03-f2230b161300 tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.855s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:35:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4c597bef-31f8-4505-b8aa-d74db5df56ec tempest-SnapshotsActionsTest-2012801752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.090s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:35:58 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-4c597bef-31f8-4505-b8aa-d74db5df56ec tempest-SnapshotsActionsTest-2012801752 None] Creating offline snapshot 1618c208-7185-4df6-b1b4-45258ee49cf5 of volume 678fcb9f-5ef4-4cb4-8549-c1294d6e87e5 {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:35:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9053bcc6-1183-4612-ac03-f2230b161300 tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdc4427c-6e72-45f8-8407-44ae8a8e0d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d43aff7-cc87-4bff-b230-a2a3501d041e', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9053bcc6-1183-4612-ac03-f2230b161300 tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf3def1-328c-4529-a9ce-e97fa629755d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:35:59 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50c4e45-c1c9-4cfc-80e7-890924f92e70]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:35:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4c597bef-31f8-4505-b8aa-d74db5df56ec tempest-SnapshotsActionsTest-2012801752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:35:59 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-9053bcc6-1183-4612-ac03-f2230b161300 tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Volume volume-4d43aff7-cc87-4bff-b230-a2a3501d041e (4d43aff7-cc87-4bff-b230-a2a3501d041e): created successfully Jul 08 01:35:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9053bcc6-1183-4612-ac03-f2230b161300 tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf3def1-328c-4529-a9ce-e97fa629755d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:35:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9053bcc6-1183-4612-ac03-f2230b161300 tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Flow 'volume_create_manager' (e04e4da0-f14d-43af-8399-f428baa69997) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:35:59 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-9053bcc6-1183-4612-ac03-f2230b161300 tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Created volume successfully. Jul 08 01:35:59 devstack sudo[92849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5 Jul 08 01:35:59 devstack sudo[92849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:35:59 devstack sudo[92849]: pam_unix(sudo:session): session closed for user root Jul 08 01:35:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4c597bef-31f8-4505-b8aa-d74db5df56ec tempest-SnapshotsActionsTest-2012801752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5" returned: 0 in 0.951s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:35:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4c597bef-31f8-4505-b8aa-d74db5df56ec tempest-SnapshotsActionsTest-2012801752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:00 devstack sudo[92854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 1G Jul 08 01:36:00 devstack sudo[92854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4b3896e7-d850-483c-bd0e-f89a9809d32c tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4b3896e7-d850-483c-bd0e-f89a9809d32c tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-4b3896e7-d850-483c-bd0e-f89a9809d32c tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:36:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-4b3896e7-d850-483c-bd0e-f89a9809d32c tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:36:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4b3896e7-d850-483c-bd0e-f89a9809d32c tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4b3896e7-d850-483c-bd0e-f89a9809d32c tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:00 devstack sudo[92859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:36:00 devstack sudo[92859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:01 devstack sudo[92854]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4c597bef-31f8-4505-b8aa-d74db5df56ec tempest-SnapshotsActionsTest-2012801752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 1G" returned: 0 in 1.204s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4c597bef-31f8-4505-b8aa-d74db5df56ec tempest-SnapshotsActionsTest-2012801752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:01 devstack sudo[92863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 Jul 08 01:36:01 devstack sudo[92863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:01 devstack sudo[92859]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4b3896e7-d850-483c-bd0e-f89a9809d32c tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.896s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:01 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-4b3896e7-d850-483c-bd0e-f89a9809d32c tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:36:01 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-4b3896e7-d850-483c-bd0e-f89a9809d32c tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Retype volume completed successfully. Jul 08 01:36:02 devstack sudo[92863]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4c597bef-31f8-4505-b8aa-d74db5df56ec tempest-SnapshotsActionsTest-2012801752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5" returned: 0 in 1.066s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:02 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-4c597bef-31f8-4505-b8aa-d74db5df56ec tempest-SnapshotsActionsTest-2012801752 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 is being set with open permissions: ugo+rw Jul 08 01:36:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4c597bef-31f8-4505-b8aa-d74db5df56ec tempest-SnapshotsActionsTest-2012801752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:02 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-61053c14-dc49-4335-9753-ed56ed60ffdb tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Acquiring lock "cinder-4d43aff7-cc87-4bff-b230-a2a3501d041e-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:02 devstack sudo[92869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 Jul 08 01:36:02 devstack sudo[92869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:02 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-61053c14-dc49-4335-9753-ed56ed60ffdb tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Lock "cinder-4d43aff7-cc87-4bff-b230-a2a3501d041e-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:02 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-61053c14-dc49-4335-9753-ed56ed60ffdb tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Acquiring lock "cinder-quobyte-4d43aff7-cc87-4bff-b230-a2a3501d041e" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:02 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-61053c14-dc49-4335-9753-ed56ed60ffdb tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Lock "cinder-quobyte-4d43aff7-cc87-4bff-b230-a2a3501d041e" acquired by "delete_volume" :: waited 0.024s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:02 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a725111-9b11-484d-8f46-5d534dcfff16]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:36:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-61053c14-dc49-4335-9753-ed56ed60ffdb tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4d43aff7-cc87-4bff-b230-a2a3501d041e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:02 devstack sudo[92871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4d43aff7-cc87-4bff-b230-a2a3501d041e Jul 08 01:36:02 devstack sudo[92871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:03 devstack sudo[92869]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4c597bef-31f8-4505-b8aa-d74db5df56ec tempest-SnapshotsActionsTest-2012801752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5" returned: 0 in 1.233s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4c597bef-31f8-4505-b8aa-d74db5df56ec tempest-SnapshotsActionsTest-2012801752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:03 devstack sudo[92874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.info Jul 08 01:36:03 devstack sudo[92874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:03 devstack sudo[92871]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-61053c14-dc49-4335-9753-ed56ed60ffdb tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4d43aff7-cc87-4bff-b230-a2a3501d041e" returned: 0 in 1.414s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-61053c14-dc49-4335-9753-ed56ed60ffdb tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4d43aff7-cc87-4bff-b230-a2a3501d041e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:03 devstack sudo[92880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4d43aff7-cc87-4bff-b230-a2a3501d041e Jul 08 01:36:03 devstack sudo[92880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:04 devstack sudo[92874]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4c597bef-31f8-4505-b8aa-d74db5df56ec tempest-SnapshotsActionsTest-2012801752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.info" returned: 0 in 0.858s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:04 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-4c597bef-31f8-4505-b8aa-d74db5df56ec tempest-SnapshotsActionsTest-2012801752 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.info is being set with open permissions: ugo+rw Jul 08 01:36:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4c597bef-31f8-4505-b8aa-d74db5df56ec tempest-SnapshotsActionsTest-2012801752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:04 devstack sudo[92894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.info Jul 08 01:36:04 devstack sudo[92894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:04 devstack sudo[92880]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-61053c14-dc49-4335-9753-ed56ed60ffdb tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4d43aff7-cc87-4bff-b230-a2a3501d041e" returned: 0 in 0.895s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:04 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-61053c14-dc49-4335-9753-ed56ed60ffdb tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Lock "cinder-quobyte-4d43aff7-cc87-4bff-b230-a2a3501d041e" released by "delete_volume" :: held 2.368s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:04 devstack cinder-volume[87284]: WARNING cinder.quota [None req-61053c14-dc49-4335-9753-ed56ed60ffdb tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:36:04 devstack cinder-volume[87284]: WARNING cinder.quota [None req-61053c14-dc49-4335-9753-ed56ed60ffdb tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:36:04 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-61053c14-dc49-4335-9753-ed56ed60ffdb tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Created reservations ['5ce593ba-7755-4a3c-863d-adbca398736b', 'e10bdeca-61ff-4666-b8d8-9678d9baa4a1', '3b7b09b5-f224-4d35-b60b-215f39e39f0a', '403ccaf0-6ccf-4a97-86d0-35858fe6a80f'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:36:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-61053c14-dc49-4335-9753-ed56ed60ffdb tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-61053c14-dc49-4335-9753-ed56ed60ffdb tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:04 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-61053c14-dc49-4335-9753-ed56ed60ffdb tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:36:04 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-61053c14-dc49-4335-9753-ed56ed60ffdb tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:36:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-61053c14-dc49-4335-9753-ed56ed60ffdb tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-61053c14-dc49-4335-9753-ed56ed60ffdb tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:04 devstack sudo[92904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:36:04 devstack sudo[92904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:05 devstack sudo[92894]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4c597bef-31f8-4505-b8aa-d74db5df56ec tempest-SnapshotsActionsTest-2012801752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.info" returned: 0 in 0.892s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4c597bef-31f8-4505-b8aa-d74db5df56ec tempest-SnapshotsActionsTest-2012801752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.390s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:05 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-4c597bef-31f8-4505-b8aa-d74db5df56ec tempest-SnapshotsActionsTest-2012801752 None] Create snapshot completed successfully Jul 08 01:36:05 devstack sudo[92904]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-61053c14-dc49-4335-9753-ed56ed60ffdb tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.769s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:05 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-61053c14-dc49-4335-9753-ed56ed60ffdb tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:36:05 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-61053c14-dc49-4335-9753-ed56ed60ffdb tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Deleted volume successfully. Jul 08 01:36:05 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-61053c14-dc49-4335-9753-ed56ed60ffdb tempest-VolumeRetypeWithoutMigrationTest-1887667644 None] Lock "cinder-4d43aff7-cc87-4bff-b230-a2a3501d041e-delete_volume" released by "delete_volume" :: held 3.444s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2c96cf7e-a999-44c4-a37b-d6f0d4670860 tempest-SnapshotsActionsTest-2012801752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2c96cf7e-a999-44c4-a37b-d6f0d4670860 tempest-SnapshotsActionsTest-2012801752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:07 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-2c96cf7e-a999-44c4-a37b-d6f0d4670860 tempest-SnapshotsActionsTest-2012801752 None] Creating offline snapshot 0e01ce9a-288a-4670-a9e0-cc53e9ea9ada of volume 678fcb9f-5ef4-4cb4-8549-c1294d6e87e5 {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:36:07 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[149e3971-bff9-42a9-95a9-4d977f86d4e1]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:36:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2c96cf7e-a999-44c4-a37b-d6f0d4670860 tempest-SnapshotsActionsTest-2012801752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:07 devstack sudo[92908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 Jul 08 01:36:07 devstack sudo[92908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:08 devstack sudo[92908]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2c96cf7e-a999-44c4-a37b-d6f0d4670860 tempest-SnapshotsActionsTest-2012801752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5" returned: 0 in 1.262s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:08 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-2c96cf7e-a999-44c4-a37b-d6f0d4670860 tempest-SnapshotsActionsTest-2012801752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:36:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2c96cf7e-a999-44c4-a37b-d6f0d4670860 tempest-SnapshotsActionsTest-2012801752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.0e01ce9a-288a-4670-a9e0-cc53e9ea9ada 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:08 devstack sudo[92948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.0e01ce9a-288a-4670-a9e0-cc53e9ea9ada 1G Jul 08 01:36:08 devstack sudo[92948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:10 devstack sudo[92948]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2c96cf7e-a999-44c4-a37b-d6f0d4670860 tempest-SnapshotsActionsTest-2012801752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.0e01ce9a-288a-4670-a9e0-cc53e9ea9ada 1G" returned: 0 in 1.302s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2c96cf7e-a999-44c4-a37b-d6f0d4670860 tempest-SnapshotsActionsTest-2012801752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.0e01ce9a-288a-4670-a9e0-cc53e9ea9ada {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:10 devstack sudo[92984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.0e01ce9a-288a-4670-a9e0-cc53e9ea9ada Jul 08 01:36:10 devstack sudo[92984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:11 devstack sudo[92984]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2c96cf7e-a999-44c4-a37b-d6f0d4670860 tempest-SnapshotsActionsTest-2012801752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.0e01ce9a-288a-4670-a9e0-cc53e9ea9ada" returned: 0 in 1.350s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:11 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-2c96cf7e-a999-44c4-a37b-d6f0d4670860 tempest-SnapshotsActionsTest-2012801752 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.0e01ce9a-288a-4670-a9e0-cc53e9ea9ada is being set with open permissions: ugo+rw Jul 08 01:36:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2c96cf7e-a999-44c4-a37b-d6f0d4670860 tempest-SnapshotsActionsTest-2012801752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.0e01ce9a-288a-4670-a9e0-cc53e9ea9ada {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:11 devstack sudo[92993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.0e01ce9a-288a-4670-a9e0-cc53e9ea9ada Jul 08 01:36:11 devstack sudo[92993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:12 devstack sudo[92993]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2c96cf7e-a999-44c4-a37b-d6f0d4670860 tempest-SnapshotsActionsTest-2012801752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.0e01ce9a-288a-4670-a9e0-cc53e9ea9ada" returned: 0 in 1.109s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2c96cf7e-a999-44c4-a37b-d6f0d4670860 tempest-SnapshotsActionsTest-2012801752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.171s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:12 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-2c96cf7e-a999-44c4-a37b-d6f0d4670860 tempest-SnapshotsActionsTest-2012801752 None] Create snapshot completed successfully Jul 08 01:36:13 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ad7131e6-bf67-4564-ae8b-4a0bda30ad18 tempest-SnapshotsActionsTest-579051250 None] Acquiring lock "cinder-0e01ce9a-288a-4670-a9e0-cc53e9ea9ada-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:13 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ad7131e6-bf67-4564-ae8b-4a0bda30ad18 tempest-SnapshotsActionsTest-579051250 None] Lock "cinder-0e01ce9a-288a-4670-a9e0-cc53e9ea9ada-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:13 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ad7131e6-bf67-4564-ae8b-4a0bda30ad18 tempest-SnapshotsActionsTest-579051250 None] Acquiring lock "cinder-quobyte-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:13 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ad7131e6-bf67-4564-ae8b-4a0bda30ad18 tempest-SnapshotsActionsTest-579051250 None] Lock "cinder-quobyte-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:13 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ad7131e6-bf67-4564-ae8b-4a0bda30ad18 tempest-SnapshotsActionsTest-579051250 None] Acquiring lock "cinder-quobyte-0e01ce9a-288a-4670-a9e0-cc53e9ea9ada" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:13 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ad7131e6-bf67-4564-ae8b-4a0bda30ad18 tempest-SnapshotsActionsTest-579051250 None] Lock "cinder-quobyte-0e01ce9a-288a-4670-a9e0-cc53e9ea9ada" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:13 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-ad7131e6-bf67-4564-ae8b-4a0bda30ad18 tempest-SnapshotsActionsTest-579051250 None] Deleting offline snapshot 0e01ce9a-288a-4670-a9e0-cc53e9ea9ada of volume 678fcb9f-5ef4-4cb4-8549-c1294d6e87e5 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:36:13 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-ad7131e6-bf67-4564-ae8b-4a0bda30ad18 tempest-SnapshotsActionsTest-579051250 None] snapshot_file for this snap is: volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.0e01ce9a-288a-4670-a9e0-cc53e9ea9ada {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:36:13 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa53c17-4b35-4397-ac79-e9a7f2d599a3]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:36:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ad7131e6-bf67-4564-ae8b-4a0bda30ad18 tempest-SnapshotsActionsTest-579051250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.0e01ce9a-288a-4670-a9e0-cc53e9ea9ada {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:13 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-97a747ef-639b-468a-a320-9c8380e944a7 tempest-VolumesServicesTestJSON-1852590854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:36:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-97a747ef-639b-468a-a320-9c8380e944a7 tempest-VolumesServicesTestJSON-1852590854 None] Flow 'volume_create_manager' (74940ac0-f896-4411-ad43-7b5802a7cedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:36:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-97a747ef-639b-468a-a320-9c8380e944a7 tempest-VolumesServicesTestJSON-1852590854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff299728-dbfc-48d3-90f9-42792bc87472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-97a747ef-639b-468a-a320-9c8380e944a7 tempest-VolumesServicesTestJSON-1852590854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff299728-dbfc-48d3-90f9-42792bc87472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-248718319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5976b65-ed8a-4924-a1f6-5a5fbea9faba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcaefb800bac4f7c82f43c6edd92625a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:36:13Z,use_quota=True,user_id='ca0f2e125e174f23b9a5638dcf3e8dc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-97a747ef-639b-468a-a320-9c8380e944a7 tempest-VolumesServicesTestJSON-1852590854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5e5b286-ee50-4a45-96df-eac947cef4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-97a747ef-639b-468a-a320-9c8380e944a7 tempest-VolumesServicesTestJSON-1852590854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5e5b286-ee50-4a45-96df-eac947cef4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-97a747ef-639b-468a-a320-9c8380e944a7 tempest-VolumesServicesTestJSON-1852590854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29eb5f84-7b70-49d2-b233-7678ef7428e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-97a747ef-639b-468a-a320-9c8380e944a7 tempest-VolumesServicesTestJSON-1852590854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29eb5f84-7b70-49d2-b233-7678ef7428e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5976b65-ed8a-4924-a1f6-5a5fbea9faba', 'volume_name': 'volume-b5976b65-ed8a-4924-a1f6-5a5fbea9faba', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-97a747ef-639b-468a-a320-9c8380e944a7 tempest-VolumesServicesTestJSON-1852590854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f73e12c4-e733-496b-819e-fdb8da196377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-97a747ef-639b-468a-a320-9c8380e944a7 tempest-VolumesServicesTestJSON-1852590854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f73e12c4-e733-496b-819e-fdb8da196377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-97a747ef-639b-468a-a320-9c8380e944a7 tempest-VolumesServicesTestJSON-1852590854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e442c96-fb4f-44fb-b6e0-3f5c136bc9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:13 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-97a747ef-639b-468a-a320-9c8380e944a7 tempest-VolumesServicesTestJSON-1852590854 None] Volume b5976b65-ed8a-4924-a1f6-5a5fbea9faba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5976b65-ed8a-4924-a1f6-5a5fbea9faba', 'volume_size': 1} Jul 08 01:36:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-97a747ef-639b-468a-a320-9c8380e944a7 tempest-VolumesServicesTestJSON-1852590854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-97a747ef-639b-468a-a320-9c8380e944a7 tempest-VolumesServicesTestJSON-1852590854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:13 devstack sudo[92996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.0e01ce9a-288a-4670-a9e0-cc53e9ea9ada Jul 08 01:36:13 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-97a747ef-639b-468a-a320-9c8380e944a7 tempest-VolumesServicesTestJSON-1852590854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-248718319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5976b65-ed8a-4924-a1f6-5a5fbea9faba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcaefb800bac4f7c82f43c6edd92625a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:36:13Z,use_quota=True,user_id='ca0f2e125e174f23b9a5638dcf3e8dc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:36:13 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-97a747ef-639b-468a-a320-9c8380e944a7 tempest-VolumesServicesTestJSON-1852590854 None] Creating volume b5976b65-ed8a-4924-a1f6-5a5fbea9faba {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:36:13 devstack sudo[92996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-97a747ef-639b-468a-a320-9c8380e944a7 tempest-VolumesServicesTestJSON-1852590854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-97a747ef-639b-468a-a320-9c8380e944a7 tempest-VolumesServicesTestJSON-1852590854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:13 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-97a747ef-639b-468a-a320-9c8380e944a7 tempest-VolumesServicesTestJSON-1852590854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:36:13 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-97a747ef-639b-468a-a320-9c8380e944a7 tempest-VolumesServicesTestJSON-1852590854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:36:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-97a747ef-639b-468a-a320-9c8380e944a7 tempest-VolumesServicesTestJSON-1852590854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:13 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-97a747ef-639b-468a-a320-9c8380e944a7 tempest-VolumesServicesTestJSON-1852590854 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:36:13 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-97a747ef-639b-468a-a320-9c8380e944a7 tempest-VolumesServicesTestJSON-1852590854 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:36:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-97a747ef-639b-468a-a320-9c8380e944a7 tempest-VolumesServicesTestJSON-1852590854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b5976b65-ed8a-4924-a1f6-5a5fbea9faba 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:13 devstack sudo[92998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b5976b65-ed8a-4924-a1f6-5a5fbea9faba 1073741824 Jul 08 01:36:13 devstack sudo[92998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:14 devstack sudo[92996]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ad7131e6-bf67-4564-ae8b-4a0bda30ad18 tempest-SnapshotsActionsTest-579051250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.0e01ce9a-288a-4670-a9e0-cc53e9ea9ada" returned: 0 in 1.316s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:14 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-ad7131e6-bf67-4564-ae8b-4a0bda30ad18 tempest-SnapshotsActionsTest-579051250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:36:14 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ccad86-9c07-4205-84d2-5fc68e1a3049]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:36:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ad7131e6-bf67-4564-ae8b-4a0bda30ad18 tempest-SnapshotsActionsTest-579051250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:14 devstack sudo[93008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 Jul 08 01:36:14 devstack sudo[93008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:15 devstack sudo[92998]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-97a747ef-639b-468a-a320-9c8380e944a7 tempest-VolumesServicesTestJSON-1852590854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b5976b65-ed8a-4924-a1f6-5a5fbea9faba 1073741824" returned: 0 in 1.718s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-97a747ef-639b-468a-a320-9c8380e944a7 tempest-VolumesServicesTestJSON-1852590854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b5976b65-ed8a-4924-a1f6-5a5fbea9faba {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:15 devstack sudo[93010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b5976b65-ed8a-4924-a1f6-5a5fbea9faba Jul 08 01:36:15 devstack sudo[93010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:15 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4dad986-638b-434d-b713-ec87f8322b0b tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:36:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c4dad986-638b-434d-b713-ec87f8322b0b tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Flow 'volume_create_manager' (8d22b14e-bbf9-432d-ab72-85cc24c79710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:36:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c4dad986-638b-434d-b713-ec87f8322b0b tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f18d635f-80c1-4a7c-8f69-3dae0a5584bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c4dad986-638b-434d-b713-ec87f8322b0b tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f18d635f-80c1-4a7c-8f69-3dae0a5584bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-256627457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6e6c797-6568-4098-ab28-11cfc2f4a0c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b877b4f9d84fb2a4d025c237b0020b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:36:16Z,use_quota=True,user_id='23dd83e915784a3682b0357a4bf1a053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c4dad986-638b-434d-b713-ec87f8322b0b tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a5bf312-6f55-4c6a-8795-af6f8a93a6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c4dad986-638b-434d-b713-ec87f8322b0b tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a5bf312-6f55-4c6a-8795-af6f8a93a6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c4dad986-638b-434d-b713-ec87f8322b0b tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f14da6e6-3363-4087-b143-cf75487cdfce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c4dad986-638b-434d-b713-ec87f8322b0b tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f14da6e6-3363-4087-b143-cf75487cdfce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6e6c797-6568-4098-ab28-11cfc2f4a0c6', 'volume_name': 'volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c4dad986-638b-434d-b713-ec87f8322b0b tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c44d038-48ae-4550-bcf9-7a494de3914c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c4dad986-638b-434d-b713-ec87f8322b0b tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c44d038-48ae-4550-bcf9-7a494de3914c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c4dad986-638b-434d-b713-ec87f8322b0b tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29891c70-cbeb-408b-9886-32ad9b183b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:15 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-c4dad986-638b-434d-b713-ec87f8322b0b tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Volume a6e6c797-6568-4098-ab28-11cfc2f4a0c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6', 'volume_size': 1} Jul 08 01:36:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c4dad986-638b-434d-b713-ec87f8322b0b tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:16 devstack sudo[93008]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ad7131e6-bf67-4564-ae8b-4a0bda30ad18 tempest-SnapshotsActionsTest-579051250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5" returned: 0 in 1.382s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:16 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-ad7131e6-bf67-4564-ae8b-4a0bda30ad18 tempest-SnapshotsActionsTest-579051250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:36:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ad7131e6-bf67-4564-ae8b-4a0bda30ad18 tempest-SnapshotsActionsTest-579051250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.0e01ce9a-288a-4670-a9e0-cc53e9ea9ada {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:16 devstack sudo[93016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.0e01ce9a-288a-4670-a9e0-cc53e9ea9ada Jul 08 01:36:16 devstack sudo[93016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:16 devstack sudo[93010]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-97a747ef-639b-468a-a320-9c8380e944a7 tempest-VolumesServicesTestJSON-1852590854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b5976b65-ed8a-4924-a1f6-5a5fbea9faba" returned: 0 in 0.927s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:16 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-97a747ef-639b-468a-a320-9c8380e944a7 tempest-VolumesServicesTestJSON-1852590854 None] <== create_volume: return (2743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:36:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-97a747ef-639b-468a-a320-9c8380e944a7 tempest-VolumesServicesTestJSON-1852590854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.749s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c4dad986-638b-434d-b713-ec87f8322b0b tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.308s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:16 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c4dad986-638b-434d-b713-ec87f8322b0b tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-256627457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6e6c797-6568-4098-ab28-11cfc2f4a0c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b877b4f9d84fb2a4d025c237b0020b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:36:16Z,use_quota=True,user_id='23dd83e915784a3682b0357a4bf1a053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:36:16 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-c4dad986-638b-434d-b713-ec87f8322b0b tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Creating volume a6e6c797-6568-4098-ab28-11cfc2f4a0c6 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:36:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c4dad986-638b-434d-b713-ec87f8322b0b tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c4dad986-638b-434d-b713-ec87f8322b0b tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:16 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c4dad986-638b-434d-b713-ec87f8322b0b tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:36:16 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c4dad986-638b-434d-b713-ec87f8322b0b tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:36:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c4dad986-638b-434d-b713-ec87f8322b0b tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:16 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c4dad986-638b-434d-b713-ec87f8322b0b tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:36:16 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-c4dad986-638b-434d-b713-ec87f8322b0b tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:36:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c4dad986-638b-434d-b713-ec87f8322b0b tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:16 devstack sudo[93020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6 1073741824 Jul 08 01:36:16 devstack sudo[93020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-97a747ef-639b-468a-a320-9c8380e944a7 tempest-VolumesServicesTestJSON-1852590854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e442c96-fb4f-44fb-b6e0-3f5c136bc9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5976b65-ed8a-4924-a1f6-5a5fbea9faba', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-97a747ef-639b-468a-a320-9c8380e944a7 tempest-VolumesServicesTestJSON-1852590854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f10c0ae4-c010-49ed-b4c7-52558f86e1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:16 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-97a747ef-639b-468a-a320-9c8380e944a7 tempest-VolumesServicesTestJSON-1852590854 None] Volume volume-b5976b65-ed8a-4924-a1f6-5a5fbea9faba (b5976b65-ed8a-4924-a1f6-5a5fbea9faba): created successfully Jul 08 01:36:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-97a747ef-639b-468a-a320-9c8380e944a7 tempest-VolumesServicesTestJSON-1852590854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f10c0ae4-c010-49ed-b4c7-52558f86e1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-97a747ef-639b-468a-a320-9c8380e944a7 tempest-VolumesServicesTestJSON-1852590854 None] Flow 'volume_create_manager' (74940ac0-f896-4411-ad43-7b5802a7cedf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:36:16 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-97a747ef-639b-468a-a320-9c8380e944a7 tempest-VolumesServicesTestJSON-1852590854 None] Created volume successfully. Jul 08 01:36:16 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-7d0f29c8-cae9-46e8-9b3f-6f1d26470383 tempest-VolumesServicesTestJSON-1852590854 None] Acquiring lock "cinder-b5976b65-ed8a-4924-a1f6-5a5fbea9faba-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:16 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-7d0f29c8-cae9-46e8-9b3f-6f1d26470383 tempest-VolumesServicesTestJSON-1852590854 None] Lock "cinder-b5976b65-ed8a-4924-a1f6-5a5fbea9faba-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:16 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-7d0f29c8-cae9-46e8-9b3f-6f1d26470383 tempest-VolumesServicesTestJSON-1852590854 None] Acquiring lock "cinder-quobyte-b5976b65-ed8a-4924-a1f6-5a5fbea9faba" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:16 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-7d0f29c8-cae9-46e8-9b3f-6f1d26470383 tempest-VolumesServicesTestJSON-1852590854 None] Lock "cinder-quobyte-b5976b65-ed8a-4924-a1f6-5a5fbea9faba" acquired by "delete_volume" :: waited 0.025s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:16 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f24f8c-62a4-43a2-85ec-7d70a3b45e24]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:36:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7d0f29c8-cae9-46e8-9b3f-6f1d26470383 tempest-VolumesServicesTestJSON-1852590854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b5976b65-ed8a-4924-a1f6-5a5fbea9faba {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:17 devstack sudo[93026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b5976b65-ed8a-4924-a1f6-5a5fbea9faba Jul 08 01:36:17 devstack sudo[93026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:17 devstack sudo[93016]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ad7131e6-bf67-4564-ae8b-4a0bda30ad18 tempest-SnapshotsActionsTest-579051250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.0e01ce9a-288a-4670-a9e0-cc53e9ea9ada" returned: 0 in 1.338s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ad7131e6-bf67-4564-ae8b-4a0bda30ad18 tempest-SnapshotsActionsTest-579051250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.0e01ce9a-288a-4670-a9e0-cc53e9ea9ada {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:17 devstack sudo[93032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.0e01ce9a-288a-4670-a9e0-cc53e9ea9ada Jul 08 01:36:17 devstack sudo[93032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:17 devstack sudo[93020]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c4dad986-638b-434d-b713-ec87f8322b0b tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6 1073741824" returned: 0 in 1.544s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c4dad986-638b-434d-b713-ec87f8322b0b tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:17 devstack sudo[93037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6 Jul 08 01:36:17 devstack sudo[93037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:18 devstack sudo[93026]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7d0f29c8-cae9-46e8-9b3f-6f1d26470383 tempest-VolumesServicesTestJSON-1852590854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b5976b65-ed8a-4924-a1f6-5a5fbea9faba" returned: 0 in 1.159s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7d0f29c8-cae9-46e8-9b3f-6f1d26470383 tempest-VolumesServicesTestJSON-1852590854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b5976b65-ed8a-4924-a1f6-5a5fbea9faba {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:18 devstack sudo[93039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b5976b65-ed8a-4924-a1f6-5a5fbea9faba Jul 08 01:36:18 devstack sudo[93039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:18 devstack sudo[93032]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ad7131e6-bf67-4564-ae8b-4a0bda30ad18 tempest-SnapshotsActionsTest-579051250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.0e01ce9a-288a-4670-a9e0-cc53e9ea9ada" returned: 0 in 0.915s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:18 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ad7131e6-bf67-4564-ae8b-4a0bda30ad18 tempest-SnapshotsActionsTest-579051250 None] Lock "cinder-quobyte-0e01ce9a-288a-4670-a9e0-cc53e9ea9ada" released by "_delete_snapshot" :: held 5.123s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:18 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ad7131e6-bf67-4564-ae8b-4a0bda30ad18 tempest-SnapshotsActionsTest-579051250 None] Lock "cinder-quobyte-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5" released by "delete_snapshot" :: held 5.159s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:18 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-ad7131e6-bf67-4564-ae8b-4a0bda30ad18 tempest-SnapshotsActionsTest-579051250 None] Created reservations ['6deea919-2260-488c-abff-8e4ec6904452', '3169484d-9a3e-4ebd-8444-af88ac98e58f', '9bf83771-2a78-4e02-8639-a24a4293e4e6', '14705c8c-0767-4542-8db8-784df6b3997b'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:36:18 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-ad7131e6-bf67-4564-ae8b-4a0bda30ad18 tempest-SnapshotsActionsTest-579051250 None] Delete snapshot completed successfully. Jul 08 01:36:18 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ad7131e6-bf67-4564-ae8b-4a0bda30ad18 tempest-SnapshotsActionsTest-579051250 None] Lock "cinder-0e01ce9a-288a-4670-a9e0-cc53e9ea9ada-delete_snapshot" released by "delete_snapshot" :: held 5.374s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:18 devstack sudo[93037]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c4dad986-638b-434d-b713-ec87f8322b0b tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6" returned: 0 in 0.947s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:18 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c4dad986-638b-434d-b713-ec87f8322b0b tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] <== create_volume: return (2579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:36:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c4dad986-638b-434d-b713-ec87f8322b0b tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.585s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:18 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c4dad986-638b-434d-b713-ec87f8322b0b tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29891c70-cbeb-408b-9886-32ad9b183b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:18 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c4dad986-638b-434d-b713-ec87f8322b0b tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c8fa5c1-f981-488d-b6da-de12d9b21f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:18 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-c4dad986-638b-434d-b713-ec87f8322b0b tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Volume volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6 (a6e6c797-6568-4098-ab28-11cfc2f4a0c6): created successfully Jul 08 01:36:18 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c4dad986-638b-434d-b713-ec87f8322b0b tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c8fa5c1-f981-488d-b6da-de12d9b21f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:18 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c4dad986-638b-434d-b713-ec87f8322b0b tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Flow 'volume_create_manager' (8d22b14e-bbf9-432d-ab72-85cc24c79710) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:36:18 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-c4dad986-638b-434d-b713-ec87f8322b0b tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Created volume successfully. Jul 08 01:36:19 devstack sudo[93039]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7d0f29c8-cae9-46e8-9b3f-6f1d26470383 tempest-VolumesServicesTestJSON-1852590854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b5976b65-ed8a-4924-a1f6-5a5fbea9faba" returned: 0 in 0.947s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:19 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-7d0f29c8-cae9-46e8-9b3f-6f1d26470383 tempest-VolumesServicesTestJSON-1852590854 None] Lock "cinder-quobyte-b5976b65-ed8a-4924-a1f6-5a5fbea9faba" released by "delete_volume" :: held 2.170s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:19 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-7d0f29c8-cae9-46e8-9b3f-6f1d26470383 tempest-VolumesServicesTestJSON-1852590854 None] Created reservations ['5293d5eb-520c-4ac6-9fa1-a09935affb6d', '02b0c10c-af71-483f-af4a-9aa0e8504cce', 'ba5d640f-530a-48d6-a877-1881849e9c65', '3641fad2-a384-441e-8898-c7999e6890ca'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:36:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-46f10353-1436-4d21-92c3-3ea933f346a7 tempest-SnapshotsActionsTest-2012801752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-46f10353-1436-4d21-92c3-3ea933f346a7 tempest-SnapshotsActionsTest-2012801752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:19 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-46f10353-1436-4d21-92c3-3ea933f346a7 tempest-SnapshotsActionsTest-2012801752 None] Creating offline snapshot fa616450-43ad-40dd-9d2b-a36207b04d81 of volume 678fcb9f-5ef4-4cb4-8549-c1294d6e87e5 {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:36:19 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9779d4-6e5a-49c7-afcf-d04f3a6f15ec]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:36:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-46f10353-1436-4d21-92c3-3ea933f346a7 tempest-SnapshotsActionsTest-2012801752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-7d0f29c8-cae9-46e8-9b3f-6f1d26470383 tempest-VolumesServicesTestJSON-1852590854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-7d0f29c8-cae9-46e8-9b3f-6f1d26470383 tempest-VolumesServicesTestJSON-1852590854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:19 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-7d0f29c8-cae9-46e8-9b3f-6f1d26470383 tempest-VolumesServicesTestJSON-1852590854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:36:19 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-7d0f29c8-cae9-46e8-9b3f-6f1d26470383 tempest-VolumesServicesTestJSON-1852590854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:36:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-7d0f29c8-cae9-46e8-9b3f-6f1d26470383 tempest-VolumesServicesTestJSON-1852590854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7d0f29c8-cae9-46e8-9b3f-6f1d26470383 tempest-VolumesServicesTestJSON-1852590854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:19 devstack sudo[93045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:36:19 devstack sudo[93045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:19 devstack sudo[93044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 Jul 08 01:36:19 devstack sudo[93044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:20 devstack sudo[93045]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7d0f29c8-cae9-46e8-9b3f-6f1d26470383 tempest-VolumesServicesTestJSON-1852590854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.714s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:20 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-7d0f29c8-cae9-46e8-9b3f-6f1d26470383 tempest-VolumesServicesTestJSON-1852590854 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:36:20 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-7d0f29c8-cae9-46e8-9b3f-6f1d26470383 tempest-VolumesServicesTestJSON-1852590854 None] Deleted volume successfully. Jul 08 01:36:20 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-7d0f29c8-cae9-46e8-9b3f-6f1d26470383 tempest-VolumesServicesTestJSON-1852590854 None] Lock "cinder-b5976b65-ed8a-4924-a1f6-5a5fbea9faba-delete_volume" released by "delete_volume" :: held 3.269s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:20 devstack sudo[93044]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-46f10353-1436-4d21-92c3-3ea933f346a7 tempest-SnapshotsActionsTest-2012801752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5" returned: 0 in 0.920s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:20 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-46f10353-1436-4d21-92c3-3ea933f346a7 tempest-SnapshotsActionsTest-2012801752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:36:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-46f10353-1436-4d21-92c3-3ea933f346a7 tempest-SnapshotsActionsTest-2012801752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.fa616450-43ad-40dd-9d2b-a36207b04d81 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:20 devstack sudo[93053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.fa616450-43ad-40dd-9d2b-a36207b04d81 1G Jul 08 01:36:20 devstack sudo[93053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:20 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:INSERT=20,cinder:UPDATE=88,cinder:SELECT=64,cinder:DELETE=4 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:36:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-60f9925d-9e00-43bf-b05b-01a4596b2a03 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:21 devstack sudo[93053]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-46f10353-1436-4d21-92c3-3ea933f346a7 tempest-SnapshotsActionsTest-2012801752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.fa616450-43ad-40dd-9d2b-a36207b04d81 1G" returned: 0 in 1.098s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-46f10353-1436-4d21-92c3-3ea933f346a7 tempest-SnapshotsActionsTest-2012801752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.fa616450-43ad-40dd-9d2b-a36207b04d81 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:21 devstack sudo[93059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.fa616450-43ad-40dd-9d2b-a36207b04d81 Jul 08 01:36:21 devstack sudo[93059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:22 devstack sudo[93059]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-46f10353-1436-4d21-92c3-3ea933f346a7 tempest-SnapshotsActionsTest-2012801752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.fa616450-43ad-40dd-9d2b-a36207b04d81" returned: 0 in 0.833s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:22 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-46f10353-1436-4d21-92c3-3ea933f346a7 tempest-SnapshotsActionsTest-2012801752 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.fa616450-43ad-40dd-9d2b-a36207b04d81 is being set with open permissions: ugo+rw Jul 08 01:36:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-46f10353-1436-4d21-92c3-3ea933f346a7 tempest-SnapshotsActionsTest-2012801752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.fa616450-43ad-40dd-9d2b-a36207b04d81 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:22 devstack sudo[93064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.fa616450-43ad-40dd-9d2b-a36207b04d81 Jul 08 01:36:22 devstack sudo[93064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:22 devstack sudo[93064]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-46f10353-1436-4d21-92c3-3ea933f346a7 tempest-SnapshotsActionsTest-2012801752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.fa616450-43ad-40dd-9d2b-a36207b04d81" returned: 0 in 0.794s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-46f10353-1436-4d21-92c3-3ea933f346a7 tempest-SnapshotsActionsTest-2012801752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.773s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-60f9925d-9e00-43bf-b05b-01a4596b2a03 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.491s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:22 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-60f9925d-9e00-43bf-b05b-01a4596b2a03 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Creating offline snapshot c8f6c872-6441-4240-9337-9c22932f8e07 of volume a6e6c797-6568-4098-ab28-11cfc2f4a0c6 {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:36:22 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-46f10353-1436-4d21-92c3-3ea933f346a7 tempest-SnapshotsActionsTest-2012801752 None] Create snapshot completed successfully Jul 08 01:36:23 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[9835aa55-20c3-49e0-b6c2-63b1a1c95ad4]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:36:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-60f9925d-9e00-43bf-b05b-01a4596b2a03 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:23 devstack sudo[93067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6 Jul 08 01:36:23 devstack sudo[93067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:23 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5d499409-30ba-4ed5-969b-85f0c4fbd13a tempest-SnapshotsActionsTest-579051250 None] Acquiring lock "cinder-fa616450-43ad-40dd-9d2b-a36207b04d81-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:23 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5d499409-30ba-4ed5-969b-85f0c4fbd13a tempest-SnapshotsActionsTest-579051250 None] Lock "cinder-fa616450-43ad-40dd-9d2b-a36207b04d81-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:23 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5d499409-30ba-4ed5-969b-85f0c4fbd13a tempest-SnapshotsActionsTest-579051250 None] Acquiring lock "cinder-quobyte-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:23 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5d499409-30ba-4ed5-969b-85f0c4fbd13a tempest-SnapshotsActionsTest-579051250 None] Lock "cinder-quobyte-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:23 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5d499409-30ba-4ed5-969b-85f0c4fbd13a tempest-SnapshotsActionsTest-579051250 None] Acquiring lock "cinder-quobyte-fa616450-43ad-40dd-9d2b-a36207b04d81" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:23 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5d499409-30ba-4ed5-969b-85f0c4fbd13a tempest-SnapshotsActionsTest-579051250 None] Lock "cinder-quobyte-fa616450-43ad-40dd-9d2b-a36207b04d81" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:23 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-5d499409-30ba-4ed5-969b-85f0c4fbd13a tempest-SnapshotsActionsTest-579051250 None] Deleting offline snapshot fa616450-43ad-40dd-9d2b-a36207b04d81 of volume 678fcb9f-5ef4-4cb4-8549-c1294d6e87e5 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:36:23 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-5d499409-30ba-4ed5-969b-85f0c4fbd13a tempest-SnapshotsActionsTest-579051250 None] snapshot_file for this snap is: volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.fa616450-43ad-40dd-9d2b-a36207b04d81 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:36:23 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b98f54-5520-4fa5-9f05-7294a356a071]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:36:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5d499409-30ba-4ed5-969b-85f0c4fbd13a tempest-SnapshotsActionsTest-579051250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.fa616450-43ad-40dd-9d2b-a36207b04d81 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:24 devstack sudo[93070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.fa616450-43ad-40dd-9d2b-a36207b04d81 Jul 08 01:36:24 devstack sudo[93070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:24 devstack sudo[93067]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-60f9925d-9e00-43bf-b05b-01a4596b2a03 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6" returned: 0 in 1.176s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-60f9925d-9e00-43bf-b05b-01a4596b2a03 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6.c8f6c872-6441-4240-9337-9c22932f8e07 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:24 devstack sudo[93074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6.c8f6c872-6441-4240-9337-9c22932f8e07 1G Jul 08 01:36:24 devstack sudo[93074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:25 devstack sudo[93070]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5d499409-30ba-4ed5-969b-85f0c4fbd13a tempest-SnapshotsActionsTest-579051250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.fa616450-43ad-40dd-9d2b-a36207b04d81" returned: 0 in 1.212s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:25 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-5d499409-30ba-4ed5-969b-85f0c4fbd13a tempest-SnapshotsActionsTest-579051250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:36:25 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca86dce8-0391-4d74-bfe4-7e8717a01ef7]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:36:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5d499409-30ba-4ed5-969b-85f0c4fbd13a tempest-SnapshotsActionsTest-579051250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:25 devstack sudo[93105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 Jul 08 01:36:25 devstack sudo[93105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:25 devstack sudo[93074]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-60f9925d-9e00-43bf-b05b-01a4596b2a03 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6.c8f6c872-6441-4240-9337-9c22932f8e07 1G" returned: 0 in 1.212s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-60f9925d-9e00-43bf-b05b-01a4596b2a03 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6.c8f6c872-6441-4240-9337-9c22932f8e07 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:25 devstack sudo[93124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6.c8f6c872-6441-4240-9337-9c22932f8e07 Jul 08 01:36:25 devstack sudo[93124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:26 devstack sudo[93105]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5d499409-30ba-4ed5-969b-85f0c4fbd13a tempest-SnapshotsActionsTest-579051250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5" returned: 0 in 0.926s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:26 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-5d499409-30ba-4ed5-969b-85f0c4fbd13a tempest-SnapshotsActionsTest-579051250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:36:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5d499409-30ba-4ed5-969b-85f0c4fbd13a tempest-SnapshotsActionsTest-579051250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.fa616450-43ad-40dd-9d2b-a36207b04d81 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:26 devstack sudo[93152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.fa616450-43ad-40dd-9d2b-a36207b04d81 Jul 08 01:36:26 devstack sudo[93152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:26 devstack sudo[93124]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-60f9925d-9e00-43bf-b05b-01a4596b2a03 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6.c8f6c872-6441-4240-9337-9c22932f8e07" returned: 0 in 0.924s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:26 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-60f9925d-9e00-43bf-b05b-01a4596b2a03 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6.c8f6c872-6441-4240-9337-9c22932f8e07 is being set with open permissions: ugo+rw Jul 08 01:36:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-60f9925d-9e00-43bf-b05b-01a4596b2a03 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6.c8f6c872-6441-4240-9337-9c22932f8e07 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:26 devstack sudo[93157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6.c8f6c872-6441-4240-9337-9c22932f8e07 Jul 08 01:36:26 devstack sudo[93157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:26 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb3f1c43-75b2-4361-b25b-0b3d168afd13 tempest-AbsoluteLimitsTests-1969475873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:36:27 devstack sudo[93152]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:27 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eb3f1c43-75b2-4361-b25b-0b3d168afd13 tempest-AbsoluteLimitsTests-1969475873 None] Flow 'volume_create_manager' (98446872-616c-4bd6-b111-5cbd1652462a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:36:27 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eb3f1c43-75b2-4361-b25b-0b3d168afd13 tempest-AbsoluteLimitsTests-1969475873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ccf8f8-d229-42f1-925c-833caf824b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5d499409-30ba-4ed5-969b-85f0c4fbd13a tempest-SnapshotsActionsTest-579051250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.fa616450-43ad-40dd-9d2b-a36207b04d81" returned: 0 in 0.961s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5d499409-30ba-4ed5-969b-85f0c4fbd13a tempest-SnapshotsActionsTest-579051250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.fa616450-43ad-40dd-9d2b-a36207b04d81 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:27 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eb3f1c43-75b2-4361-b25b-0b3d168afd13 tempest-AbsoluteLimitsTests-1969475873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ccf8f8-d229-42f1-925c-833caf824b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-895162227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=036ee9d0-6afa-4c3c-94ed-1479229b6955,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c077d50e6554505b6cf39c5eb17d8fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:36:27Z,use_quota=True,user_id='56cb9ca69a754861add77fc252253c33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:27 devstack sudo[93163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.fa616450-43ad-40dd-9d2b-a36207b04d81 Jul 08 01:36:27 devstack sudo[93163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:27 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eb3f1c43-75b2-4361-b25b-0b3d168afd13 tempest-AbsoluteLimitsTests-1969475873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2608c127-01da-4991-ae3a-68a3bcdc66fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:27 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eb3f1c43-75b2-4361-b25b-0b3d168afd13 tempest-AbsoluteLimitsTests-1969475873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2608c127-01da-4991-ae3a-68a3bcdc66fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:27 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eb3f1c43-75b2-4361-b25b-0b3d168afd13 tempest-AbsoluteLimitsTests-1969475873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e152b4f-5428-4327-8b3a-fe45cf117ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:27 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eb3f1c43-75b2-4361-b25b-0b3d168afd13 tempest-AbsoluteLimitsTests-1969475873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e152b4f-5428-4327-8b3a-fe45cf117ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '036ee9d0-6afa-4c3c-94ed-1479229b6955', 'volume_name': 'volume-036ee9d0-6afa-4c3c-94ed-1479229b6955', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:27 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eb3f1c43-75b2-4361-b25b-0b3d168afd13 tempest-AbsoluteLimitsTests-1969475873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (648d129a-52cd-41dc-892d-b27a174146ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:27 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eb3f1c43-75b2-4361-b25b-0b3d168afd13 tempest-AbsoluteLimitsTests-1969475873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (648d129a-52cd-41dc-892d-b27a174146ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:27 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eb3f1c43-75b2-4361-b25b-0b3d168afd13 tempest-AbsoluteLimitsTests-1969475873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e76e715-18b0-4b30-8b35-b2c23cfbd36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:27 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-eb3f1c43-75b2-4361-b25b-0b3d168afd13 tempest-AbsoluteLimitsTests-1969475873 None] Volume 036ee9d0-6afa-4c3c-94ed-1479229b6955: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-036ee9d0-6afa-4c3c-94ed-1479229b6955', 'volume_size': 1} Jul 08 01:36:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-eb3f1c43-75b2-4361-b25b-0b3d168afd13 tempest-AbsoluteLimitsTests-1969475873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:27 devstack sudo[93157]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-60f9925d-9e00-43bf-b05b-01a4596b2a03 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6.c8f6c872-6441-4240-9337-9c22932f8e07" returned: 0 in 0.805s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-60f9925d-9e00-43bf-b05b-01a4596b2a03 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:27 devstack sudo[93165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6.info Jul 08 01:36:27 devstack sudo[93165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:27 devstack sudo[93163]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5d499409-30ba-4ed5-969b-85f0c4fbd13a tempest-SnapshotsActionsTest-579051250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.fa616450-43ad-40dd-9d2b-a36207b04d81" returned: 0 in 0.712s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:27 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5d499409-30ba-4ed5-969b-85f0c4fbd13a tempest-SnapshotsActionsTest-579051250 None] Lock "cinder-quobyte-fa616450-43ad-40dd-9d2b-a36207b04d81" released by "_delete_snapshot" :: held 3.969s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:27 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5d499409-30ba-4ed5-969b-85f0c4fbd13a tempest-SnapshotsActionsTest-579051250 None] Lock "cinder-quobyte-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5" released by "delete_snapshot" :: held 4.008s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:27 devstack sudo[93165]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:27 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-5d499409-30ba-4ed5-969b-85f0c4fbd13a tempest-SnapshotsActionsTest-579051250 None] Created reservations ['26503a6c-909e-4b1b-a6fe-8ca8f1bc6729', '30e2554f-efab-418e-a42e-2cd09f53b553', '252fee6a-12b1-4d1c-854d-ef41e250905e', '5c75255c-3cbb-4da8-9bdf-c677c2bae924'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:36:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-60f9925d-9e00-43bf-b05b-01a4596b2a03 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6.info" returned: 0 in 0.702s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:27 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-60f9925d-9e00-43bf-b05b-01a4596b2a03 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6.info is being set with open permissions: ugo+rw Jul 08 01:36:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-60f9925d-9e00-43bf-b05b-01a4596b2a03 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:27 devstack sudo[93169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6.info Jul 08 01:36:27 devstack sudo[93169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:27 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-5d499409-30ba-4ed5-969b-85f0c4fbd13a tempest-SnapshotsActionsTest-579051250 None] Delete snapshot completed successfully. Jul 08 01:36:27 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5d499409-30ba-4ed5-969b-85f0c4fbd13a tempest-SnapshotsActionsTest-579051250 None] Lock "cinder-fa616450-43ad-40dd-9d2b-a36207b04d81-delete_snapshot" released by "delete_snapshot" :: held 4.207s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6a1c7b04-fca8-481b-87c9-26a9381b3171 tempest-SnapshotsActionsTest-2012801752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:28 devstack sudo[93169]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-60f9925d-9e00-43bf-b05b-01a4596b2a03 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6.info" returned: 0 in 0.819s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-60f9925d-9e00-43bf-b05b-01a4596b2a03 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.757s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-eb3f1c43-75b2-4361-b25b-0b3d168afd13 tempest-AbsoluteLimitsTests-1969475873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.599s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:28 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-eb3f1c43-75b2-4361-b25b-0b3d168afd13 tempest-AbsoluteLimitsTests-1969475873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-895162227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=036ee9d0-6afa-4c3c-94ed-1479229b6955,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c077d50e6554505b6cf39c5eb17d8fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:36:27Z,use_quota=True,user_id='56cb9ca69a754861add77fc252253c33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:36:28 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-eb3f1c43-75b2-4361-b25b-0b3d168afd13 tempest-AbsoluteLimitsTests-1969475873 None] Creating volume 036ee9d0-6afa-4c3c-94ed-1479229b6955 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:36:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-eb3f1c43-75b2-4361-b25b-0b3d168afd13 tempest-AbsoluteLimitsTests-1969475873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-eb3f1c43-75b2-4361-b25b-0b3d168afd13 tempest-AbsoluteLimitsTests-1969475873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:28 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-eb3f1c43-75b2-4361-b25b-0b3d168afd13 tempest-AbsoluteLimitsTests-1969475873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:36:28 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-eb3f1c43-75b2-4361-b25b-0b3d168afd13 tempest-AbsoluteLimitsTests-1969475873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:36:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-eb3f1c43-75b2-4361-b25b-0b3d168afd13 tempest-AbsoluteLimitsTests-1969475873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:28 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-eb3f1c43-75b2-4361-b25b-0b3d168afd13 tempest-AbsoluteLimitsTests-1969475873 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:36:28 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-eb3f1c43-75b2-4361-b25b-0b3d168afd13 tempest-AbsoluteLimitsTests-1969475873 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:36:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-eb3f1c43-75b2-4361-b25b-0b3d168afd13 tempest-AbsoluteLimitsTests-1969475873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-036ee9d0-6afa-4c3c-94ed-1479229b6955 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:28 devstack sudo[93172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-036ee9d0-6afa-4c3c-94ed-1479229b6955 1073741824 Jul 08 01:36:28 devstack sudo[93172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:28 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-60f9925d-9e00-43bf-b05b-01a4596b2a03 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Create snapshot completed successfully Jul 08 01:36:29 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ce640b95-1f2d-4b89-bfac-353b70a7fa28 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Acquiring lock "cinder-c8f6c872-6441-4240-9337-9c22932f8e07-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:29 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ce640b95-1f2d-4b89-bfac-353b70a7fa28 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Lock "cinder-c8f6c872-6441-4240-9337-9c22932f8e07-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:29 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ce640b95-1f2d-4b89-bfac-353b70a7fa28 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Acquiring lock "cinder-quobyte-a6e6c797-6568-4098-ab28-11cfc2f4a0c6" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:29 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ce640b95-1f2d-4b89-bfac-353b70a7fa28 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Lock "cinder-quobyte-a6e6c797-6568-4098-ab28-11cfc2f4a0c6" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:29 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ce640b95-1f2d-4b89-bfac-353b70a7fa28 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Acquiring lock "cinder-quobyte-c8f6c872-6441-4240-9337-9c22932f8e07" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:29 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ce640b95-1f2d-4b89-bfac-353b70a7fa28 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Lock "cinder-quobyte-c8f6c872-6441-4240-9337-9c22932f8e07" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:29 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-ce640b95-1f2d-4b89-bfac-353b70a7fa28 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Deleting offline snapshot c8f6c872-6441-4240-9337-9c22932f8e07 of volume a6e6c797-6568-4098-ab28-11cfc2f4a0c6 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:36:29 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-ce640b95-1f2d-4b89-bfac-353b70a7fa28 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] snapshot_file for this snap is: volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6.c8f6c872-6441-4240-9337-9c22932f8e07 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:36:29 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[f082bd9b-3acb-4c13-9992-4b853910b31e]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:36:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ce640b95-1f2d-4b89-bfac-353b70a7fa28 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6.c8f6c872-6441-4240-9337-9c22932f8e07 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:29 devstack sudo[93177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6.c8f6c872-6441-4240-9337-9c22932f8e07 Jul 08 01:36:29 devstack sudo[93177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:29 devstack sudo[93172]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-eb3f1c43-75b2-4361-b25b-0b3d168afd13 tempest-AbsoluteLimitsTests-1969475873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-036ee9d0-6afa-4c3c-94ed-1479229b6955 1073741824" returned: 0 in 0.984s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-eb3f1c43-75b2-4361-b25b-0b3d168afd13 tempest-AbsoluteLimitsTests-1969475873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-036ee9d0-6afa-4c3c-94ed-1479229b6955 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:29 devstack sudo[93179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-036ee9d0-6afa-4c3c-94ed-1479229b6955 Jul 08 01:36:29 devstack sudo[93179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:30 devstack sudo[93177]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ce640b95-1f2d-4b89-bfac-353b70a7fa28 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6.c8f6c872-6441-4240-9337-9c22932f8e07" returned: 0 in 0.838s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:30 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-ce640b95-1f2d-4b89-bfac-353b70a7fa28 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:36:30 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[340c3c5e-7e65-4157-91dd-9a5d507c7638]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:36:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ce640b95-1f2d-4b89-bfac-353b70a7fa28 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:30 devstack sudo[93179]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-eb3f1c43-75b2-4361-b25b-0b3d168afd13 tempest-AbsoluteLimitsTests-1969475873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-036ee9d0-6afa-4c3c-94ed-1479229b6955" returned: 0 in 0.772s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:30 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-eb3f1c43-75b2-4361-b25b-0b3d168afd13 tempest-AbsoluteLimitsTests-1969475873 None] <== create_volume: return (1812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:36:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-eb3f1c43-75b2-4361-b25b-0b3d168afd13 tempest-AbsoluteLimitsTests-1969475873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.814s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6a1c7b04-fca8-481b-87c9-26a9381b3171 tempest-SnapshotsActionsTest-2012801752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.107s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:30 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-6a1c7b04-fca8-481b-87c9-26a9381b3171 tempest-SnapshotsActionsTest-2012801752 None] Creating offline snapshot ae71ec80-951c-4a84-8409-f43feaf7df3c of volume 678fcb9f-5ef4-4cb4-8549-c1294d6e87e5 {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:36:30 devstack sudo[93185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6 Jul 08 01:36:30 devstack sudo[93185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:30 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eb3f1c43-75b2-4361-b25b-0b3d168afd13 tempest-AbsoluteLimitsTests-1969475873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e76e715-18b0-4b30-8b35-b2c23cfbd36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-036ee9d0-6afa-4c3c-94ed-1479229b6955', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:30 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eb3f1c43-75b2-4361-b25b-0b3d168afd13 tempest-AbsoluteLimitsTests-1969475873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd51b521-cab6-4cba-92cb-bb76b758bf2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:30 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e9b71b-ccfd-42a8-ac98-045516a11896]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:36:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6a1c7b04-fca8-481b-87c9-26a9381b3171 tempest-SnapshotsActionsTest-2012801752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:30 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-eb3f1c43-75b2-4361-b25b-0b3d168afd13 tempest-AbsoluteLimitsTests-1969475873 None] Volume volume-036ee9d0-6afa-4c3c-94ed-1479229b6955 (036ee9d0-6afa-4c3c-94ed-1479229b6955): created successfully Jul 08 01:36:30 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eb3f1c43-75b2-4361-b25b-0b3d168afd13 tempest-AbsoluteLimitsTests-1969475873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd51b521-cab6-4cba-92cb-bb76b758bf2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:30 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eb3f1c43-75b2-4361-b25b-0b3d168afd13 tempest-AbsoluteLimitsTests-1969475873 None] Flow 'volume_create_manager' (98446872-616c-4bd6-b111-5cbd1652462a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:36:30 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-eb3f1c43-75b2-4361-b25b-0b3d168afd13 tempest-AbsoluteLimitsTests-1969475873 None] Created volume successfully. Jul 08 01:36:30 devstack sudo[93187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 Jul 08 01:36:30 devstack sudo[93187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:31 devstack sudo[93185]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ce640b95-1f2d-4b89-bfac-353b70a7fa28 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6" returned: 0 in 0.963s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ce640b95-1f2d-4b89-bfac-353b70a7fa28 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6.c8f6c872-6441-4240-9337-9c22932f8e07 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:31 devstack sudo[93195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6.c8f6c872-6441-4240-9337-9c22932f8e07 Jul 08 01:36:31 devstack sudo[93195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:31 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-7b8e2048-7b95-4652-bb76-df7ceea73d06 tempest-AbsoluteLimitsTests-1969475873 None] Acquiring lock "cinder-036ee9d0-6afa-4c3c-94ed-1479229b6955-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:31 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-7b8e2048-7b95-4652-bb76-df7ceea73d06 tempest-AbsoluteLimitsTests-1969475873 None] Lock "cinder-036ee9d0-6afa-4c3c-94ed-1479229b6955-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:31 devstack sudo[93187]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6a1c7b04-fca8-481b-87c9-26a9381b3171 tempest-SnapshotsActionsTest-2012801752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5" returned: 0 in 0.932s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:31 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-6a1c7b04-fca8-481b-87c9-26a9381b3171 tempest-SnapshotsActionsTest-2012801752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:36:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6a1c7b04-fca8-481b-87c9-26a9381b3171 tempest-SnapshotsActionsTest-2012801752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.ae71ec80-951c-4a84-8409-f43feaf7df3c 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:31 devstack sudo[93197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.ae71ec80-951c-4a84-8409-f43feaf7df3c 1G Jul 08 01:36:31 devstack sudo[93197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:31 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-7b8e2048-7b95-4652-bb76-df7ceea73d06 tempest-AbsoluteLimitsTests-1969475873 None] Acquiring lock "cinder-quobyte-036ee9d0-6afa-4c3c-94ed-1479229b6955" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:31 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-7b8e2048-7b95-4652-bb76-df7ceea73d06 tempest-AbsoluteLimitsTests-1969475873 None] Lock "cinder-quobyte-036ee9d0-6afa-4c3c-94ed-1479229b6955" acquired by "delete_volume" :: waited 0.016s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:31 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[9203a35a-bf06-4775-ab88-1b56cc1e6d0a]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:36:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7b8e2048-7b95-4652-bb76-df7ceea73d06 tempest-AbsoluteLimitsTests-1969475873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-036ee9d0-6afa-4c3c-94ed-1479229b6955 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:31 devstack sudo[93199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-036ee9d0-6afa-4c3c-94ed-1479229b6955 Jul 08 01:36:31 devstack sudo[93199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:32 devstack sudo[93195]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ce640b95-1f2d-4b89-bfac-353b70a7fa28 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6.c8f6c872-6441-4240-9337-9c22932f8e07" returned: 0 in 1.117s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ce640b95-1f2d-4b89-bfac-353b70a7fa28 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6.c8f6c872-6441-4240-9337-9c22932f8e07 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:32 devstack sudo[93209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6.c8f6c872-6441-4240-9337-9c22932f8e07 Jul 08 01:36:32 devstack sudo[93209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:32 devstack sudo[93199]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:32 devstack sudo[93197]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7b8e2048-7b95-4652-bb76-df7ceea73d06 tempest-AbsoluteLimitsTests-1969475873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-036ee9d0-6afa-4c3c-94ed-1479229b6955" returned: 0 in 1.173s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7b8e2048-7b95-4652-bb76-df7ceea73d06 tempest-AbsoluteLimitsTests-1969475873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-036ee9d0-6afa-4c3c-94ed-1479229b6955 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6a1c7b04-fca8-481b-87c9-26a9381b3171 tempest-SnapshotsActionsTest-2012801752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.ae71ec80-951c-4a84-8409-f43feaf7df3c 1G" returned: 0 in 1.281s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6a1c7b04-fca8-481b-87c9-26a9381b3171 tempest-SnapshotsActionsTest-2012801752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.ae71ec80-951c-4a84-8409-f43feaf7df3c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:32 devstack sudo[93213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-036ee9d0-6afa-4c3c-94ed-1479229b6955 Jul 08 01:36:32 devstack sudo[93213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:32 devstack sudo[93214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.ae71ec80-951c-4a84-8409-f43feaf7df3c Jul 08 01:36:32 devstack sudo[93214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:33 devstack sudo[93209]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ce640b95-1f2d-4b89-bfac-353b70a7fa28 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6.c8f6c872-6441-4240-9337-9c22932f8e07" returned: 0 in 0.980s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:33 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ce640b95-1f2d-4b89-bfac-353b70a7fa28 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Lock "cinder-quobyte-c8f6c872-6441-4240-9337-9c22932f8e07" released by "_delete_snapshot" :: held 4.036s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:33 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ce640b95-1f2d-4b89-bfac-353b70a7fa28 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Lock "cinder-quobyte-a6e6c797-6568-4098-ab28-11cfc2f4a0c6" released by "delete_snapshot" :: held 4.069s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:33 devstack sudo[93213]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7b8e2048-7b95-4652-bb76-df7ceea73d06 tempest-AbsoluteLimitsTests-1969475873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-036ee9d0-6afa-4c3c-94ed-1479229b6955" returned: 0 in 0.933s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:33 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-7b8e2048-7b95-4652-bb76-df7ceea73d06 tempest-AbsoluteLimitsTests-1969475873 None] Lock "cinder-quobyte-036ee9d0-6afa-4c3c-94ed-1479229b6955" released by "delete_volume" :: held 2.190s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:33 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-ce640b95-1f2d-4b89-bfac-353b70a7fa28 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Created reservations ['92b31500-320e-4271-98f1-f071897a1d78', '0223afa8-b3b7-47ec-b804-d001a6be2a30', '4f722dfc-7828-4a5c-b30e-a60655051f11', 'bd0c7f47-25d7-4e37-b8ff-c76f8c373819'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:36:33 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:UPDATE=103,cinder:SELECT=91,cinder:INSERT=24,cinder:DELETE=10 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:36:33 devstack sudo[93214]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6a1c7b04-fca8-481b-87c9-26a9381b3171 tempest-SnapshotsActionsTest-2012801752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.ae71ec80-951c-4a84-8409-f43feaf7df3c" returned: 0 in 1.008s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:33 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-6a1c7b04-fca8-481b-87c9-26a9381b3171 tempest-SnapshotsActionsTest-2012801752 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.ae71ec80-951c-4a84-8409-f43feaf7df3c is being set with open permissions: ugo+rw Jul 08 01:36:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6a1c7b04-fca8-481b-87c9-26a9381b3171 tempest-SnapshotsActionsTest-2012801752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.ae71ec80-951c-4a84-8409-f43feaf7df3c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:33 devstack sudo[93223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.ae71ec80-951c-4a84-8409-f43feaf7df3c Jul 08 01:36:33 devstack sudo[93223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:33 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-7b8e2048-7b95-4652-bb76-df7ceea73d06 tempest-AbsoluteLimitsTests-1969475873 None] Created reservations ['4012ac0d-4aae-40c2-82d3-74aa319a47f5', '0d572207-681e-4bb6-ba51-051de7798ef2', '03147e90-d0a5-4222-b0b0-6766c7f7ab45', '0349ebb6-f297-4d3f-b86f-48bd06e22364'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:36:33 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-ce640b95-1f2d-4b89-bfac-353b70a7fa28 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Delete snapshot completed successfully. Jul 08 01:36:34 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ce640b95-1f2d-4b89-bfac-353b70a7fa28 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Lock "cinder-c8f6c872-6441-4240-9337-9c22932f8e07-delete_snapshot" released by "delete_snapshot" :: held 4.557s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-7b8e2048-7b95-4652-bb76-df7ceea73d06 tempest-AbsoluteLimitsTests-1969475873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-7b8e2048-7b95-4652-bb76-df7ceea73d06 tempest-AbsoluteLimitsTests-1969475873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:34 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-7b8e2048-7b95-4652-bb76-df7ceea73d06 tempest-AbsoluteLimitsTests-1969475873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:36:34 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-7b8e2048-7b95-4652-bb76-df7ceea73d06 tempest-AbsoluteLimitsTests-1969475873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:36:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-7b8e2048-7b95-4652-bb76-df7ceea73d06 tempest-AbsoluteLimitsTests-1969475873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7b8e2048-7b95-4652-bb76-df7ceea73d06 tempest-AbsoluteLimitsTests-1969475873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:34 devstack sudo[93225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:36:34 devstack sudo[93225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:34 devstack sudo[93223]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6a1c7b04-fca8-481b-87c9-26a9381b3171 tempest-SnapshotsActionsTest-2012801752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.ae71ec80-951c-4a84-8409-f43feaf7df3c" returned: 0 in 0.885s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6a1c7b04-fca8-481b-87c9-26a9381b3171 tempest-SnapshotsActionsTest-2012801752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.225s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:34 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-6a1c7b04-fca8-481b-87c9-26a9381b3171 tempest-SnapshotsActionsTest-2012801752 None] Create snapshot completed successfully Jul 08 01:36:34 devstack sudo[93225]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7b8e2048-7b95-4652-bb76-df7ceea73d06 tempest-AbsoluteLimitsTests-1969475873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.746s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:34 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-7b8e2048-7b95-4652-bb76-df7ceea73d06 tempest-AbsoluteLimitsTests-1969475873 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:36:34 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-7b8e2048-7b95-4652-bb76-df7ceea73d06 tempest-AbsoluteLimitsTests-1969475873 None] Deleted volume successfully. Jul 08 01:36:34 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-7b8e2048-7b95-4652-bb76-df7ceea73d06 tempest-AbsoluteLimitsTests-1969475873 None] Lock "cinder-036ee9d0-6afa-4c3c-94ed-1479229b6955-delete_volume" released by "delete_volume" :: held 3.400s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:34 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-84cc99d1-fba8-4bbc-a82c-3d2e80b03af0 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Acquiring lock "cinder-a6e6c797-6568-4098-ab28-11cfc2f4a0c6-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:34 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-84cc99d1-fba8-4bbc-a82c-3d2e80b03af0 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Lock "cinder-a6e6c797-6568-4098-ab28-11cfc2f4a0c6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:35 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-84cc99d1-fba8-4bbc-a82c-3d2e80b03af0 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Acquiring lock "cinder-quobyte-a6e6c797-6568-4098-ab28-11cfc2f4a0c6" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:35 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-84cc99d1-fba8-4bbc-a82c-3d2e80b03af0 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Lock "cinder-quobyte-a6e6c797-6568-4098-ab28-11cfc2f4a0c6" acquired by "delete_volume" :: waited 0.028s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:35 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[33eadc47-b577-4043-8940-28973220337d]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:36:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-84cc99d1-fba8-4bbc-a82c-3d2e80b03af0 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:35 devstack sudo[93231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6 Jul 08 01:36:35 devstack sudo[93231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:35 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-954bdca6-e8dd-4eda-9f5d-0a7b605e304c tempest-SnapshotsActionsTest-579051250 None] Acquiring lock "cinder-ae71ec80-951c-4a84-8409-f43feaf7df3c-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:35 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-954bdca6-e8dd-4eda-9f5d-0a7b605e304c tempest-SnapshotsActionsTest-579051250 None] Lock "cinder-ae71ec80-951c-4a84-8409-f43feaf7df3c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:35 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-954bdca6-e8dd-4eda-9f5d-0a7b605e304c tempest-SnapshotsActionsTest-579051250 None] Acquiring lock "cinder-quobyte-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:35 devstack sudo[93231]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-84cc99d1-fba8-4bbc-a82c-3d2e80b03af0 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6" returned: 0 in 0.869s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-84cc99d1-fba8-4bbc-a82c-3d2e80b03af0 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:36 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-954bdca6-e8dd-4eda-9f5d-0a7b605e304c tempest-SnapshotsActionsTest-579051250 None] Lock "cinder-quobyte-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:36 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-954bdca6-e8dd-4eda-9f5d-0a7b605e304c tempest-SnapshotsActionsTest-579051250 None] Acquiring lock "cinder-quobyte-ae71ec80-951c-4a84-8409-f43feaf7df3c" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:36 devstack sudo[93239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6 Jul 08 01:36:36 devstack sudo[93239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:36 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-954bdca6-e8dd-4eda-9f5d-0a7b605e304c tempest-SnapshotsActionsTest-579051250 None] Lock "cinder-quobyte-ae71ec80-951c-4a84-8409-f43feaf7df3c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-954bdca6-e8dd-4eda-9f5d-0a7b605e304c tempest-SnapshotsActionsTest-579051250 None] Deleting offline snapshot ae71ec80-951c-4a84-8409-f43feaf7df3c of volume 678fcb9f-5ef4-4cb4-8549-c1294d6e87e5 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:36:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-954bdca6-e8dd-4eda-9f5d-0a7b605e304c tempest-SnapshotsActionsTest-579051250 None] snapshot_file for this snap is: volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.ae71ec80-951c-4a84-8409-f43feaf7df3c {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:36:36 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b28e5d-20dc-4256-90a0-bf0bdd1b7210]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:36:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-954bdca6-e8dd-4eda-9f5d-0a7b605e304c tempest-SnapshotsActionsTest-579051250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.ae71ec80-951c-4a84-8409-f43feaf7df3c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:36 devstack sudo[93242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.ae71ec80-951c-4a84-8409-f43feaf7df3c Jul 08 01:36:36 devstack sudo[93242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:36 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a78dba5-107f-4db0-bf21-9051ff5f90f5 tempest-AttachVolumeTestJSON-1425049151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:36:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4a78dba5-107f-4db0-bf21-9051ff5f90f5 tempest-AttachVolumeTestJSON-1425049151 None] Flow 'volume_create_manager' (28db4bd5-880f-47df-aa23-34a11389ab3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:36:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4a78dba5-107f-4db0-bf21-9051ff5f90f5 tempest-AttachVolumeTestJSON-1425049151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (262626f1-025b-47a4-a5e7-f49e7ef2b4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4a78dba5-107f-4db0-bf21-9051ff5f90f5 tempest-AttachVolumeTestJSON-1425049151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (262626f1-025b-47a4-a5e7-f49e7ef2b4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:36:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1422077121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=036ab950-64f6-4f78-9cd8-39551020e708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edad54f26b864ce99af045441a7ccb6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:36:37Z,use_quota=True,user_id='7eab7814fdd44227a113508d610b1fd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4a78dba5-107f-4db0-bf21-9051ff5f90f5 tempest-AttachVolumeTestJSON-1425049151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626aff2b-eecd-4c06-8c04-6e801e23128e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4a78dba5-107f-4db0-bf21-9051ff5f90f5 tempest-AttachVolumeTestJSON-1425049151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626aff2b-eecd-4c06-8c04-6e801e23128e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4a78dba5-107f-4db0-bf21-9051ff5f90f5 tempest-AttachVolumeTestJSON-1425049151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78bb9398-0453-4a04-a894-5f48f8728a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4a78dba5-107f-4db0-bf21-9051ff5f90f5 tempest-AttachVolumeTestJSON-1425049151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78bb9398-0453-4a04-a894-5f48f8728a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '036ab950-64f6-4f78-9cd8-39551020e708', 'volume_name': 'volume-036ab950-64f6-4f78-9cd8-39551020e708', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4a78dba5-107f-4db0-bf21-9051ff5f90f5 tempest-AttachVolumeTestJSON-1425049151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc03780-ccd2-4f20-8605-c2f6d20a04fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4a78dba5-107f-4db0-bf21-9051ff5f90f5 tempest-AttachVolumeTestJSON-1425049151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc03780-ccd2-4f20-8605-c2f6d20a04fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4a78dba5-107f-4db0-bf21-9051ff5f90f5 tempest-AttachVolumeTestJSON-1425049151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a24823a3-4ebe-4f5e-8761-ed90f10a28f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:36 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-4a78dba5-107f-4db0-bf21-9051ff5f90f5 tempest-AttachVolumeTestJSON-1425049151 None] Volume 036ab950-64f6-4f78-9cd8-39551020e708: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-036ab950-64f6-4f78-9cd8-39551020e708', 'volume_size': 1} Jul 08 01:36:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4a78dba5-107f-4db0-bf21-9051ff5f90f5 tempest-AttachVolumeTestJSON-1425049151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4a78dba5-107f-4db0-bf21-9051ff5f90f5 tempest-AttachVolumeTestJSON-1425049151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-4a78dba5-107f-4db0-bf21-9051ff5f90f5 tempest-AttachVolumeTestJSON-1425049151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:36:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1422077121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=036ab950-64f6-4f78-9cd8-39551020e708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edad54f26b864ce99af045441a7ccb6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:36:37Z,use_quota=True,user_id='7eab7814fdd44227a113508d610b1fd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:36:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-4a78dba5-107f-4db0-bf21-9051ff5f90f5 tempest-AttachVolumeTestJSON-1425049151 None] Creating volume 036ab950-64f6-4f78-9cd8-39551020e708 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:36:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4a78dba5-107f-4db0-bf21-9051ff5f90f5 tempest-AttachVolumeTestJSON-1425049151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4a78dba5-107f-4db0-bf21-9051ff5f90f5 tempest-AttachVolumeTestJSON-1425049151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-4a78dba5-107f-4db0-bf21-9051ff5f90f5 tempest-AttachVolumeTestJSON-1425049151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:36:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-4a78dba5-107f-4db0-bf21-9051ff5f90f5 tempest-AttachVolumeTestJSON-1425049151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:36:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4a78dba5-107f-4db0-bf21-9051ff5f90f5 tempest-AttachVolumeTestJSON-1425049151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-4a78dba5-107f-4db0-bf21-9051ff5f90f5 tempest-AttachVolumeTestJSON-1425049151 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:36:36 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-4a78dba5-107f-4db0-bf21-9051ff5f90f5 tempest-AttachVolumeTestJSON-1425049151 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:36:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4a78dba5-107f-4db0-bf21-9051ff5f90f5 tempest-AttachVolumeTestJSON-1425049151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-036ab950-64f6-4f78-9cd8-39551020e708 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:36 devstack sudo[93253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-036ab950-64f6-4f78-9cd8-39551020e708 1073741824 Jul 08 01:36:36 devstack sudo[93253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:37 devstack sudo[93239]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-84cc99d1-fba8-4bbc-a82c-3d2e80b03af0 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6e6c797-6568-4098-ab28-11cfc2f4a0c6" returned: 0 in 1.138s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:37 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-84cc99d1-fba8-4bbc-a82c-3d2e80b03af0 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Lock "cinder-quobyte-a6e6c797-6568-4098-ab28-11cfc2f4a0c6" released by "delete_volume" :: held 2.118s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:37 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-84cc99d1-fba8-4bbc-a82c-3d2e80b03af0 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Created reservations ['3c6dd3db-9dc2-4d57-8b64-756fa0bc25bf', '86471964-852f-4b2d-a513-9d0188fffbea', 'd06dbd40-cd8e-4235-aa85-673942fc0e7c', '51e249a7-76e3-4760-8515-0811b4777ca0'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:36:37 devstack sudo[93242]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-954bdca6-e8dd-4eda-9f5d-0a7b605e304c tempest-SnapshotsActionsTest-579051250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.ae71ec80-951c-4a84-8409-f43feaf7df3c" returned: 0 in 1.286s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:37 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-954bdca6-e8dd-4eda-9f5d-0a7b605e304c tempest-SnapshotsActionsTest-579051250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:36:37 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7b4892-ddc9-482f-85aa-51bad78b43e3]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:36:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-954bdca6-e8dd-4eda-9f5d-0a7b605e304c tempest-SnapshotsActionsTest-579051250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-84cc99d1-fba8-4bbc-a82c-3d2e80b03af0 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-84cc99d1-fba8-4bbc-a82c-3d2e80b03af0 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:37 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-84cc99d1-fba8-4bbc-a82c-3d2e80b03af0 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:36:37 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-84cc99d1-fba8-4bbc-a82c-3d2e80b03af0 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:36:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-84cc99d1-fba8-4bbc-a82c-3d2e80b03af0 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-84cc99d1-fba8-4bbc-a82c-3d2e80b03af0 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:37 devstack sudo[93260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:36:37 devstack sudo[93260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:37 devstack sudo[93259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 Jul 08 01:36:37 devstack sudo[93259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:38 devstack sudo[93253]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4a78dba5-107f-4db0-bf21-9051ff5f90f5 tempest-AttachVolumeTestJSON-1425049151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-036ab950-64f6-4f78-9cd8-39551020e708 1073741824" returned: 0 in 1.401s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4a78dba5-107f-4db0-bf21-9051ff5f90f5 tempest-AttachVolumeTestJSON-1425049151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-036ab950-64f6-4f78-9cd8-39551020e708 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:38 devstack sudo[93267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-036ab950-64f6-4f78-9cd8-39551020e708 Jul 08 01:36:38 devstack sudo[93267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:38 devstack sudo[93260]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-84cc99d1-fba8-4bbc-a82c-3d2e80b03af0 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.131s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:38 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-84cc99d1-fba8-4bbc-a82c-3d2e80b03af0 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:36:38 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-84cc99d1-fba8-4bbc-a82c-3d2e80b03af0 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Deleted volume successfully. Jul 08 01:36:38 devstack sudo[93259]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-954bdca6-e8dd-4eda-9f5d-0a7b605e304c tempest-SnapshotsActionsTest-579051250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5" returned: 0 in 1.225s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:38 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-954bdca6-e8dd-4eda-9f5d-0a7b605e304c tempest-SnapshotsActionsTest-579051250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:36:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-954bdca6-e8dd-4eda-9f5d-0a7b605e304c tempest-SnapshotsActionsTest-579051250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.ae71ec80-951c-4a84-8409-f43feaf7df3c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:38 devstack sudo[93273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.ae71ec80-951c-4a84-8409-f43feaf7df3c Jul 08 01:36:38 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-84cc99d1-fba8-4bbc-a82c-3d2e80b03af0 tempest-VolumeSnapshotQuotasNegativeTestJSON-606937891 None] Lock "cinder-a6e6c797-6568-4098-ab28-11cfc2f4a0c6-delete_volume" released by "delete_volume" :: held 3.765s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:38 devstack sudo[93273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:39 devstack sudo[93267]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4a78dba5-107f-4db0-bf21-9051ff5f90f5 tempest-AttachVolumeTestJSON-1425049151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-036ab950-64f6-4f78-9cd8-39551020e708" returned: 0 in 1.079s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:39 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-4a78dba5-107f-4db0-bf21-9051ff5f90f5 tempest-AttachVolumeTestJSON-1425049151 None] <== create_volume: return (2545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:36:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4a78dba5-107f-4db0-bf21-9051ff5f90f5 tempest-AttachVolumeTestJSON-1425049151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.548s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4a78dba5-107f-4db0-bf21-9051ff5f90f5 tempest-AttachVolumeTestJSON-1425049151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a24823a3-4ebe-4f5e-8761-ed90f10a28f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-036ab950-64f6-4f78-9cd8-39551020e708', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4a78dba5-107f-4db0-bf21-9051ff5f90f5 tempest-AttachVolumeTestJSON-1425049151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cbcb84f-f116-481a-a132-b80504f51467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:39 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-4a78dba5-107f-4db0-bf21-9051ff5f90f5 tempest-AttachVolumeTestJSON-1425049151 None] Volume volume-036ab950-64f6-4f78-9cd8-39551020e708 (036ab950-64f6-4f78-9cd8-39551020e708): created successfully Jul 08 01:36:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4a78dba5-107f-4db0-bf21-9051ff5f90f5 tempest-AttachVolumeTestJSON-1425049151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cbcb84f-f116-481a-a132-b80504f51467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4a78dba5-107f-4db0-bf21-9051ff5f90f5 tempest-AttachVolumeTestJSON-1425049151 None] Flow 'volume_create_manager' (28db4bd5-880f-47df-aa23-34a11389ab3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:36:39 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-4a78dba5-107f-4db0-bf21-9051ff5f90f5 tempest-AttachVolumeTestJSON-1425049151 None] Created volume successfully. Jul 08 01:36:39 devstack sudo[93273]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-954bdca6-e8dd-4eda-9f5d-0a7b605e304c tempest-SnapshotsActionsTest-579051250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.ae71ec80-951c-4a84-8409-f43feaf7df3c" returned: 0 in 1.022s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-954bdca6-e8dd-4eda-9f5d-0a7b605e304c tempest-SnapshotsActionsTest-579051250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.ae71ec80-951c-4a84-8409-f43feaf7df3c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:39 devstack sudo[93279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.ae71ec80-951c-4a84-8409-f43feaf7df3c Jul 08 01:36:39 devstack sudo[93279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:40 devstack sudo[93279]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-954bdca6-e8dd-4eda-9f5d-0a7b605e304c tempest-SnapshotsActionsTest-579051250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.ae71ec80-951c-4a84-8409-f43feaf7df3c" returned: 0 in 0.845s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:40 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-954bdca6-e8dd-4eda-9f5d-0a7b605e304c tempest-SnapshotsActionsTest-579051250 None] Lock "cinder-quobyte-ae71ec80-951c-4a84-8409-f43feaf7df3c" released by "_delete_snapshot" :: held 4.563s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:40 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-954bdca6-e8dd-4eda-9f5d-0a7b605e304c tempest-SnapshotsActionsTest-579051250 None] Lock "cinder-quobyte-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5" released by "delete_snapshot" :: held 4.608s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:40 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-954bdca6-e8dd-4eda-9f5d-0a7b605e304c tempest-SnapshotsActionsTest-579051250 None] Created reservations ['8ae39828-8108-4138-9fb4-05dbb5bf0a8c', '3c969584-e843-4258-b504-3b25a061400a', 'b20408aa-ea09-436a-8de0-0f5c0e9fe5c7', '8fe699d1-bdd0-4a09-9657-205fd95c3de6'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:36:40 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-954bdca6-e8dd-4eda-9f5d-0a7b605e304c tempest-SnapshotsActionsTest-579051250 None] Delete snapshot completed successfully. Jul 08 01:36:40 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-954bdca6-e8dd-4eda-9f5d-0a7b605e304c tempest-SnapshotsActionsTest-579051250 None] Lock "cinder-ae71ec80-951c-4a84-8409-f43feaf7df3c-delete_snapshot" released by "delete_snapshot" :: held 4.845s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:41 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-3692087f-5491-4dbf-9d37-ce4343e650f3 tempest-VolumesMetadataTest-512579391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:36:41 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3692087f-5491-4dbf-9d37-ce4343e650f3 tempest-VolumesMetadataTest-512579391 None] Flow 'volume_create_manager' (030262ee-92c7-4e6c-a280-efbde559f62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:36:41 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3692087f-5491-4dbf-9d37-ce4343e650f3 tempest-VolumesMetadataTest-512579391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29e20f7e-117d-49be-878d-5ca3ae3a63b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:41 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3692087f-5491-4dbf-9d37-ce4343e650f3 tempest-VolumesMetadataTest-512579391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29e20f7e-117d-49be-878d-5ca3ae3a63b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-809808990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fdf1df1-781d-41d1-9c94-cd8565d4c3db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86124426d445428bb61536cc2ebe3550',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:36:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:36:42Z,use_quota=True,user_id='7420eff44d7a4f4ab0397c3078ad7495',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:41 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3692087f-5491-4dbf-9d37-ce4343e650f3 tempest-VolumesMetadataTest-512579391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9636e4d4-5ed2-4e51-a2e3-5d2c393d8748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:41 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3692087f-5491-4dbf-9d37-ce4343e650f3 tempest-VolumesMetadataTest-512579391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9636e4d4-5ed2-4e51-a2e3-5d2c393d8748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:41 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3692087f-5491-4dbf-9d37-ce4343e650f3 tempest-VolumesMetadataTest-512579391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (542d9e5b-4571-447c-a36a-a363a0a77cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:41 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3692087f-5491-4dbf-9d37-ce4343e650f3 tempest-VolumesMetadataTest-512579391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (542d9e5b-4571-447c-a36a-a363a0a77cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fdf1df1-781d-41d1-9c94-cd8565d4c3db', 'volume_name': 'volume-9fdf1df1-781d-41d1-9c94-cd8565d4c3db', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:41 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3692087f-5491-4dbf-9d37-ce4343e650f3 tempest-VolumesMetadataTest-512579391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d8c4daf-9930-441f-8505-2089e5bbe53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:41 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3692087f-5491-4dbf-9d37-ce4343e650f3 tempest-VolumesMetadataTest-512579391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d8c4daf-9930-441f-8505-2089e5bbe53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:41 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3692087f-5491-4dbf-9d37-ce4343e650f3 tempest-VolumesMetadataTest-512579391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6422b11-6b65-4bc6-bf7b-491b58f2dc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:41 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-3692087f-5491-4dbf-9d37-ce4343e650f3 tempest-VolumesMetadataTest-512579391 None] Volume 9fdf1df1-781d-41d1-9c94-cd8565d4c3db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fdf1df1-781d-41d1-9c94-cd8565d4c3db', 'volume_size': 1} Jul 08 01:36:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3692087f-5491-4dbf-9d37-ce4343e650f3 tempest-VolumesMetadataTest-512579391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3692087f-5491-4dbf-9d37-ce4343e650f3 tempest-VolumesMetadataTest-512579391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:41 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3692087f-5491-4dbf-9d37-ce4343e650f3 tempest-VolumesMetadataTest-512579391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-809808990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fdf1df1-781d-41d1-9c94-cd8565d4c3db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86124426d445428bb61536cc2ebe3550',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:36:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:36:42Z,use_quota=True,user_id='7420eff44d7a4f4ab0397c3078ad7495',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:36:41 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-3692087f-5491-4dbf-9d37-ce4343e650f3 tempest-VolumesMetadataTest-512579391 None] Creating volume 9fdf1df1-781d-41d1-9c94-cd8565d4c3db {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:36:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3692087f-5491-4dbf-9d37-ce4343e650f3 tempest-VolumesMetadataTest-512579391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3692087f-5491-4dbf-9d37-ce4343e650f3 tempest-VolumesMetadataTest-512579391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:41 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3692087f-5491-4dbf-9d37-ce4343e650f3 tempest-VolumesMetadataTest-512579391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:36:41 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3692087f-5491-4dbf-9d37-ce4343e650f3 tempest-VolumesMetadataTest-512579391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:36:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3692087f-5491-4dbf-9d37-ce4343e650f3 tempest-VolumesMetadataTest-512579391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:41 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3692087f-5491-4dbf-9d37-ce4343e650f3 tempest-VolumesMetadataTest-512579391 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:36:41 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-3692087f-5491-4dbf-9d37-ce4343e650f3 tempest-VolumesMetadataTest-512579391 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:36:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3692087f-5491-4dbf-9d37-ce4343e650f3 tempest-VolumesMetadataTest-512579391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9fdf1df1-781d-41d1-9c94-cd8565d4c3db 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:41 devstack sudo[93286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9fdf1df1-781d-41d1-9c94-cd8565d4c3db 1073741824 Jul 08 01:36:41 devstack sudo[93286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8db25450-7faa-4530-bc9f-bcf469ca69d0 tempest-SnapshotsActionsTest-2012801752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:42 devstack sudo[93286]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3692087f-5491-4dbf-9d37-ce4343e650f3 tempest-VolumesMetadataTest-512579391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9fdf1df1-781d-41d1-9c94-cd8565d4c3db 1073741824" returned: 0 in 1.047s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3692087f-5491-4dbf-9d37-ce4343e650f3 tempest-VolumesMetadataTest-512579391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9fdf1df1-781d-41d1-9c94-cd8565d4c3db {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:42 devstack sudo[93293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9fdf1df1-781d-41d1-9c94-cd8565d4c3db Jul 08 01:36:42 devstack sudo[93293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:43 devstack sudo[93293]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3692087f-5491-4dbf-9d37-ce4343e650f3 tempest-VolumesMetadataTest-512579391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9fdf1df1-781d-41d1-9c94-cd8565d4c3db" returned: 0 in 0.725s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:43 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3692087f-5491-4dbf-9d37-ce4343e650f3 tempest-VolumesMetadataTest-512579391 None] <== create_volume: return (1820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:36:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3692087f-5491-4dbf-9d37-ce4343e650f3 tempest-VolumesMetadataTest-512579391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.822s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8db25450-7faa-4530-bc9f-bcf469ca69d0 tempest-SnapshotsActionsTest-2012801752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.765s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:43 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3692087f-5491-4dbf-9d37-ce4343e650f3 tempest-VolumesMetadataTest-512579391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6422b11-6b65-4bc6-bf7b-491b58f2dc2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fdf1df1-781d-41d1-9c94-cd8565d4c3db', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:43 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3692087f-5491-4dbf-9d37-ce4343e650f3 tempest-VolumesMetadataTest-512579391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85f8681f-c7eb-438c-9973-4f418ed8ee22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:43 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-8db25450-7faa-4530-bc9f-bcf469ca69d0 tempest-SnapshotsActionsTest-2012801752 None] Creating offline snapshot e4343a29-4a89-4c81-9073-25a3f87a5349 of volume 678fcb9f-5ef4-4cb4-8549-c1294d6e87e5 {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:36:43 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-3692087f-5491-4dbf-9d37-ce4343e650f3 tempest-VolumesMetadataTest-512579391 None] Volume volume-9fdf1df1-781d-41d1-9c94-cd8565d4c3db (9fdf1df1-781d-41d1-9c94-cd8565d4c3db): created successfully Jul 08 01:36:43 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3692087f-5491-4dbf-9d37-ce4343e650f3 tempest-VolumesMetadataTest-512579391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85f8681f-c7eb-438c-9973-4f418ed8ee22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:43 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3692087f-5491-4dbf-9d37-ce4343e650f3 tempest-VolumesMetadataTest-512579391 None] Flow 'volume_create_manager' (030262ee-92c7-4e6c-a280-efbde559f62a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:36:43 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab525e33-7c29-40dc-8c37-fa1673e5611a]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:36:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8db25450-7faa-4530-bc9f-bcf469ca69d0 tempest-SnapshotsActionsTest-2012801752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-2a4ed398-83b7-4f81-a211-a26881bd112c req-e13948d9-4d06-49a5-b5d1-842a116e8ff0 tempest-AttachVolumeTestJSON-1425049151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:43 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-3692087f-5491-4dbf-9d37-ce4343e650f3 tempest-VolumesMetadataTest-512579391 None] Created volume successfully. Jul 08 01:36:43 devstack sudo[93304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 Jul 08 01:36:43 devstack sudo[93304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:44 devstack sudo[93304]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8db25450-7faa-4530-bc9f-bcf469ca69d0 tempest-SnapshotsActionsTest-2012801752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5" returned: 0 in 0.861s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:44 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-8db25450-7faa-4530-bc9f-bcf469ca69d0 tempest-SnapshotsActionsTest-2012801752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:36:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8db25450-7faa-4530-bc9f-bcf469ca69d0 tempest-SnapshotsActionsTest-2012801752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.e4343a29-4a89-4c81-9073-25a3f87a5349 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:44 devstack sudo[93310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.e4343a29-4a89-4c81-9073-25a3f87a5349 1G Jul 08 01:36:44 devstack sudo[93310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:45 devstack sudo[93310]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8db25450-7faa-4530-bc9f-bcf469ca69d0 tempest-SnapshotsActionsTest-2012801752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.e4343a29-4a89-4c81-9073-25a3f87a5349 1G" returned: 0 in 1.033s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8db25450-7faa-4530-bc9f-bcf469ca69d0 tempest-SnapshotsActionsTest-2012801752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.e4343a29-4a89-4c81-9073-25a3f87a5349 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:45 devstack sudo[93318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.e4343a29-4a89-4c81-9073-25a3f87a5349 Jul 08 01:36:45 devstack sudo[93318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:45 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e065eae1-b0f2-44e0-80b8-5c1ecb33dddd tempest-VolumesMetadataTest-512579391 None] Acquiring lock "cinder-9fdf1df1-781d-41d1-9c94-cd8565d4c3db-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:45 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e065eae1-b0f2-44e0-80b8-5c1ecb33dddd tempest-VolumesMetadataTest-512579391 None] Lock "cinder-9fdf1df1-781d-41d1-9c94-cd8565d4c3db-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:45 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e065eae1-b0f2-44e0-80b8-5c1ecb33dddd tempest-VolumesMetadataTest-512579391 None] Acquiring lock "cinder-quobyte-9fdf1df1-781d-41d1-9c94-cd8565d4c3db" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:45 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e065eae1-b0f2-44e0-80b8-5c1ecb33dddd tempest-VolumesMetadataTest-512579391 None] Lock "cinder-quobyte-9fdf1df1-781d-41d1-9c94-cd8565d4c3db" acquired by "delete_volume" :: waited 0.020s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:45 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cc45a4-5b93-4f15-a6b9-50436c606e04]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:36:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e065eae1-b0f2-44e0-80b8-5c1ecb33dddd tempest-VolumesMetadataTest-512579391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9fdf1df1-781d-41d1-9c94-cd8565d4c3db {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:46 devstack sudo[93320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9fdf1df1-781d-41d1-9c94-cd8565d4c3db Jul 08 01:36:46 devstack sudo[93320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:46 devstack sudo[93318]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8db25450-7faa-4530-bc9f-bcf469ca69d0 tempest-SnapshotsActionsTest-2012801752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.e4343a29-4a89-4c81-9073-25a3f87a5349" returned: 0 in 0.833s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:46 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-8db25450-7faa-4530-bc9f-bcf469ca69d0 tempest-SnapshotsActionsTest-2012801752 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.e4343a29-4a89-4c81-9073-25a3f87a5349 is being set with open permissions: ugo+rw Jul 08 01:36:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8db25450-7faa-4530-bc9f-bcf469ca69d0 tempest-SnapshotsActionsTest-2012801752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.e4343a29-4a89-4c81-9073-25a3f87a5349 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:46 devstack sudo[93325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.e4343a29-4a89-4c81-9073-25a3f87a5349 Jul 08 01:36:46 devstack sudo[93325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:46 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-5deb6dc4-53b1-405c-bd92-ee16262a234f tempest-VolumeTypesAccessTest-1000165262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:36:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5deb6dc4-53b1-405c-bd92-ee16262a234f tempest-VolumeTypesAccessTest-1000165262 None] Flow 'volume_create_manager' (84836434-f976-4dfd-a0d9-a72198e6e07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:36:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5deb6dc4-53b1-405c-bd92-ee16262a234f tempest-VolumeTypesAccessTest-1000165262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (258b4ce9-6a5c-4eeb-b4c8-e862556a8cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5deb6dc4-53b1-405c-bd92-ee16262a234f tempest-VolumeTypesAccessTest-1000165262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (258b4ce9-6a5c-4eeb-b4c8-e862556a8cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-93750885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b1092a4-db2c-4f25-b2c3-a21f170100fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cd8f9462ca347e89d302429abbc67a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:36:47Z,use_quota=True,user_id='ffda6df7ab314e71b35f2cef32532b9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4663f0d3-0200-4263-8739-3c5454953a5e),volume_type_id=4663f0d3-0200-4263-8739-3c5454953a5e)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:46 devstack sudo[93320]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5deb6dc4-53b1-405c-bd92-ee16262a234f tempest-VolumeTypesAccessTest-1000165262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (785610cd-07aa-4241-88db-28a794201aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5deb6dc4-53b1-405c-bd92-ee16262a234f tempest-VolumeTypesAccessTest-1000165262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (785610cd-07aa-4241-88db-28a794201aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5deb6dc4-53b1-405c-bd92-ee16262a234f tempest-VolumeTypesAccessTest-1000165262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb3250c2-b1f0-4393-968e-57e241b949aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5deb6dc4-53b1-405c-bd92-ee16262a234f tempest-VolumeTypesAccessTest-1000165262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb3250c2-b1f0-4393-968e-57e241b949aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b1092a4-db2c-4f25-b2c3-a21f170100fe', 'volume_name': 'volume-3b1092a4-db2c-4f25-b2c3-a21f170100fe', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5deb6dc4-53b1-405c-bd92-ee16262a234f tempest-VolumeTypesAccessTest-1000165262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd11fbf8-0f76-4523-9a6c-8477daf60a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5deb6dc4-53b1-405c-bd92-ee16262a234f tempest-VolumeTypesAccessTest-1000165262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd11fbf8-0f76-4523-9a6c-8477daf60a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5deb6dc4-53b1-405c-bd92-ee16262a234f tempest-VolumeTypesAccessTest-1000165262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66edcf54-6ddf-4a39-be2e-189b234c93b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:46 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-5deb6dc4-53b1-405c-bd92-ee16262a234f tempest-VolumeTypesAccessTest-1000165262 None] Volume 3b1092a4-db2c-4f25-b2c3-a21f170100fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b1092a4-db2c-4f25-b2c3-a21f170100fe', 'volume_size': 1} Jul 08 01:36:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5deb6dc4-53b1-405c-bd92-ee16262a234f tempest-VolumeTypesAccessTest-1000165262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e065eae1-b0f2-44e0-80b8-5c1ecb33dddd tempest-VolumesMetadataTest-512579391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9fdf1df1-781d-41d1-9c94-cd8565d4c3db" returned: 0 in 1.006s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e065eae1-b0f2-44e0-80b8-5c1ecb33dddd tempest-VolumesMetadataTest-512579391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9fdf1df1-781d-41d1-9c94-cd8565d4c3db {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:46 devstack sudo[93330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9fdf1df1-781d-41d1-9c94-cd8565d4c3db Jul 08 01:36:46 devstack sudo[93330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:47 devstack sudo[93325]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8db25450-7faa-4530-bc9f-bcf469ca69d0 tempest-SnapshotsActionsTest-2012801752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.e4343a29-4a89-4c81-9073-25a3f87a5349" returned: 0 in 0.852s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8db25450-7faa-4530-bc9f-bcf469ca69d0 tempest-SnapshotsActionsTest-2012801752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.762s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-2a4ed398-83b7-4f81-a211-a26881bd112c req-e13948d9-4d06-49a5-b5d1-842a116e8ff0 tempest-AttachVolumeTestJSON-1425049151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.610s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:47 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[9704e198-5e2c-4c56-8616-96cb62413209]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:36:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-2a4ed398-83b7-4f81-a211-a26881bd112c req-e13948d9-4d06-49a5-b5d1-842a116e8ff0 tempest-AttachVolumeTestJSON-1425049151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-036ab950-64f6-4f78-9cd8-39551020e708 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:47 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-8db25450-7faa-4530-bc9f-bcf469ca69d0 tempest-SnapshotsActionsTest-2012801752 None] Create snapshot completed successfully Jul 08 01:36:47 devstack sudo[93333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-036ab950-64f6-4f78-9cd8-39551020e708 Jul 08 01:36:47 devstack sudo[93333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:47 devstack sudo[93330]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e065eae1-b0f2-44e0-80b8-5c1ecb33dddd tempest-VolumesMetadataTest-512579391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9fdf1df1-781d-41d1-9c94-cd8565d4c3db" returned: 0 in 0.689s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:47 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e065eae1-b0f2-44e0-80b8-5c1ecb33dddd tempest-VolumesMetadataTest-512579391 None] Lock "cinder-quobyte-9fdf1df1-781d-41d1-9c94-cd8565d4c3db" released by "delete_volume" :: held 1.750s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:47 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-e065eae1-b0f2-44e0-80b8-5c1ecb33dddd tempest-VolumesMetadataTest-512579391 None] Created reservations ['27142038-6c13-4031-a7e8-f714df4c8611', '846d911b-c1f4-46f4-8cba-3622beffad02', 'ba1e3da3-33d3-4433-94f3-c7b2ee40c4fb', '8e4e0a9c-ec65-41dc-b354-1967cd9f3893'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:36:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e065eae1-b0f2-44e0-80b8-5c1ecb33dddd tempest-VolumesMetadataTest-512579391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e065eae1-b0f2-44e0-80b8-5c1ecb33dddd tempest-VolumesMetadataTest-512579391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:47 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e065eae1-b0f2-44e0-80b8-5c1ecb33dddd tempest-VolumesMetadataTest-512579391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:36:47 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e065eae1-b0f2-44e0-80b8-5c1ecb33dddd tempest-VolumesMetadataTest-512579391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:36:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e065eae1-b0f2-44e0-80b8-5c1ecb33dddd tempest-VolumesMetadataTest-512579391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e065eae1-b0f2-44e0-80b8-5c1ecb33dddd tempest-VolumesMetadataTest-512579391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:47 devstack sudo[93336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:36:47 devstack sudo[93336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:48 devstack sudo[93333]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-2a4ed398-83b7-4f81-a211-a26881bd112c req-e13948d9-4d06-49a5-b5d1-842a116e8ff0 tempest-AttachVolumeTestJSON-1425049151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-036ab950-64f6-4f78-9cd8-39551020e708" returned: 0 in 0.824s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-2a4ed398-83b7-4f81-a211-a26881bd112c req-e13948d9-4d06-49a5-b5d1-842a116e8ff0 tempest-AttachVolumeTestJSON-1425049151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.846s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5deb6dc4-53b1-405c-bd92-ee16262a234f tempest-VolumeTypesAccessTest-1000165262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.272s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:48 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5deb6dc4-53b1-405c-bd92-ee16262a234f tempest-VolumeTypesAccessTest-1000165262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-93750885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b1092a4-db2c-4f25-b2c3-a21f170100fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cd8f9462ca347e89d302429abbc67a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:36:47Z,use_quota=True,user_id='ffda6df7ab314e71b35f2cef32532b9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4663f0d3-0200-4263-8739-3c5454953a5e),volume_type_id=4663f0d3-0200-4263-8739-3c5454953a5e)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:36:48 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-5deb6dc4-53b1-405c-bd92-ee16262a234f tempest-VolumeTypesAccessTest-1000165262 None] Creating volume 3b1092a4-db2c-4f25-b2c3-a21f170100fe {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:36:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5deb6dc4-53b1-405c-bd92-ee16262a234f tempest-VolumeTypesAccessTest-1000165262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5deb6dc4-53b1-405c-bd92-ee16262a234f tempest-VolumeTypesAccessTest-1000165262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:48 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5deb6dc4-53b1-405c-bd92-ee16262a234f tempest-VolumeTypesAccessTest-1000165262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:36:48 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5deb6dc4-53b1-405c-bd92-ee16262a234f tempest-VolumeTypesAccessTest-1000165262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:36:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5deb6dc4-53b1-405c-bd92-ee16262a234f tempest-VolumeTypesAccessTest-1000165262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:48 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5deb6dc4-53b1-405c-bd92-ee16262a234f tempest-VolumeTypesAccessTest-1000165262 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:36:48 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-5deb6dc4-53b1-405c-bd92-ee16262a234f tempest-VolumeTypesAccessTest-1000165262 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:36:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5deb6dc4-53b1-405c-bd92-ee16262a234f tempest-VolumeTypesAccessTest-1000165262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3b1092a4-db2c-4f25-b2c3-a21f170100fe 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:48 devstack sudo[93341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3b1092a4-db2c-4f25-b2c3-a21f170100fe 1073741824 Jul 08 01:36:48 devstack sudo[93341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-2a4ed398-83b7-4f81-a211-a26881bd112c req-e13948d9-4d06-49a5-b5d1-842a116e8ff0 tempest-AttachVolumeTestJSON-1425049151 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96', 'name': 'volume-036ab950-64f6-4f78-9cd8-39551020e708', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7cc8cd1b-361e-43dc-8814-2d30903b676b', 'enforce_multipath': True} {{(pid=87284) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:36:48 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-86332cae-b686-426a-b76a-c985b2b54e66 tempest-SnapshotsActionsTest-579051250 None] Acquiring lock "cinder-e4343a29-4a89-4c81-9073-25a3f87a5349-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:48 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-2a4ed398-83b7-4f81-a211-a26881bd112c req-e13948d9-4d06-49a5-b5d1-842a116e8ff0 tempest-AttachVolumeTestJSON-1425049151 None] attachment_update completed successfully. Jul 08 01:36:48 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-86332cae-b686-426a-b76a-c985b2b54e66 tempest-SnapshotsActionsTest-579051250 None] Lock "cinder-e4343a29-4a89-4c81-9073-25a3f87a5349-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:48 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-86332cae-b686-426a-b76a-c985b2b54e66 tempest-SnapshotsActionsTest-579051250 None] Acquiring lock "cinder-quobyte-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:48 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-86332cae-b686-426a-b76a-c985b2b54e66 tempest-SnapshotsActionsTest-579051250 None] Lock "cinder-quobyte-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:48 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-86332cae-b686-426a-b76a-c985b2b54e66 tempest-SnapshotsActionsTest-579051250 None] Acquiring lock "cinder-quobyte-e4343a29-4a89-4c81-9073-25a3f87a5349" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:48 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-86332cae-b686-426a-b76a-c985b2b54e66 tempest-SnapshotsActionsTest-579051250 None] Lock "cinder-quobyte-e4343a29-4a89-4c81-9073-25a3f87a5349" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:48 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-86332cae-b686-426a-b76a-c985b2b54e66 tempest-SnapshotsActionsTest-579051250 None] Deleting offline snapshot e4343a29-4a89-4c81-9073-25a3f87a5349 of volume 678fcb9f-5ef4-4cb4-8549-c1294d6e87e5 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:36:48 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-86332cae-b686-426a-b76a-c985b2b54e66 tempest-SnapshotsActionsTest-579051250 None] snapshot_file for this snap is: volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.e4343a29-4a89-4c81-9073-25a3f87a5349 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:36:48 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[4920cd38-6e13-4df6-bc8a-cc1c54c78b68]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:36:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-86332cae-b686-426a-b76a-c985b2b54e66 tempest-SnapshotsActionsTest-579051250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.e4343a29-4a89-4c81-9073-25a3f87a5349 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:48 devstack sudo[93344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.e4343a29-4a89-4c81-9073-25a3f87a5349 Jul 08 01:36:48 devstack sudo[93344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:48 devstack sudo[93336]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e065eae1-b0f2-44e0-80b8-5c1ecb33dddd tempest-VolumesMetadataTest-512579391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.945s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:48 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-e065eae1-b0f2-44e0-80b8-5c1ecb33dddd tempest-VolumesMetadataTest-512579391 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:36:48 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-e065eae1-b0f2-44e0-80b8-5c1ecb33dddd tempest-VolumesMetadataTest-512579391 None] Deleted volume successfully. Jul 08 01:36:48 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e065eae1-b0f2-44e0-80b8-5c1ecb33dddd tempest-VolumesMetadataTest-512579391 None] Lock "cinder-9fdf1df1-781d-41d1-9c94-cd8565d4c3db-delete_volume" released by "delete_volume" :: held 2.995s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:49 devstack sudo[93341]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5deb6dc4-53b1-405c-bd92-ee16262a234f tempest-VolumeTypesAccessTest-1000165262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3b1092a4-db2c-4f25-b2c3-a21f170100fe 1073741824" returned: 0 in 1.358s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5deb6dc4-53b1-405c-bd92-ee16262a234f tempest-VolumeTypesAccessTest-1000165262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3b1092a4-db2c-4f25-b2c3-a21f170100fe {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:49 devstack sudo[93735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3b1092a4-db2c-4f25-b2c3-a21f170100fe Jul 08 01:36:49 devstack sudo[93735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:49 devstack sudo[93344]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-86332cae-b686-426a-b76a-c985b2b54e66 tempest-SnapshotsActionsTest-579051250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.e4343a29-4a89-4c81-9073-25a3f87a5349" returned: 0 in 1.231s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:49 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-86332cae-b686-426a-b76a-c985b2b54e66 tempest-SnapshotsActionsTest-579051250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:36:49 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe877ff-23f5-407a-8c39-4f44707a11ff]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:36:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-86332cae-b686-426a-b76a-c985b2b54e66 tempest-SnapshotsActionsTest-579051250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:50 devstack sudo[93737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 Jul 08 01:36:50 devstack sudo[93737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:50 devstack sudo[93735]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5deb6dc4-53b1-405c-bd92-ee16262a234f tempest-VolumeTypesAccessTest-1000165262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3b1092a4-db2c-4f25-b2c3-a21f170100fe" returned: 0 in 0.900s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5deb6dc4-53b1-405c-bd92-ee16262a234f tempest-VolumeTypesAccessTest-1000165262 None] <== create_volume: return (2362ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:36:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5deb6dc4-53b1-405c-bd92-ee16262a234f tempest-VolumeTypesAccessTest-1000165262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.368s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5deb6dc4-53b1-405c-bd92-ee16262a234f tempest-VolumeTypesAccessTest-1000165262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66edcf54-6ddf-4a39-be2e-189b234c93b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b1092a4-db2c-4f25-b2c3-a21f170100fe', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5deb6dc4-53b1-405c-bd92-ee16262a234f tempest-VolumeTypesAccessTest-1000165262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5f42ff2-58fa-463a-9414-a901371ea4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:50 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-5deb6dc4-53b1-405c-bd92-ee16262a234f tempest-VolumeTypesAccessTest-1000165262 None] Volume volume-3b1092a4-db2c-4f25-b2c3-a21f170100fe (3b1092a4-db2c-4f25-b2c3-a21f170100fe): created successfully Jul 08 01:36:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5deb6dc4-53b1-405c-bd92-ee16262a234f tempest-VolumeTypesAccessTest-1000165262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5f42ff2-58fa-463a-9414-a901371ea4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5deb6dc4-53b1-405c-bd92-ee16262a234f tempest-VolumeTypesAccessTest-1000165262 None] Flow 'volume_create_manager' (84836434-f976-4dfd-a0d9-a72198e6e07f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:36:50 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-5deb6dc4-53b1-405c-bd92-ee16262a234f tempest-VolumeTypesAccessTest-1000165262 None] Created volume successfully. Jul 08 01:36:50 devstack sudo[93737]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-86332cae-b686-426a-b76a-c985b2b54e66 tempest-SnapshotsActionsTest-579051250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5" returned: 0 in 0.989s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-86332cae-b686-426a-b76a-c985b2b54e66 tempest-SnapshotsActionsTest-579051250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:36:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-86332cae-b686-426a-b76a-c985b2b54e66 tempest-SnapshotsActionsTest-579051250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.e4343a29-4a89-4c81-9073-25a3f87a5349 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:50 devstack sudo[93744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.e4343a29-4a89-4c81-9073-25a3f87a5349 Jul 08 01:36:50 devstack sudo[93744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:51 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-9414d8c4-19e1-4dbe-82f8-6049fbf4151e tempest-VolumeTypesAccessTest-1000165262 None] Acquiring lock "cinder-3b1092a4-db2c-4f25-b2c3-a21f170100fe-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:51 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-9414d8c4-19e1-4dbe-82f8-6049fbf4151e tempest-VolumeTypesAccessTest-1000165262 None] Lock "cinder-3b1092a4-db2c-4f25-b2c3-a21f170100fe-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:51 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-9414d8c4-19e1-4dbe-82f8-6049fbf4151e tempest-VolumeTypesAccessTest-1000165262 None] Acquiring lock "cinder-quobyte-3b1092a4-db2c-4f25-b2c3-a21f170100fe" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:51 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-9414d8c4-19e1-4dbe-82f8-6049fbf4151e tempest-VolumeTypesAccessTest-1000165262 None] Lock "cinder-quobyte-3b1092a4-db2c-4f25-b2c3-a21f170100fe" acquired by "delete_volume" :: waited 0.018s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:51 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[4758853a-55c9-443f-baa7-513df975c9e5]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:36:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9414d8c4-19e1-4dbe-82f8-6049fbf4151e tempest-VolumeTypesAccessTest-1000165262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3b1092a4-db2c-4f25-b2c3-a21f170100fe {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:51 devstack sudo[93746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3b1092a4-db2c-4f25-b2c3-a21f170100fe Jul 08 01:36:51 devstack sudo[93746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:51 devstack sudo[93744]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-86332cae-b686-426a-b76a-c985b2b54e66 tempest-SnapshotsActionsTest-579051250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.e4343a29-4a89-4c81-9073-25a3f87a5349" returned: 0 in 0.889s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-86332cae-b686-426a-b76a-c985b2b54e66 tempest-SnapshotsActionsTest-579051250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.e4343a29-4a89-4c81-9073-25a3f87a5349 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:51 devstack sudo[93752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.e4343a29-4a89-4c81-9073-25a3f87a5349 Jul 08 01:36:51 devstack sudo[93752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:52 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-04b816de-8000-4600-ae4d-70cba9ff8d3a tempest-VolumesSnapshotListTestJSON-74209177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:36:52 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-04b816de-8000-4600-ae4d-70cba9ff8d3a tempest-VolumesSnapshotListTestJSON-74209177 None] Flow 'volume_create_manager' (c36a89e8-74e1-41bf-9eca-68912ff0f60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:36:52 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-04b816de-8000-4600-ae4d-70cba9ff8d3a tempest-VolumesSnapshotListTestJSON-74209177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81d9f80e-4f74-41b6-af5c-365b94e1be31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:52 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-04b816de-8000-4600-ae4d-70cba9ff8d3a tempest-VolumesSnapshotListTestJSON-74209177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81d9f80e-4f74-41b6-af5c-365b94e1be31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1947293639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59106196-2e47-45ef-b2b3-28af98f6e2ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e59b02f4066c47cdadfd1464e81b290a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:36:52Z,use_quota=True,user_id='4405cd5617f843efa45267a0da44b133',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:52 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-04b816de-8000-4600-ae4d-70cba9ff8d3a tempest-VolumesSnapshotListTestJSON-74209177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (186237b5-be5a-4edc-81d7-373e508352e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:52 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-04b816de-8000-4600-ae4d-70cba9ff8d3a tempest-VolumesSnapshotListTestJSON-74209177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (186237b5-be5a-4edc-81d7-373e508352e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:52 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-04b816de-8000-4600-ae4d-70cba9ff8d3a tempest-VolumesSnapshotListTestJSON-74209177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a22c9e2-6b1a-4e48-a9b9-ae6461bc6597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:52 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-04b816de-8000-4600-ae4d-70cba9ff8d3a tempest-VolumesSnapshotListTestJSON-74209177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a22c9e2-6b1a-4e48-a9b9-ae6461bc6597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59106196-2e47-45ef-b2b3-28af98f6e2ab', 'volume_name': 'volume-59106196-2e47-45ef-b2b3-28af98f6e2ab', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:52 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-04b816de-8000-4600-ae4d-70cba9ff8d3a tempest-VolumesSnapshotListTestJSON-74209177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaafaea3-f4d2-4a73-92ad-451720d57186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:52 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-04b816de-8000-4600-ae4d-70cba9ff8d3a tempest-VolumesSnapshotListTestJSON-74209177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaafaea3-f4d2-4a73-92ad-451720d57186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:52 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-04b816de-8000-4600-ae4d-70cba9ff8d3a tempest-VolumesSnapshotListTestJSON-74209177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae9c6950-b145-4c6b-be3e-486f35f8b251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:52 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-04b816de-8000-4600-ae4d-70cba9ff8d3a tempest-VolumesSnapshotListTestJSON-74209177 None] Volume 59106196-2e47-45ef-b2b3-28af98f6e2ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59106196-2e47-45ef-b2b3-28af98f6e2ab', 'volume_size': 1} Jul 08 01:36:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-04b816de-8000-4600-ae4d-70cba9ff8d3a tempest-VolumesSnapshotListTestJSON-74209177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-04b816de-8000-4600-ae4d-70cba9ff8d3a tempest-VolumesSnapshotListTestJSON-74209177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-04b816de-8000-4600-ae4d-70cba9ff8d3a tempest-VolumesSnapshotListTestJSON-74209177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1947293639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59106196-2e47-45ef-b2b3-28af98f6e2ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e59b02f4066c47cdadfd1464e81b290a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:36:52Z,use_quota=True,user_id='4405cd5617f843efa45267a0da44b133',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:36:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-04b816de-8000-4600-ae4d-70cba9ff8d3a tempest-VolumesSnapshotListTestJSON-74209177 None] Creating volume 59106196-2e47-45ef-b2b3-28af98f6e2ab {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:36:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-04b816de-8000-4600-ae4d-70cba9ff8d3a tempest-VolumesSnapshotListTestJSON-74209177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-04b816de-8000-4600-ae4d-70cba9ff8d3a tempest-VolumesSnapshotListTestJSON-74209177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-04b816de-8000-4600-ae4d-70cba9ff8d3a tempest-VolumesSnapshotListTestJSON-74209177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:36:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-04b816de-8000-4600-ae4d-70cba9ff8d3a tempest-VolumesSnapshotListTestJSON-74209177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:36:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-04b816de-8000-4600-ae4d-70cba9ff8d3a tempest-VolumesSnapshotListTestJSON-74209177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-04b816de-8000-4600-ae4d-70cba9ff8d3a tempest-VolumesSnapshotListTestJSON-74209177 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:36:52 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-04b816de-8000-4600-ae4d-70cba9ff8d3a tempest-VolumesSnapshotListTestJSON-74209177 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:36:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-04b816de-8000-4600-ae4d-70cba9ff8d3a tempest-VolumesSnapshotListTestJSON-74209177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:52 devstack sudo[93757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab 1073741824 Jul 08 01:36:52 devstack sudo[93757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:52 devstack sudo[93746]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9414d8c4-19e1-4dbe-82f8-6049fbf4151e tempest-VolumeTypesAccessTest-1000165262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3b1092a4-db2c-4f25-b2c3-a21f170100fe" returned: 0 in 1.024s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9414d8c4-19e1-4dbe-82f8-6049fbf4151e tempest-VolumeTypesAccessTest-1000165262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3b1092a4-db2c-4f25-b2c3-a21f170100fe {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:52 devstack sudo[93759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3b1092a4-db2c-4f25-b2c3-a21f170100fe Jul 08 01:36:52 devstack sudo[93759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:52 devstack sudo[93752]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-86332cae-b686-426a-b76a-c985b2b54e66 tempest-SnapshotsActionsTest-579051250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.e4343a29-4a89-4c81-9073-25a3f87a5349" returned: 0 in 0.846s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:52 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-86332cae-b686-426a-b76a-c985b2b54e66 tempest-SnapshotsActionsTest-579051250 None] Lock "cinder-quobyte-e4343a29-4a89-4c81-9073-25a3f87a5349" released by "_delete_snapshot" :: held 4.122s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:52 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-86332cae-b686-426a-b76a-c985b2b54e66 tempest-SnapshotsActionsTest-579051250 None] Lock "cinder-quobyte-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5" released by "delete_snapshot" :: held 4.156s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:52 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-86332cae-b686-426a-b76a-c985b2b54e66 tempest-SnapshotsActionsTest-579051250 None] Created reservations ['ce43750f-6b49-4d5a-b937-e848130839e2', 'cec7bd1f-38f7-472f-a8fc-5334dafd0fd4', '3022832e-d406-4b99-ba90-ab8e7ac4f5e3', '1700961e-b623-4c40-bdc2-f08c4961a992'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:36:52 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-86332cae-b686-426a-b76a-c985b2b54e66 tempest-SnapshotsActionsTest-579051250 None] Delete snapshot completed successfully. Jul 08 01:36:52 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-86332cae-b686-426a-b76a-c985b2b54e66 tempest-SnapshotsActionsTest-579051250 None] Lock "cinder-e4343a29-4a89-4c81-9073-25a3f87a5349-delete_snapshot" released by "delete_snapshot" :: held 4.379s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:53 devstack sudo[93759]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9414d8c4-19e1-4dbe-82f8-6049fbf4151e tempest-VolumeTypesAccessTest-1000165262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3b1092a4-db2c-4f25-b2c3-a21f170100fe" returned: 0 in 0.854s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:53 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-9414d8c4-19e1-4dbe-82f8-6049fbf4151e tempest-VolumeTypesAccessTest-1000165262 None] Lock "cinder-quobyte-3b1092a4-db2c-4f25-b2c3-a21f170100fe" released by "delete_volume" :: held 1.941s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:53 devstack cinder-volume[87284]: WARNING cinder.quota [None req-9414d8c4-19e1-4dbe-82f8-6049fbf4151e tempest-VolumeTypesAccessTest-1000165262 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1561408964 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1561408964, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:36:53 devstack cinder-volume[87284]: WARNING cinder.quota [None req-9414d8c4-19e1-4dbe-82f8-6049fbf4151e tempest-VolumeTypesAccessTest-1000165262 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1561408964 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1561408964, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:36:53 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-9414d8c4-19e1-4dbe-82f8-6049fbf4151e tempest-VolumeTypesAccessTest-1000165262 None] Created reservations ['6216aa4b-87a8-422e-a2a4-9ef08a67845a', '5164da40-6051-4e38-9266-f1205833d797', 'b81ca622-cd3f-4c8a-8cc8-34b8bf13675c', '1978bf59-6e9b-42e3-9abd-fcb047796756'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:36:53 devstack sudo[93757]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-04b816de-8000-4600-ae4d-70cba9ff8d3a tempest-VolumesSnapshotListTestJSON-74209177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab 1073741824" returned: 0 in 1.058s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-9414d8c4-19e1-4dbe-82f8-6049fbf4151e tempest-VolumeTypesAccessTest-1000165262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-9414d8c4-19e1-4dbe-82f8-6049fbf4151e tempest-VolumeTypesAccessTest-1000165262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:53 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-9414d8c4-19e1-4dbe-82f8-6049fbf4151e tempest-VolumeTypesAccessTest-1000165262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:36:53 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-9414d8c4-19e1-4dbe-82f8-6049fbf4151e tempest-VolumeTypesAccessTest-1000165262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:36:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-9414d8c4-19e1-4dbe-82f8-6049fbf4151e tempest-VolumeTypesAccessTest-1000165262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9414d8c4-19e1-4dbe-82f8-6049fbf4151e tempest-VolumeTypesAccessTest-1000165262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-04b816de-8000-4600-ae4d-70cba9ff8d3a tempest-VolumesSnapshotListTestJSON-74209177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:53 devstack sudo[93767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:36:53 devstack sudo[93767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:53 devstack sudo[93768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab Jul 08 01:36:53 devstack sudo[93768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc1c2bcb-2e8b-4f87-899d-e57a1077c2fc tempest-AttachVolumeTestJSON-1425049151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc1c2bcb-2e8b-4f87-899d-e57a1077c2fc tempest-AttachVolumeTestJSON-1425049151 None] Flow 'volume_create_manager' (a5d37c1a-c610-4366-91f6-e7771b79f299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc1c2bcb-2e8b-4f87-899d-e57a1077c2fc tempest-AttachVolumeTestJSON-1425049151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c3581d-342b-49e8-acb8-435ea50a7dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc1c2bcb-2e8b-4f87-899d-e57a1077c2fc tempest-AttachVolumeTestJSON-1425049151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c3581d-342b-49e8-acb8-435ea50a7dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-317764029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a32bbbc8-11f2-481a-861d-3e5a85149313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edad54f26b864ce99af045441a7ccb6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:36:54Z,use_quota=True,user_id='7eab7814fdd44227a113508d610b1fd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc1c2bcb-2e8b-4f87-899d-e57a1077c2fc tempest-AttachVolumeTestJSON-1425049151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e93826c9-ad3e-41c2-98a8-642beddfd223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc1c2bcb-2e8b-4f87-899d-e57a1077c2fc tempest-AttachVolumeTestJSON-1425049151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e93826c9-ad3e-41c2-98a8-642beddfd223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc1c2bcb-2e8b-4f87-899d-e57a1077c2fc tempest-AttachVolumeTestJSON-1425049151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b86d782-dca9-4c91-bc55-119f1beefc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc1c2bcb-2e8b-4f87-899d-e57a1077c2fc tempest-AttachVolumeTestJSON-1425049151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b86d782-dca9-4c91-bc55-119f1beefc00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a32bbbc8-11f2-481a-861d-3e5a85149313', 'volume_name': 'volume-a32bbbc8-11f2-481a-861d-3e5a85149313', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc1c2bcb-2e8b-4f87-899d-e57a1077c2fc tempest-AttachVolumeTestJSON-1425049151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efcc8716-ce11-4782-b293-71d046dc6bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc1c2bcb-2e8b-4f87-899d-e57a1077c2fc tempest-AttachVolumeTestJSON-1425049151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efcc8716-ce11-4782-b293-71d046dc6bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc1c2bcb-2e8b-4f87-899d-e57a1077c2fc tempest-AttachVolumeTestJSON-1425049151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec6df13-86bb-44ec-8fa5-ee4666e73285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:54 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-cc1c2bcb-2e8b-4f87-899d-e57a1077c2fc tempest-AttachVolumeTestJSON-1425049151 None] Volume a32bbbc8-11f2-481a-861d-3e5a85149313: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a32bbbc8-11f2-481a-861d-3e5a85149313', 'volume_size': 1} Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-cc1c2bcb-2e8b-4f87-899d-e57a1077c2fc tempest-AttachVolumeTestJSON-1425049151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:54 devstack sudo[93767]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9414d8c4-19e1-4dbe-82f8-6049fbf4151e tempest-VolumeTypesAccessTest-1000165262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.090s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-9414d8c4-19e1-4dbe-82f8-6049fbf4151e tempest-VolumeTypesAccessTest-1000165262 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:36:54 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-9414d8c4-19e1-4dbe-82f8-6049fbf4151e tempest-VolumeTypesAccessTest-1000165262 None] Deleted volume successfully. Jul 08 01:36:54 devstack sudo[93768]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-04b816de-8000-4600-ae4d-70cba9ff8d3a tempest-VolumesSnapshotListTestJSON-74209177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab" returned: 0 in 1.121s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-9414d8c4-19e1-4dbe-82f8-6049fbf4151e tempest-VolumeTypesAccessTest-1000165262 None] Lock "cinder-3b1092a4-db2c-4f25-b2c3-a21f170100fe-delete_volume" released by "delete_volume" :: held 3.337s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-04b816de-8000-4600-ae4d-70cba9ff8d3a tempest-VolumesSnapshotListTestJSON-74209177 None] <== create_volume: return (2264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-04b816de-8000-4600-ae4d-70cba9ff8d3a tempest-VolumesSnapshotListTestJSON-74209177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.267s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-cc1c2bcb-2e8b-4f87-899d-e57a1077c2fc tempest-AttachVolumeTestJSON-1425049151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.187s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-cc1c2bcb-2e8b-4f87-899d-e57a1077c2fc tempest-AttachVolumeTestJSON-1425049151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-317764029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a32bbbc8-11f2-481a-861d-3e5a85149313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edad54f26b864ce99af045441a7ccb6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:36:54Z,use_quota=True,user_id='7eab7814fdd44227a113508d610b1fd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-cc1c2bcb-2e8b-4f87-899d-e57a1077c2fc tempest-AttachVolumeTestJSON-1425049151 None] Creating volume a32bbbc8-11f2-481a-861d-3e5a85149313 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-cc1c2bcb-2e8b-4f87-899d-e57a1077c2fc tempest-AttachVolumeTestJSON-1425049151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-cc1c2bcb-2e8b-4f87-899d-e57a1077c2fc tempest-AttachVolumeTestJSON-1425049151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-cc1c2bcb-2e8b-4f87-899d-e57a1077c2fc tempest-AttachVolumeTestJSON-1425049151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-cc1c2bcb-2e8b-4f87-899d-e57a1077c2fc tempest-AttachVolumeTestJSON-1425049151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-cc1c2bcb-2e8b-4f87-899d-e57a1077c2fc tempest-AttachVolumeTestJSON-1425049151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-cc1c2bcb-2e8b-4f87-899d-e57a1077c2fc tempest-AttachVolumeTestJSON-1425049151 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:36:54 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-cc1c2bcb-2e8b-4f87-899d-e57a1077c2fc tempest-AttachVolumeTestJSON-1425049151 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc1c2bcb-2e8b-4f87-899d-e57a1077c2fc tempest-AttachVolumeTestJSON-1425049151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a32bbbc8-11f2-481a-861d-3e5a85149313 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:54 devstack sudo[93774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a32bbbc8-11f2-481a-861d-3e5a85149313 1073741824 Jul 08 01:36:54 devstack sudo[93774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-04b816de-8000-4600-ae4d-70cba9ff8d3a tempest-VolumesSnapshotListTestJSON-74209177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae9c6950-b145-4c6b-be3e-486f35f8b251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59106196-2e47-45ef-b2b3-28af98f6e2ab', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-04b816de-8000-4600-ae4d-70cba9ff8d3a tempest-VolumesSnapshotListTestJSON-74209177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d77bb99-4b2f-4456-bbdf-7fdaf4749eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:54 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-04b816de-8000-4600-ae4d-70cba9ff8d3a tempest-VolumesSnapshotListTestJSON-74209177 None] Volume volume-59106196-2e47-45ef-b2b3-28af98f6e2ab (59106196-2e47-45ef-b2b3-28af98f6e2ab): created successfully Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-04b816de-8000-4600-ae4d-70cba9ff8d3a tempest-VolumesSnapshotListTestJSON-74209177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d77bb99-4b2f-4456-bbdf-7fdaf4749eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-04b816de-8000-4600-ae4d-70cba9ff8d3a tempest-VolumesSnapshotListTestJSON-74209177 None] Flow 'volume_create_manager' (c36a89e8-74e1-41bf-9eca-68912ff0f60f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:36:54 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-04b816de-8000-4600-ae4d-70cba9ff8d3a tempest-VolumesSnapshotListTestJSON-74209177 None] Created volume successfully. Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1da91295-038f-4f40-9cf8-9a8c042e9e2d tempest-SnapshotsActionsTest-2012801752 None] Acquiring lock "cinder-1618c208-7185-4df6-b1b4-45258ee49cf5-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1da91295-038f-4f40-9cf8-9a8c042e9e2d tempest-SnapshotsActionsTest-2012801752 None] Lock "cinder-1618c208-7185-4df6-b1b4-45258ee49cf5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1da91295-038f-4f40-9cf8-9a8c042e9e2d tempest-SnapshotsActionsTest-2012801752 None] Acquiring lock "cinder-quobyte-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1da91295-038f-4f40-9cf8-9a8c042e9e2d tempest-SnapshotsActionsTest-2012801752 None] Lock "cinder-quobyte-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1da91295-038f-4f40-9cf8-9a8c042e9e2d tempest-SnapshotsActionsTest-2012801752 None] Acquiring lock "cinder-quobyte-1618c208-7185-4df6-b1b4-45258ee49cf5" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1da91295-038f-4f40-9cf8-9a8c042e9e2d tempest-SnapshotsActionsTest-2012801752 None] Lock "cinder-quobyte-1618c208-7185-4df6-b1b4-45258ee49cf5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-1da91295-038f-4f40-9cf8-9a8c042e9e2d tempest-SnapshotsActionsTest-2012801752 None] Deleting offline snapshot 1618c208-7185-4df6-b1b4-45258ee49cf5 of volume 678fcb9f-5ef4-4cb4-8549-c1294d6e87e5 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-1da91295-038f-4f40-9cf8-9a8c042e9e2d tempest-SnapshotsActionsTest-2012801752 None] snapshot_file for this snap is: volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[525a1f3e-a871-4049-894b-4956f229bb6a]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:36:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1da91295-038f-4f40-9cf8-9a8c042e9e2d tempest-SnapshotsActionsTest-2012801752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:55 devstack sudo[93776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 Jul 08 01:36:55 devstack sudo[93776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:55 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:36:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:36:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:36:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:55 devstack sudo[93778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:36:55 devstack sudo[93778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-27cdac54-5087-49c2-9d0c-2caf712c3ef4 tempest-VolumesSnapshotListTestJSON-74209177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:36:55 devstack sudo[93774]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc1c2bcb-2e8b-4f87-899d-e57a1077c2fc tempest-AttachVolumeTestJSON-1425049151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a32bbbc8-11f2-481a-861d-3e5a85149313 1073741824" returned: 0 in 1.328s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:56 devstack sudo[93776]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1da91295-038f-4f40-9cf8-9a8c042e9e2d tempest-SnapshotsActionsTest-2012801752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5" returned: 0 in 1.108s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:56 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-1da91295-038f-4f40-9cf8-9a8c042e9e2d tempest-SnapshotsActionsTest-2012801752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:36:56 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75b37a9-90dd-4067-921b-5ea6064d28c0]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:36:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1da91295-038f-4f40-9cf8-9a8c042e9e2d tempest-SnapshotsActionsTest-2012801752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc1c2bcb-2e8b-4f87-899d-e57a1077c2fc tempest-AttachVolumeTestJSON-1425049151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a32bbbc8-11f2-481a-861d-3e5a85149313 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:56 devstack sudo[93789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a32bbbc8-11f2-481a-861d-3e5a85149313 Jul 08 01:36:56 devstack sudo[93789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:56 devstack sudo[93778]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.952s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:56 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:36:56 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager._thread_info {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:36:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread count: 8 {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:36:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread info: [<_MainThread(MainThread, started 127058402500736)>, , , , , , , ] {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:36:56 devstack sudo[93788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5 Jul 08 01:36:56 devstack sudo[93788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:56 devstack sudo[93789]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc1c2bcb-2e8b-4f87-899d-e57a1077c2fc tempest-AttachVolumeTestJSON-1425049151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a32bbbc8-11f2-481a-861d-3e5a85149313" returned: 0 in 0.881s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:56 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-cc1c2bcb-2e8b-4f87-899d-e57a1077c2fc tempest-AttachVolumeTestJSON-1425049151 None] <== create_volume: return (2317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:36:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-cc1c2bcb-2e8b-4f87-899d-e57a1077c2fc tempest-AttachVolumeTestJSON-1425049151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.320s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:36:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-27cdac54-5087-49c2-9d0c-2caf712c3ef4 tempest-VolumesSnapshotListTestJSON-74209177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.073s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:36:57 devstack sudo[93788]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc1c2bcb-2e8b-4f87-899d-e57a1077c2fc tempest-AttachVolumeTestJSON-1425049151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec6df13-86bb-44ec-8fa5-ee4666e73285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a32bbbc8-11f2-481a-861d-3e5a85149313', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc1c2bcb-2e8b-4f87-899d-e57a1077c2fc tempest-AttachVolumeTestJSON-1425049151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a708b16-a01f-4ca6-bdda-cfba6ad7227e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:36:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-27cdac54-5087-49c2-9d0c-2caf712c3ef4 tempest-VolumesSnapshotListTestJSON-74209177 None] Creating offline snapshot 512d8be0-7ad7-4699-bdf1-193733ba751f of volume 59106196-2e47-45ef-b2b3-28af98f6e2ab {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:36:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1da91295-038f-4f40-9cf8-9a8c042e9e2d tempest-SnapshotsActionsTest-2012801752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5" returned: 0 in 0.963s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1da91295-038f-4f40-9cf8-9a8c042e9e2d tempest-SnapshotsActionsTest-2012801752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:57 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[286a46dc-00b4-478d-9c9b-9419cb89c3d1]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:36:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-27cdac54-5087-49c2-9d0c-2caf712c3ef4 tempest-VolumesSnapshotListTestJSON-74209177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:57 devstack sudo[93796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 Jul 08 01:36:57 devstack sudo[93796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:57 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-cc1c2bcb-2e8b-4f87-899d-e57a1077c2fc tempest-AttachVolumeTestJSON-1425049151 None] Volume volume-a32bbbc8-11f2-481a-861d-3e5a85149313 (a32bbbc8-11f2-481a-861d-3e5a85149313): created successfully Jul 08 01:36:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc1c2bcb-2e8b-4f87-899d-e57a1077c2fc tempest-AttachVolumeTestJSON-1425049151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a708b16-a01f-4ca6-bdda-cfba6ad7227e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:36:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc1c2bcb-2e8b-4f87-899d-e57a1077c2fc tempest-AttachVolumeTestJSON-1425049151 None] Flow 'volume_create_manager' (a5d37c1a-c610-4366-91f6-e7771b79f299) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:36:57 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-cc1c2bcb-2e8b-4f87-899d-e57a1077c2fc tempest-AttachVolumeTestJSON-1425049151 None] Created volume successfully. Jul 08 01:36:57 devstack sudo[93797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab Jul 08 01:36:57 devstack sudo[93797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:58 devstack sudo[93796]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:58 devstack sudo[93797]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1da91295-038f-4f40-9cf8-9a8c042e9e2d tempest-SnapshotsActionsTest-2012801752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5" returned: 0 in 1.061s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1da91295-038f-4f40-9cf8-9a8c042e9e2d tempest-SnapshotsActionsTest-2012801752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-27cdac54-5087-49c2-9d0c-2caf712c3ef4 tempest-VolumesSnapshotListTestJSON-74209177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab" returned: 0 in 1.048s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-27cdac54-5087-49c2-9d0c-2caf712c3ef4 tempest-VolumesSnapshotListTestJSON-74209177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.512d8be0-7ad7-4699-bdf1-193733ba751f 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:58 devstack sudo[93814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5 Jul 08 01:36:58 devstack sudo[93814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:58 devstack sudo[93815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.512d8be0-7ad7-4699-bdf1-193733ba751f 1G Jul 08 01:36:58 devstack sudo[93815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:58 devstack sudo[93814]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1da91295-038f-4f40-9cf8-9a8c042e9e2d tempest-SnapshotsActionsTest-2012801752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5.1618c208-7185-4df6-b1b4-45258ee49cf5" returned: 0 in 0.756s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:58 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1da91295-038f-4f40-9cf8-9a8c042e9e2d tempest-SnapshotsActionsTest-2012801752 None] Lock "cinder-quobyte-1618c208-7185-4df6-b1b4-45258ee49cf5" released by "_delete_snapshot" :: held 4.020s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:58 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1da91295-038f-4f40-9cf8-9a8c042e9e2d tempest-SnapshotsActionsTest-2012801752 None] Lock "cinder-quobyte-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5" released by "delete_snapshot" :: held 4.046s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:59 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-1da91295-038f-4f40-9cf8-9a8c042e9e2d tempest-SnapshotsActionsTest-2012801752 None] Created reservations ['e110ea09-14ec-4c12-a4d1-1229302817c2', '7f01ae49-34a6-4083-8950-4c3615d49022', 'ab90258a-401d-4b2e-91f7-6291ea402fbe', 'f936279e-ac95-4b19-a981-62a904f5e4a7'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:36:59 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-1da91295-038f-4f40-9cf8-9a8c042e9e2d tempest-SnapshotsActionsTest-2012801752 None] Delete snapshot completed successfully. Jul 08 01:36:59 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1da91295-038f-4f40-9cf8-9a8c042e9e2d tempest-SnapshotsActionsTest-2012801752 None] Lock "cinder-1618c208-7185-4df6-b1b4-45258ee49cf5-delete_snapshot" released by "delete_snapshot" :: held 4.263s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:36:59 devstack sudo[93815]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-27cdac54-5087-49c2-9d0c-2caf712c3ef4 tempest-VolumesSnapshotListTestJSON-74209177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.512d8be0-7ad7-4699-bdf1-193733ba751f 1G" returned: 0 in 1.064s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-27cdac54-5087-49c2-9d0c-2caf712c3ef4 tempest-VolumesSnapshotListTestJSON-74209177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59106196-2e47-45ef-b2b3-28af98f6e2ab -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.512d8be0-7ad7-4699-bdf1-193733ba751f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:59 devstack sudo[93823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59106196-2e47-45ef-b2b3-28af98f6e2ab -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.512d8be0-7ad7-4699-bdf1-193733ba751f Jul 08 01:36:59 devstack sudo[93823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:59 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5e5c4717-1c8e-4609-8ea4-88083c83dd94 tempest-SnapshotsActionsTest-2012801752 None] Acquiring lock "cinder-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:59 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5e5c4717-1c8e-4609-8ea4-88083c83dd94 tempest-SnapshotsActionsTest-2012801752 None] Lock "cinder-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:59 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5e5c4717-1c8e-4609-8ea4-88083c83dd94 tempest-SnapshotsActionsTest-2012801752 None] Acquiring lock "cinder-quobyte-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:36:59 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5e5c4717-1c8e-4609-8ea4-88083c83dd94 tempest-SnapshotsActionsTest-2012801752 None] Lock "cinder-quobyte-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5" acquired by "delete_volume" :: waited 0.035s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:36:59 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[033ce5fb-2a51-49e7-a7f4-f78707db03bb]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:36:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5e5c4717-1c8e-4609-8ea4-88083c83dd94 tempest-SnapshotsActionsTest-2012801752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:59 devstack sudo[93825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5 Jul 08 01:36:59 devstack sudo[93825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:00 devstack sudo[93823]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-27cdac54-5087-49c2-9d0c-2caf712c3ef4 tempest-VolumesSnapshotListTestJSON-74209177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59106196-2e47-45ef-b2b3-28af98f6e2ab -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.512d8be0-7ad7-4699-bdf1-193733ba751f" returned: 0 in 0.965s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:00 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-27cdac54-5087-49c2-9d0c-2caf712c3ef4 tempest-VolumesSnapshotListTestJSON-74209177 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.512d8be0-7ad7-4699-bdf1-193733ba751f is being set with open permissions: ugo+rw Jul 08 01:37:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-27cdac54-5087-49c2-9d0c-2caf712c3ef4 tempest-VolumesSnapshotListTestJSON-74209177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.512d8be0-7ad7-4699-bdf1-193733ba751f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:00 devstack sudo[93830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.512d8be0-7ad7-4699-bdf1-193733ba751f Jul 08 01:37:00 devstack sudo[93830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:00 devstack sudo[93825]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5e5c4717-1c8e-4609-8ea4-88083c83dd94 tempest-SnapshotsActionsTest-2012801752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5" returned: 0 in 1.073s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5e5c4717-1c8e-4609-8ea4-88083c83dd94 tempest-SnapshotsActionsTest-2012801752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:00 devstack sudo[93836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5 Jul 08 01:37:00 devstack sudo[93836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:00 devstack sudo[93830]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-27cdac54-5087-49c2-9d0c-2caf712c3ef4 tempest-VolumesSnapshotListTestJSON-74209177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.512d8be0-7ad7-4699-bdf1-193733ba751f" returned: 0 in 0.850s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-27cdac54-5087-49c2-9d0c-2caf712c3ef4 tempest-VolumesSnapshotListTestJSON-74209177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:01 devstack sudo[93846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.info Jul 08 01:37:01 devstack sudo[93846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-b5af329b-1431-45d9-9d1f-ca98c92cb7e6 req-771a3c9e-07b5-4a48-9ded-949e090faea8 tempest-AttachVolumeTestJSON-1425049151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:01 devstack sudo[93836]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5e5c4717-1c8e-4609-8ea4-88083c83dd94 tempest-SnapshotsActionsTest-2012801752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5" returned: 0 in 0.899s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:01 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5e5c4717-1c8e-4609-8ea4-88083c83dd94 tempest-SnapshotsActionsTest-2012801752 None] Lock "cinder-quobyte-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5" released by "delete_volume" :: held 2.078s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:01 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-5e5c4717-1c8e-4609-8ea4-88083c83dd94 tempest-SnapshotsActionsTest-2012801752 None] Created reservations ['2abf8c7a-8b59-4aa4-9637-acaac57acd5f', '30678223-5a96-4a59-bba3-2592aead0ce6', '943e841e-daea-4e14-8e19-59eda6ab603c', '46dad3c2-4436-40ed-bab7-038753835320'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:37:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5e5c4717-1c8e-4609-8ea4-88083c83dd94 tempest-SnapshotsActionsTest-2012801752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5e5c4717-1c8e-4609-8ea4-88083c83dd94 tempest-SnapshotsActionsTest-2012801752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:01 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5e5c4717-1c8e-4609-8ea4-88083c83dd94 tempest-SnapshotsActionsTest-2012801752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:37:01 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5e5c4717-1c8e-4609-8ea4-88083c83dd94 tempest-SnapshotsActionsTest-2012801752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:37:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5e5c4717-1c8e-4609-8ea4-88083c83dd94 tempest-SnapshotsActionsTest-2012801752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5e5c4717-1c8e-4609-8ea4-88083c83dd94 tempest-SnapshotsActionsTest-2012801752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:01 devstack sudo[93851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:37:01 devstack sudo[93851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:01 devstack sudo[93846]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-27cdac54-5087-49c2-9d0c-2caf712c3ef4 tempest-VolumesSnapshotListTestJSON-74209177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.info" returned: 0 in 0.797s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:01 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-27cdac54-5087-49c2-9d0c-2caf712c3ef4 tempest-VolumesSnapshotListTestJSON-74209177 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.info is being set with open permissions: ugo+rw Jul 08 01:37:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-27cdac54-5087-49c2-9d0c-2caf712c3ef4 tempest-VolumesSnapshotListTestJSON-74209177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:01 devstack sudo[93854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.info Jul 08 01:37:01 devstack sudo[93854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:02 devstack sudo[93851]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5e5c4717-1c8e-4609-8ea4-88083c83dd94 tempest-SnapshotsActionsTest-2012801752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.978s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:02 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-5e5c4717-1c8e-4609-8ea4-88083c83dd94 tempest-SnapshotsActionsTest-2012801752 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:37:02 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-5e5c4717-1c8e-4609-8ea4-88083c83dd94 tempest-SnapshotsActionsTest-2012801752 None] Deleted volume successfully. Jul 08 01:37:02 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5e5c4717-1c8e-4609-8ea4-88083c83dd94 tempest-SnapshotsActionsTest-2012801752 None] Lock "cinder-678fcb9f-5ef4-4cb4-8549-c1294d6e87e5-delete_volume" released by "delete_volume" :: held 3.413s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:02 devstack sudo[93854]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-27cdac54-5087-49c2-9d0c-2caf712c3ef4 tempest-VolumesSnapshotListTestJSON-74209177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.info" returned: 0 in 1.011s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-27cdac54-5087-49c2-9d0c-2caf712c3ef4 tempest-VolumesSnapshotListTestJSON-74209177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.923s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-b5af329b-1431-45d9-9d1f-ca98c92cb7e6 req-771a3c9e-07b5-4a48-9ded-949e090faea8 tempest-AttachVolumeTestJSON-1425049151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.634s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:02 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a496a3-c580-45ef-9b50-6fe437405621]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:37:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-b5af329b-1431-45d9-9d1f-ca98c92cb7e6 req-771a3c9e-07b5-4a48-9ded-949e090faea8 tempest-AttachVolumeTestJSON-1425049151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a32bbbc8-11f2-481a-861d-3e5a85149313 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:02 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-27cdac54-5087-49c2-9d0c-2caf712c3ef4 tempest-VolumesSnapshotListTestJSON-74209177 None] Create snapshot completed successfully Jul 08 01:37:03 devstack sudo[93858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a32bbbc8-11f2-481a-861d-3e5a85149313 Jul 08 01:37:03 devstack sudo[93858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8f642726-8e33-4f12-93ac-019974553e1f tempest-VolumesSnapshotListTestJSON-74209177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:04 devstack sudo[93858]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-b5af329b-1431-45d9-9d1f-ca98c92cb7e6 req-771a3c9e-07b5-4a48-9ded-949e090faea8 tempest-AttachVolumeTestJSON-1425049151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a32bbbc8-11f2-481a-861d-3e5a85149313" returned: 0 in 1.269s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-b5af329b-1431-45d9-9d1f-ca98c92cb7e6 req-771a3c9e-07b5-4a48-9ded-949e090faea8 tempest-AttachVolumeTestJSON-1425049151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.305s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8f642726-8e33-4f12-93ac-019974553e1f tempest-VolumesSnapshotListTestJSON-74209177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.617s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:04 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-8f642726-8e33-4f12-93ac-019974553e1f tempest-VolumesSnapshotListTestJSON-74209177 None] Creating offline snapshot 45925706-3946-4fbf-8ed5-b34ebdedd0e9 of volume 59106196-2e47-45ef-b2b3-28af98f6e2ab {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:37:04 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3d652e-beec-4fa2-971d-1a03f9b8d226]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:37:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8f642726-8e33-4f12-93ac-019974553e1f tempest-VolumesSnapshotListTestJSON-74209177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.512d8be0-7ad7-4699-bdf1-193733ba751f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:04 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-b5af329b-1431-45d9-9d1f-ca98c92cb7e6 req-771a3c9e-07b5-4a48-9ded-949e090faea8 tempest-AttachVolumeTestJSON-1425049151 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96', 'name': 'volume-a32bbbc8-11f2-481a-861d-3e5a85149313', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0161257c-755c-44b0-a348-68931f82e25b', 'enforce_multipath': True} {{(pid=87284) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:37:04 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-b5af329b-1431-45d9-9d1f-ca98c92cb7e6 req-771a3c9e-07b5-4a48-9ded-949e090faea8 tempest-AttachVolumeTestJSON-1425049151 None] attachment_update completed successfully. Jul 08 01:37:04 devstack sudo[93863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.512d8be0-7ad7-4699-bdf1-193733ba751f Jul 08 01:37:04 devstack sudo[93863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:05 devstack sudo[93863]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8f642726-8e33-4f12-93ac-019974553e1f tempest-VolumesSnapshotListTestJSON-74209177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.512d8be0-7ad7-4699-bdf1-193733ba751f" returned: 0 in 1.069s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:05 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-8f642726-8e33-4f12-93ac-019974553e1f tempest-VolumesSnapshotListTestJSON-74209177 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59106196-2e47-45ef-b2b3-28af98f6e2ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:37:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8f642726-8e33-4f12-93ac-019974553e1f tempest-VolumesSnapshotListTestJSON-74209177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.512d8be0-7ad7-4699-bdf1-193733ba751f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.45925706-3946-4fbf-8ed5-b34ebdedd0e9 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:05 devstack sudo[93870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.512d8be0-7ad7-4699-bdf1-193733ba751f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.45925706-3946-4fbf-8ed5-b34ebdedd0e9 1G Jul 08 01:37:05 devstack sudo[93870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:06 devstack sudo[93870]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8f642726-8e33-4f12-93ac-019974553e1f tempest-VolumesSnapshotListTestJSON-74209177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.512d8be0-7ad7-4699-bdf1-193733ba751f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.45925706-3946-4fbf-8ed5-b34ebdedd0e9 1G" returned: 0 in 1.371s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8f642726-8e33-4f12-93ac-019974553e1f tempest-VolumesSnapshotListTestJSON-74209177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.512d8be0-7ad7-4699-bdf1-193733ba751f -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.45925706-3946-4fbf-8ed5-b34ebdedd0e9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:06 devstack sudo[93877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.512d8be0-7ad7-4699-bdf1-193733ba751f -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.45925706-3946-4fbf-8ed5-b34ebdedd0e9 Jul 08 01:37:06 devstack sudo[93877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:07 devstack sudo[93877]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8f642726-8e33-4f12-93ac-019974553e1f tempest-VolumesSnapshotListTestJSON-74209177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.512d8be0-7ad7-4699-bdf1-193733ba751f -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.45925706-3946-4fbf-8ed5-b34ebdedd0e9" returned: 0 in 0.899s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:07 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-8f642726-8e33-4f12-93ac-019974553e1f tempest-VolumesSnapshotListTestJSON-74209177 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.45925706-3946-4fbf-8ed5-b34ebdedd0e9 is being set with open permissions: ugo+rw Jul 08 01:37:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8f642726-8e33-4f12-93ac-019974553e1f tempest-VolumesSnapshotListTestJSON-74209177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.45925706-3946-4fbf-8ed5-b34ebdedd0e9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:07 devstack sudo[93883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.45925706-3946-4fbf-8ed5-b34ebdedd0e9 Jul 08 01:37:07 devstack sudo[93883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:08 devstack sudo[93883]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8f642726-8e33-4f12-93ac-019974553e1f tempest-VolumesSnapshotListTestJSON-74209177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.45925706-3946-4fbf-8ed5-b34ebdedd0e9" returned: 0 in 0.800s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8f642726-8e33-4f12-93ac-019974553e1f tempest-VolumesSnapshotListTestJSON-74209177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.307s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:08 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-8f642726-8e33-4f12-93ac-019974553e1f tempest-VolumesSnapshotListTestJSON-74209177 None] Create snapshot completed successfully Jul 08 01:37:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-18957471-ee77-48b5-a99b-a3bf5a011c52 tempest-VolumesSnapshotListTestJSON-74209177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-18957471-ee77-48b5-a99b-a3bf5a011c52 tempest-VolumesSnapshotListTestJSON-74209177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:09 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-18957471-ee77-48b5-a99b-a3bf5a011c52 tempest-VolumesSnapshotListTestJSON-74209177 None] Creating offline snapshot 288a7947-75b8-4c76-ba21-ec27efa3f9e6 of volume 59106196-2e47-45ef-b2b3-28af98f6e2ab {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:37:09 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa48378-720c-4da3-a72a-487530bcc77c]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:37:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-18957471-ee77-48b5-a99b-a3bf5a011c52 tempest-VolumesSnapshotListTestJSON-74209177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.45925706-3946-4fbf-8ed5-b34ebdedd0e9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:09 devstack sudo[93913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.45925706-3946-4fbf-8ed5-b34ebdedd0e9 Jul 08 01:37:09 devstack sudo[93913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:10 devstack sudo[93913]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-18957471-ee77-48b5-a99b-a3bf5a011c52 tempest-VolumesSnapshotListTestJSON-74209177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.45925706-3946-4fbf-8ed5-b34ebdedd0e9" returned: 0 in 0.945s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:10 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-18957471-ee77-48b5-a99b-a3bf5a011c52 tempest-VolumesSnapshotListTestJSON-74209177 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59106196-2e47-45ef-b2b3-28af98f6e2ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:37:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-18957471-ee77-48b5-a99b-a3bf5a011c52 tempest-VolumesSnapshotListTestJSON-74209177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.45925706-3946-4fbf-8ed5-b34ebdedd0e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.288a7947-75b8-4c76-ba21-ec27efa3f9e6 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:10 devstack sudo[93918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.45925706-3946-4fbf-8ed5-b34ebdedd0e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.288a7947-75b8-4c76-ba21-ec27efa3f9e6 1G Jul 08 01:37:10 devstack sudo[93918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:10 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-3bc3cf8f-b8f3-48c0-873a-97f4095eda98 req-d6c8121b-e637-451d-b91e-d23db71b7345 tempest-AttachVolumeTestJSON-1425049151 None] Terminate volume connection completed successfully. Jul 08 01:37:10 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-3bc3cf8f-b8f3-48c0-873a-97f4095eda98 req-d6c8121b-e637-451d-b91e-d23db71b7345 tempest-AttachVolumeTestJSON-1425049151 None] Deleting attachment 7cc8cd1b-361e-43dc-8814-2d30903b676b. {{(pid=87284) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:37:11 devstack sudo[93918]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-18957471-ee77-48b5-a99b-a3bf5a011c52 tempest-VolumesSnapshotListTestJSON-74209177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.45925706-3946-4fbf-8ed5-b34ebdedd0e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.288a7947-75b8-4c76-ba21-ec27efa3f9e6 1G" returned: 0 in 1.292s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-18957471-ee77-48b5-a99b-a3bf5a011c52 tempest-VolumesSnapshotListTestJSON-74209177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.45925706-3946-4fbf-8ed5-b34ebdedd0e9 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.288a7947-75b8-4c76-ba21-ec27efa3f9e6 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:11 devstack sudo[93928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.45925706-3946-4fbf-8ed5-b34ebdedd0e9 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.288a7947-75b8-4c76-ba21-ec27efa3f9e6 Jul 08 01:37:11 devstack sudo[93928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:12 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-5737e0d0-7404-4417-92bb-7f1797c9ab0d tempest-VolumesTransfersTest-1940436371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:37:12 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5737e0d0-7404-4417-92bb-7f1797c9ab0d tempest-VolumesTransfersTest-1940436371 None] Flow 'volume_create_manager' (b232591d-6e06-4a46-b173-6e47dad09285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:37:12 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5737e0d0-7404-4417-92bb-7f1797c9ab0d tempest-VolumesTransfersTest-1940436371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (547feb8d-bd1a-4087-99c9-57493d0e20cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:12 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5737e0d0-7404-4417-92bb-7f1797c9ab0d tempest-VolumesTransfersTest-1940436371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (547feb8d-bd1a-4087-99c9-57493d0e20cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1814606937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd185d3a-f472-48fd-a933-d1ea03a1a652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c520b07ea6f4e5ba06ebdbffb0fa5be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:37:12Z,use_quota=True,user_id='ea8cc4de27f04efd8bbf0f941876dc55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:12 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5737e0d0-7404-4417-92bb-7f1797c9ab0d tempest-VolumesTransfersTest-1940436371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4725aad8-efdb-41b9-9ac5-694b4bc2c5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:12 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5737e0d0-7404-4417-92bb-7f1797c9ab0d tempest-VolumesTransfersTest-1940436371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4725aad8-efdb-41b9-9ac5-694b4bc2c5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:12 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5737e0d0-7404-4417-92bb-7f1797c9ab0d tempest-VolumesTransfersTest-1940436371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce39a01a-38c8-44b9-87c3-4ab40055e463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:12 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5737e0d0-7404-4417-92bb-7f1797c9ab0d tempest-VolumesTransfersTest-1940436371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce39a01a-38c8-44b9-87c3-4ab40055e463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd185d3a-f472-48fd-a933-d1ea03a1a652', 'volume_name': 'volume-dd185d3a-f472-48fd-a933-d1ea03a1a652', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:12 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5737e0d0-7404-4417-92bb-7f1797c9ab0d tempest-VolumesTransfersTest-1940436371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaceda17-6a1e-4528-be03-740bf1c82b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:12 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5737e0d0-7404-4417-92bb-7f1797c9ab0d tempest-VolumesTransfersTest-1940436371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaceda17-6a1e-4528-be03-740bf1c82b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:12 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5737e0d0-7404-4417-92bb-7f1797c9ab0d tempest-VolumesTransfersTest-1940436371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0fea1d0-f649-4253-b6d6-8f58e2797b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:12 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-5737e0d0-7404-4417-92bb-7f1797c9ab0d tempest-VolumesTransfersTest-1940436371 None] Volume dd185d3a-f472-48fd-a933-d1ea03a1a652: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd185d3a-f472-48fd-a933-d1ea03a1a652', 'volume_size': 1} Jul 08 01:37:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5737e0d0-7404-4417-92bb-7f1797c9ab0d tempest-VolumesTransfersTest-1940436371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:12 devstack sudo[93928]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-18957471-ee77-48b5-a99b-a3bf5a011c52 tempest-VolumesSnapshotListTestJSON-74209177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.45925706-3946-4fbf-8ed5-b34ebdedd0e9 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.288a7947-75b8-4c76-ba21-ec27efa3f9e6" returned: 0 in 1.174s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:12 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-18957471-ee77-48b5-a99b-a3bf5a011c52 tempest-VolumesSnapshotListTestJSON-74209177 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.288a7947-75b8-4c76-ba21-ec27efa3f9e6 is being set with open permissions: ugo+rw Jul 08 01:37:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-18957471-ee77-48b5-a99b-a3bf5a011c52 tempest-VolumesSnapshotListTestJSON-74209177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.288a7947-75b8-4c76-ba21-ec27efa3f9e6 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:12 devstack sudo[93935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.288a7947-75b8-4c76-ba21-ec27efa3f9e6 Jul 08 01:37:12 devstack sudo[93935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:13 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-c05a5f0c-40bd-4354-a13a-5ced2738b80d req-ed745021-331f-4ac1-a1ba-9275fe5a79f5 tempest-AttachVolumeTestJSON-1425049151 None] Terminate volume connection completed successfully. Jul 08 01:37:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-c05a5f0c-40bd-4354-a13a-5ced2738b80d req-ed745021-331f-4ac1-a1ba-9275fe5a79f5 tempest-AttachVolumeTestJSON-1425049151 None] Deleting attachment 0161257c-755c-44b0-a348-68931f82e25b. {{(pid=87284) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:37:13 devstack sudo[93935]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-18957471-ee77-48b5-a99b-a3bf5a011c52 tempest-VolumesSnapshotListTestJSON-74209177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.288a7947-75b8-4c76-ba21-ec27efa3f9e6" returned: 0 in 0.863s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-18957471-ee77-48b5-a99b-a3bf5a011c52 tempest-VolumesSnapshotListTestJSON-74209177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.436s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5737e0d0-7404-4417-92bb-7f1797c9ab0d tempest-VolumesTransfersTest-1940436371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.187s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:13 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5737e0d0-7404-4417-92bb-7f1797c9ab0d tempest-VolumesTransfersTest-1940436371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1814606937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd185d3a-f472-48fd-a933-d1ea03a1a652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c520b07ea6f4e5ba06ebdbffb0fa5be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:37:12Z,use_quota=True,user_id='ea8cc4de27f04efd8bbf0f941876dc55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:37:13 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-5737e0d0-7404-4417-92bb-7f1797c9ab0d tempest-VolumesTransfersTest-1940436371 None] Creating volume dd185d3a-f472-48fd-a933-d1ea03a1a652 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:37:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5737e0d0-7404-4417-92bb-7f1797c9ab0d tempest-VolumesTransfersTest-1940436371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5737e0d0-7404-4417-92bb-7f1797c9ab0d tempest-VolumesTransfersTest-1940436371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:13 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5737e0d0-7404-4417-92bb-7f1797c9ab0d tempest-VolumesTransfersTest-1940436371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:37:13 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5737e0d0-7404-4417-92bb-7f1797c9ab0d tempest-VolumesTransfersTest-1940436371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:37:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5737e0d0-7404-4417-92bb-7f1797c9ab0d tempest-VolumesTransfersTest-1940436371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:13 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5737e0d0-7404-4417-92bb-7f1797c9ab0d tempest-VolumesTransfersTest-1940436371 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:37:13 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-5737e0d0-7404-4417-92bb-7f1797c9ab0d tempest-VolumesTransfersTest-1940436371 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:37:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5737e0d0-7404-4417-92bb-7f1797c9ab0d tempest-VolumesTransfersTest-1940436371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dd185d3a-f472-48fd-a933-d1ea03a1a652 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:13 devstack sudo[93941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dd185d3a-f472-48fd-a933-d1ea03a1a652 1073741824 Jul 08 01:37:13 devstack sudo[93941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:13 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-18957471-ee77-48b5-a99b-a3bf5a011c52 tempest-VolumesSnapshotListTestJSON-74209177 None] Create snapshot completed successfully Jul 08 01:37:14 devstack sudo[93941]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5737e0d0-7404-4417-92bb-7f1797c9ab0d tempest-VolumesTransfersTest-1940436371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dd185d3a-f472-48fd-a933-d1ea03a1a652 1073741824" returned: 0 in 1.047s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5737e0d0-7404-4417-92bb-7f1797c9ab0d tempest-VolumesTransfersTest-1940436371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dd185d3a-f472-48fd-a933-d1ea03a1a652 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:14 devstack sudo[93947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dd185d3a-f472-48fd-a933-d1ea03a1a652 Jul 08 01:37:14 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:15 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5737e0d0-7404-4417-92bb-7f1797c9ab0d tempest-VolumesTransfersTest-1940436371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dd185d3a-f472-48fd-a933-d1ea03a1a652" returned: 0 in 0.844s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:15 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5737e0d0-7404-4417-92bb-7f1797c9ab0d tempest-VolumesTransfersTest-1940436371 None] <== create_volume: return (1952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:37:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5737e0d0-7404-4417-92bb-7f1797c9ab0d tempest-VolumesTransfersTest-1940436371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.955s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5737e0d0-7404-4417-92bb-7f1797c9ab0d tempest-VolumesTransfersTest-1940436371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0fea1d0-f649-4253-b6d6-8f58e2797b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd185d3a-f472-48fd-a933-d1ea03a1a652', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5737e0d0-7404-4417-92bb-7f1797c9ab0d tempest-VolumesTransfersTest-1940436371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc60c315-c1b0-4929-96d4-80662d4046a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:15 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-5737e0d0-7404-4417-92bb-7f1797c9ab0d tempest-VolumesTransfersTest-1940436371 None] Volume volume-dd185d3a-f472-48fd-a933-d1ea03a1a652 (dd185d3a-f472-48fd-a933-d1ea03a1a652): created successfully Jul 08 01:37:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5737e0d0-7404-4417-92bb-7f1797c9ab0d tempest-VolumesTransfersTest-1940436371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc60c315-c1b0-4929-96d4-80662d4046a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5737e0d0-7404-4417-92bb-7f1797c9ab0d tempest-VolumesTransfersTest-1940436371 None] Flow 'volume_create_manager' (b232591d-6e06-4a46-b173-6e47dad09285) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:37:15 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-5737e0d0-7404-4417-92bb-7f1797c9ab0d tempest-VolumesTransfersTest-1940436371 None] Created volume successfully. Jul 08 01:37:15 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-720e6dfb-322f-4c60-bccf-47aef70945f1 tempest-VolumesSnapshotListTestJSON-74209177 None] Acquiring lock "cinder-288a7947-75b8-4c76-ba21-ec27efa3f9e6-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:15 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-720e6dfb-322f-4c60-bccf-47aef70945f1 tempest-VolumesSnapshotListTestJSON-74209177 None] Lock "cinder-288a7947-75b8-4c76-ba21-ec27efa3f9e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:15 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-720e6dfb-322f-4c60-bccf-47aef70945f1 tempest-VolumesSnapshotListTestJSON-74209177 None] Acquiring lock "cinder-quobyte-59106196-2e47-45ef-b2b3-28af98f6e2ab" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:15 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-720e6dfb-322f-4c60-bccf-47aef70945f1 tempest-VolumesSnapshotListTestJSON-74209177 None] Lock "cinder-quobyte-59106196-2e47-45ef-b2b3-28af98f6e2ab" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:15 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-720e6dfb-322f-4c60-bccf-47aef70945f1 tempest-VolumesSnapshotListTestJSON-74209177 None] Acquiring lock "cinder-quobyte-288a7947-75b8-4c76-ba21-ec27efa3f9e6" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:16 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-720e6dfb-322f-4c60-bccf-47aef70945f1 tempest-VolumesSnapshotListTestJSON-74209177 None] Lock "cinder-quobyte-288a7947-75b8-4c76-ba21-ec27efa3f9e6" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:16 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-720e6dfb-322f-4c60-bccf-47aef70945f1 tempest-VolumesSnapshotListTestJSON-74209177 None] Deleting offline snapshot 288a7947-75b8-4c76-ba21-ec27efa3f9e6 of volume 59106196-2e47-45ef-b2b3-28af98f6e2ab {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:37:16 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-720e6dfb-322f-4c60-bccf-47aef70945f1 tempest-VolumesSnapshotListTestJSON-74209177 None] snapshot_file for this snap is: volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.288a7947-75b8-4c76-ba21-ec27efa3f9e6 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:37:16 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed1e8d6-92ea-40e0-b75f-15ced96e47b0]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:37:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-720e6dfb-322f-4c60-bccf-47aef70945f1 tempest-VolumesSnapshotListTestJSON-74209177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.288a7947-75b8-4c76-ba21-ec27efa3f9e6 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:16 devstack sudo[93950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.288a7947-75b8-4c76-ba21-ec27efa3f9e6 Jul 08 01:37:16 devstack sudo[93950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:17 devstack sudo[93950]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-720e6dfb-322f-4c60-bccf-47aef70945f1 tempest-VolumesSnapshotListTestJSON-74209177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.288a7947-75b8-4c76-ba21-ec27efa3f9e6" returned: 0 in 1.080s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:17 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-720e6dfb-322f-4c60-bccf-47aef70945f1 tempest-VolumesSnapshotListTestJSON-74209177 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59106196-2e47-45ef-b2b3-28af98f6e2ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:37:17 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1643ea-95fb-4260-b3e8-b96a1b2c4796]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:37:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-720e6dfb-322f-4c60-bccf-47aef70945f1 tempest-VolumesSnapshotListTestJSON-74209177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.45925706-3946-4fbf-8ed5-b34ebdedd0e9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:17 devstack sudo[93956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.45925706-3946-4fbf-8ed5-b34ebdedd0e9 Jul 08 01:37:17 devstack sudo[93956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:17 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-815c1aa1-0284-4ec5-9207-b30edf9970e3 tempest-VolumesTransfersTest-646757810 None] Transfer volume completed successfully. Jul 08 01:37:18 devstack sudo[93956]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-720e6dfb-322f-4c60-bccf-47aef70945f1 tempest-VolumesSnapshotListTestJSON-74209177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.45925706-3946-4fbf-8ed5-b34ebdedd0e9" returned: 0 in 1.254s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:18 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-720e6dfb-322f-4c60-bccf-47aef70945f1 tempest-VolumesSnapshotListTestJSON-74209177 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59106196-2e47-45ef-b2b3-28af98f6e2ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:37:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-720e6dfb-322f-4c60-bccf-47aef70945f1 tempest-VolumesSnapshotListTestJSON-74209177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.288a7947-75b8-4c76-ba21-ec27efa3f9e6 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:18 devstack sudo[93980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.288a7947-75b8-4c76-ba21-ec27efa3f9e6 Jul 08 01:37:18 devstack sudo[93980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:19 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-529de60c-3aa1-45b9-80d2-aae6e712cace tempest-VolumesTransfersTest-266863303 None] Acquiring lock "cinder-dd185d3a-f472-48fd-a933-d1ea03a1a652-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:19 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-529de60c-3aa1-45b9-80d2-aae6e712cace tempest-VolumesTransfersTest-266863303 None] Lock "cinder-dd185d3a-f472-48fd-a933-d1ea03a1a652-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:19 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-529de60c-3aa1-45b9-80d2-aae6e712cace tempest-VolumesTransfersTest-266863303 None] Acquiring lock "cinder-quobyte-dd185d3a-f472-48fd-a933-d1ea03a1a652" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:19 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-529de60c-3aa1-45b9-80d2-aae6e712cace tempest-VolumesTransfersTest-266863303 None] Lock "cinder-quobyte-dd185d3a-f472-48fd-a933-d1ea03a1a652" acquired by "delete_volume" :: waited 0.022s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:19 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d65eebd-08ed-4d77-a149-0298060d1a70]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:37:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-529de60c-3aa1-45b9-80d2-aae6e712cace tempest-VolumesTransfersTest-266863303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dd185d3a-f472-48fd-a933-d1ea03a1a652 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:19 devstack sudo[93988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dd185d3a-f472-48fd-a933-d1ea03a1a652 Jul 08 01:37:19 devstack sudo[93988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:19 devstack sudo[93980]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-720e6dfb-322f-4c60-bccf-47aef70945f1 tempest-VolumesSnapshotListTestJSON-74209177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.288a7947-75b8-4c76-ba21-ec27efa3f9e6" returned: 0 in 1.320s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-720e6dfb-322f-4c60-bccf-47aef70945f1 tempest-VolumesSnapshotListTestJSON-74209177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.288a7947-75b8-4c76-ba21-ec27efa3f9e6 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:19 devstack sudo[93991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.288a7947-75b8-4c76-ba21-ec27efa3f9e6 Jul 08 01:37:19 devstack sudo[93991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:20 devstack sudo[93991]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-720e6dfb-322f-4c60-bccf-47aef70945f1 tempest-VolumesSnapshotListTestJSON-74209177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.288a7947-75b8-4c76-ba21-ec27efa3f9e6" returned: 0 in 1.050s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:20 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-720e6dfb-322f-4c60-bccf-47aef70945f1 tempest-VolumesSnapshotListTestJSON-74209177 None] Lock "cinder-quobyte-288a7947-75b8-4c76-ba21-ec27efa3f9e6" released by "_delete_snapshot" :: held 4.851s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:20 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-720e6dfb-322f-4c60-bccf-47aef70945f1 tempest-VolumesSnapshotListTestJSON-74209177 None] Lock "cinder-quobyte-59106196-2e47-45ef-b2b3-28af98f6e2ab" released by "delete_snapshot" :: held 4.886s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:20 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=99,cinder:UPDATE=94,cinder:INSERT=24,cinder:DELETE=8 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:37:20 devstack sudo[93988]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-529de60c-3aa1-45b9-80d2-aae6e712cace tempest-VolumesTransfersTest-266863303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dd185d3a-f472-48fd-a933-d1ea03a1a652" returned: 0 in 1.334s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-529de60c-3aa1-45b9-80d2-aae6e712cace tempest-VolumesTransfersTest-266863303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dd185d3a-f472-48fd-a933-d1ea03a1a652 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:20 devstack sudo[93999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dd185d3a-f472-48fd-a933-d1ea03a1a652 Jul 08 01:37:20 devstack sudo[93999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:20 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-720e6dfb-322f-4c60-bccf-47aef70945f1 tempest-VolumesSnapshotListTestJSON-74209177 None] Created reservations ['3175e831-d245-4ad1-bee7-077de6c0ed4a', '9253dfb7-920f-4dc0-b15a-7d87bb85b7b4', 'b941ede6-1589-4ac0-b44b-a2e0a52d6872', 'efb4aed7-1beb-4c9b-a6d9-9ac1be516513'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:37:21 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-720e6dfb-322f-4c60-bccf-47aef70945f1 tempest-VolumesSnapshotListTestJSON-74209177 None] Delete snapshot completed successfully. Jul 08 01:37:21 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-720e6dfb-322f-4c60-bccf-47aef70945f1 tempest-VolumesSnapshotListTestJSON-74209177 None] Lock "cinder-288a7947-75b8-4c76-ba21-ec27efa3f9e6-delete_snapshot" released by "delete_snapshot" :: held 5.126s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:21 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5d100383-6bac-437f-8431-b0fe6941d9ab tempest-VolumesSnapshotListTestJSON-74209177 None] Acquiring lock "cinder-45925706-3946-4fbf-8ed5-b34ebdedd0e9-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:21 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5d100383-6bac-437f-8431-b0fe6941d9ab tempest-VolumesSnapshotListTestJSON-74209177 None] Lock "cinder-45925706-3946-4fbf-8ed5-b34ebdedd0e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:21 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5d100383-6bac-437f-8431-b0fe6941d9ab tempest-VolumesSnapshotListTestJSON-74209177 None] Acquiring lock "cinder-quobyte-59106196-2e47-45ef-b2b3-28af98f6e2ab" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:21 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5d100383-6bac-437f-8431-b0fe6941d9ab tempest-VolumesSnapshotListTestJSON-74209177 None] Lock "cinder-quobyte-59106196-2e47-45ef-b2b3-28af98f6e2ab" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:21 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5d100383-6bac-437f-8431-b0fe6941d9ab tempest-VolumesSnapshotListTestJSON-74209177 None] Acquiring lock "cinder-quobyte-45925706-3946-4fbf-8ed5-b34ebdedd0e9" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:21 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5d100383-6bac-437f-8431-b0fe6941d9ab tempest-VolumesSnapshotListTestJSON-74209177 None] Lock "cinder-quobyte-45925706-3946-4fbf-8ed5-b34ebdedd0e9" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:21 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-5d100383-6bac-437f-8431-b0fe6941d9ab tempest-VolumesSnapshotListTestJSON-74209177 None] Deleting offline snapshot 45925706-3946-4fbf-8ed5-b34ebdedd0e9 of volume 59106196-2e47-45ef-b2b3-28af98f6e2ab {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:37:21 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-5d100383-6bac-437f-8431-b0fe6941d9ab tempest-VolumesSnapshotListTestJSON-74209177 None] snapshot_file for this snap is: volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.45925706-3946-4fbf-8ed5-b34ebdedd0e9 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:37:21 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e717188-02a2-4fa1-aefb-603d8949710b]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:37:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5d100383-6bac-437f-8431-b0fe6941d9ab tempest-VolumesSnapshotListTestJSON-74209177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.45925706-3946-4fbf-8ed5-b34ebdedd0e9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:21 devstack sudo[94001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.45925706-3946-4fbf-8ed5-b34ebdedd0e9 Jul 08 01:37:21 devstack sudo[94001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:21 devstack sudo[93999]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-529de60c-3aa1-45b9-80d2-aae6e712cace tempest-VolumesTransfersTest-266863303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-dd185d3a-f472-48fd-a933-d1ea03a1a652" returned: 0 in 0.872s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:21 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-529de60c-3aa1-45b9-80d2-aae6e712cace tempest-VolumesTransfersTest-266863303 None] Lock "cinder-quobyte-dd185d3a-f472-48fd-a933-d1ea03a1a652" released by "delete_volume" :: held 2.262s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:21 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-529de60c-3aa1-45b9-80d2-aae6e712cace tempest-VolumesTransfersTest-266863303 None] Created reservations ['37db51ff-be87-47ae-be1d-49ff3a5b049d', 'e6016667-7a68-4d4f-a4d8-5f4b44edc182', '3614e6d7-3791-45b7-b086-03d54d871ebd', '0be19457-3324-4961-8597-c43d1ea0f1ff'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:37:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-529de60c-3aa1-45b9-80d2-aae6e712cace tempest-VolumesTransfersTest-266863303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-529de60c-3aa1-45b9-80d2-aae6e712cace tempest-VolumesTransfersTest-266863303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:21 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-529de60c-3aa1-45b9-80d2-aae6e712cace tempest-VolumesTransfersTest-266863303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:37:21 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-529de60c-3aa1-45b9-80d2-aae6e712cace tempest-VolumesTransfersTest-266863303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:37:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-529de60c-3aa1-45b9-80d2-aae6e712cace tempest-VolumesTransfersTest-266863303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-529de60c-3aa1-45b9-80d2-aae6e712cace tempest-VolumesTransfersTest-266863303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:21 devstack sudo[94004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:37:21 devstack sudo[94004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:22 devstack sudo[94001]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5d100383-6bac-437f-8431-b0fe6941d9ab tempest-VolumesSnapshotListTestJSON-74209177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.45925706-3946-4fbf-8ed5-b34ebdedd0e9" returned: 0 in 0.935s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:22 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-5d100383-6bac-437f-8431-b0fe6941d9ab tempest-VolumesSnapshotListTestJSON-74209177 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59106196-2e47-45ef-b2b3-28af98f6e2ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:37:22 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab792f7-8e9c-400e-ba3f-effa67b938b2]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:37:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5d100383-6bac-437f-8431-b0fe6941d9ab tempest-VolumesSnapshotListTestJSON-74209177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.512d8be0-7ad7-4699-bdf1-193733ba751f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:22 devstack sudo[94009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.512d8be0-7ad7-4699-bdf1-193733ba751f Jul 08 01:37:22 devstack sudo[94009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:22 devstack sudo[94004]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-529de60c-3aa1-45b9-80d2-aae6e712cace tempest-VolumesTransfersTest-266863303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.813s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:22 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-529de60c-3aa1-45b9-80d2-aae6e712cace tempest-VolumesTransfersTest-266863303 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:37:22 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-529de60c-3aa1-45b9-80d2-aae6e712cace tempest-VolumesTransfersTest-266863303 None] Deleted volume successfully. Jul 08 01:37:22 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-529de60c-3aa1-45b9-80d2-aae6e712cace tempest-VolumesTransfersTest-266863303 None] Lock "cinder-dd185d3a-f472-48fd-a933-d1ea03a1a652-delete_volume" released by "delete_volume" :: held 3.376s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:23 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-4315b31d-dcbc-4380-b32e-05db94780591 tempest-VolumesTransfersTest-1940436371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:37:23 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4315b31d-dcbc-4380-b32e-05db94780591 tempest-VolumesTransfersTest-1940436371 None] Flow 'volume_create_manager' (384ef45c-3271-4ddc-b926-47659a81b413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:37:23 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4315b31d-dcbc-4380-b32e-05db94780591 tempest-VolumesTransfersTest-1940436371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (346e7aeb-2e2b-4cf8-b788-7446b50b142a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:23 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4315b31d-dcbc-4380-b32e-05db94780591 tempest-VolumesTransfersTest-1940436371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (346e7aeb-2e2b-4cf8-b788-7446b50b142a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1831195771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db58e7e-b719-4b7f-a12e-653600a0dc14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c520b07ea6f4e5ba06ebdbffb0fa5be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:37:23Z,use_quota=True,user_id='ea8cc4de27f04efd8bbf0f941876dc55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:23 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4315b31d-dcbc-4380-b32e-05db94780591 tempest-VolumesTransfersTest-1940436371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eee1987a-753a-4890-bff4-1dfa354cea95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:23 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4315b31d-dcbc-4380-b32e-05db94780591 tempest-VolumesTransfersTest-1940436371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eee1987a-753a-4890-bff4-1dfa354cea95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:23 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4315b31d-dcbc-4380-b32e-05db94780591 tempest-VolumesTransfersTest-1940436371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb57654-ee7e-4b87-b876-a86a5569046e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:23 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4315b31d-dcbc-4380-b32e-05db94780591 tempest-VolumesTransfersTest-1940436371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb57654-ee7e-4b87-b876-a86a5569046e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5db58e7e-b719-4b7f-a12e-653600a0dc14', 'volume_name': 'volume-5db58e7e-b719-4b7f-a12e-653600a0dc14', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:23 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4315b31d-dcbc-4380-b32e-05db94780591 tempest-VolumesTransfersTest-1940436371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9467abeb-6675-4155-85cc-2c0167105ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:23 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4315b31d-dcbc-4380-b32e-05db94780591 tempest-VolumesTransfersTest-1940436371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9467abeb-6675-4155-85cc-2c0167105ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:23 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4315b31d-dcbc-4380-b32e-05db94780591 tempest-VolumesTransfersTest-1940436371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (441371b1-1df6-48a5-b299-f06a981500e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:23 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-4315b31d-dcbc-4380-b32e-05db94780591 tempest-VolumesTransfersTest-1940436371 None] Volume 5db58e7e-b719-4b7f-a12e-653600a0dc14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5db58e7e-b719-4b7f-a12e-653600a0dc14', 'volume_size': 1} Jul 08 01:37:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4315b31d-dcbc-4380-b32e-05db94780591 tempest-VolumesTransfersTest-1940436371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4315b31d-dcbc-4380-b32e-05db94780591 tempest-VolumesTransfersTest-1940436371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:23 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-4315b31d-dcbc-4380-b32e-05db94780591 tempest-VolumesTransfersTest-1940436371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1831195771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db58e7e-b719-4b7f-a12e-653600a0dc14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c520b07ea6f4e5ba06ebdbffb0fa5be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:37:23Z,use_quota=True,user_id='ea8cc4de27f04efd8bbf0f941876dc55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:37:23 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-4315b31d-dcbc-4380-b32e-05db94780591 tempest-VolumesTransfersTest-1940436371 None] Creating volume 5db58e7e-b719-4b7f-a12e-653600a0dc14 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:37:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4315b31d-dcbc-4380-b32e-05db94780591 tempest-VolumesTransfersTest-1940436371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4315b31d-dcbc-4380-b32e-05db94780591 tempest-VolumesTransfersTest-1940436371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:23 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-4315b31d-dcbc-4380-b32e-05db94780591 tempest-VolumesTransfersTest-1940436371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:37:23 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-4315b31d-dcbc-4380-b32e-05db94780591 tempest-VolumesTransfersTest-1940436371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:37:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4315b31d-dcbc-4380-b32e-05db94780591 tempest-VolumesTransfersTest-1940436371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:23 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-4315b31d-dcbc-4380-b32e-05db94780591 tempest-VolumesTransfersTest-1940436371 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:37:23 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-4315b31d-dcbc-4380-b32e-05db94780591 tempest-VolumesTransfersTest-1940436371 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:37:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4315b31d-dcbc-4380-b32e-05db94780591 tempest-VolumesTransfersTest-1940436371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5db58e7e-b719-4b7f-a12e-653600a0dc14 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:23 devstack sudo[94009]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5d100383-6bac-437f-8431-b0fe6941d9ab tempest-VolumesSnapshotListTestJSON-74209177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.512d8be0-7ad7-4699-bdf1-193733ba751f" returned: 0 in 1.066s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:23 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-5d100383-6bac-437f-8431-b0fe6941d9ab tempest-VolumesSnapshotListTestJSON-74209177 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59106196-2e47-45ef-b2b3-28af98f6e2ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:37:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5d100383-6bac-437f-8431-b0fe6941d9ab tempest-VolumesSnapshotListTestJSON-74209177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.45925706-3946-4fbf-8ed5-b34ebdedd0e9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:23 devstack sudo[94015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5db58e7e-b719-4b7f-a12e-653600a0dc14 1073741824 Jul 08 01:37:23 devstack sudo[94015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:23 devstack sudo[94016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.45925706-3946-4fbf-8ed5-b34ebdedd0e9 Jul 08 01:37:23 devstack sudo[94016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:24 devstack sudo[94016]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5d100383-6bac-437f-8431-b0fe6941d9ab tempest-VolumesSnapshotListTestJSON-74209177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.45925706-3946-4fbf-8ed5-b34ebdedd0e9" returned: 0 in 0.972s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5d100383-6bac-437f-8431-b0fe6941d9ab tempest-VolumesSnapshotListTestJSON-74209177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.45925706-3946-4fbf-8ed5-b34ebdedd0e9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:24 devstack sudo[94027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.45925706-3946-4fbf-8ed5-b34ebdedd0e9 Jul 08 01:37:24 devstack sudo[94027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:24 devstack sudo[94015]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4315b31d-dcbc-4380-b32e-05db94780591 tempest-VolumesTransfersTest-1940436371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5db58e7e-b719-4b7f-a12e-653600a0dc14 1073741824" returned: 0 in 1.075s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4315b31d-dcbc-4380-b32e-05db94780591 tempest-VolumesTransfersTest-1940436371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5db58e7e-b719-4b7f-a12e-653600a0dc14 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:24 devstack sudo[94029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5db58e7e-b719-4b7f-a12e-653600a0dc14 Jul 08 01:37:24 devstack sudo[94029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:25 devstack sudo[94027]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5d100383-6bac-437f-8431-b0fe6941d9ab tempest-VolumesSnapshotListTestJSON-74209177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.45925706-3946-4fbf-8ed5-b34ebdedd0e9" returned: 0 in 0.846s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:25 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5d100383-6bac-437f-8431-b0fe6941d9ab tempest-VolumesSnapshotListTestJSON-74209177 None] Lock "cinder-quobyte-45925706-3946-4fbf-8ed5-b34ebdedd0e9" released by "_delete_snapshot" :: held 4.009s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:25 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5d100383-6bac-437f-8431-b0fe6941d9ab tempest-VolumesSnapshotListTestJSON-74209177 None] Lock "cinder-quobyte-59106196-2e47-45ef-b2b3-28af98f6e2ab" released by "delete_snapshot" :: held 4.052s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:25 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-5d100383-6bac-437f-8431-b0fe6941d9ab tempest-VolumesSnapshotListTestJSON-74209177 None] Created reservations ['b0d5c875-6632-40bc-ab45-8e86e5b974c3', '729a9d64-0e43-4e6b-9aff-e335956d8713', '1bb91de0-59c1-4047-a633-e0d43445c683', '3fa6e2a3-18e9-4716-8578-c3e24ad1b15c'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:37:25 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-5d100383-6bac-437f-8431-b0fe6941d9ab tempest-VolumesSnapshotListTestJSON-74209177 None] Delete snapshot completed successfully. Jul 08 01:37:25 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5d100383-6bac-437f-8431-b0fe6941d9ab tempest-VolumesSnapshotListTestJSON-74209177 None] Lock "cinder-45925706-3946-4fbf-8ed5-b34ebdedd0e9-delete_snapshot" released by "delete_snapshot" :: held 4.333s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:25 devstack sudo[94029]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4315b31d-dcbc-4380-b32e-05db94780591 tempest-VolumesTransfersTest-1940436371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5db58e7e-b719-4b7f-a12e-653600a0dc14" returned: 0 in 1.073s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:25 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-4315b31d-dcbc-4380-b32e-05db94780591 tempest-VolumesTransfersTest-1940436371 None] <== create_volume: return (2206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:37:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4315b31d-dcbc-4380-b32e-05db94780591 tempest-VolumesTransfersTest-1940436371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.211s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:25 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4315b31d-dcbc-4380-b32e-05db94780591 tempest-VolumesTransfersTest-1940436371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (441371b1-1df6-48a5-b299-f06a981500e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5db58e7e-b719-4b7f-a12e-653600a0dc14', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:25 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4315b31d-dcbc-4380-b32e-05db94780591 tempest-VolumesTransfersTest-1940436371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c5cd222-c9f2-49f6-a757-ed7463b1581b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:25 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-4315b31d-dcbc-4380-b32e-05db94780591 tempest-VolumesTransfersTest-1940436371 None] Volume volume-5db58e7e-b719-4b7f-a12e-653600a0dc14 (5db58e7e-b719-4b7f-a12e-653600a0dc14): created successfully Jul 08 01:37:25 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4315b31d-dcbc-4380-b32e-05db94780591 tempest-VolumesTransfersTest-1940436371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c5cd222-c9f2-49f6-a757-ed7463b1581b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:25 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4315b31d-dcbc-4380-b32e-05db94780591 tempest-VolumesTransfersTest-1940436371 None] Flow 'volume_create_manager' (384ef45c-3271-4ddc-b926-47659a81b413) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:37:25 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-4315b31d-dcbc-4380-b32e-05db94780591 tempest-VolumesTransfersTest-1940436371 None] Created volume successfully. Jul 08 01:37:26 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e35e26eb-e0b3-45ce-ac90-2e59b7a28797 tempest-AttachVolumeTestJSON-1425049151 None] Acquiring lock "cinder-a32bbbc8-11f2-481a-861d-3e5a85149313-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:26 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e35e26eb-e0b3-45ce-ac90-2e59b7a28797 tempest-AttachVolumeTestJSON-1425049151 None] Lock "cinder-a32bbbc8-11f2-481a-861d-3e5a85149313-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:26 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e35e26eb-e0b3-45ce-ac90-2e59b7a28797 tempest-AttachVolumeTestJSON-1425049151 None] Acquiring lock "cinder-quobyte-a32bbbc8-11f2-481a-861d-3e5a85149313" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:26 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e35e26eb-e0b3-45ce-ac90-2e59b7a28797 tempest-AttachVolumeTestJSON-1425049151 None] Lock "cinder-quobyte-a32bbbc8-11f2-481a-861d-3e5a85149313" acquired by "delete_volume" :: waited 0.020s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:26 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1027c4-87be-4df9-8044-3cc96d2a0c77]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:37:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e35e26eb-e0b3-45ce-ac90-2e59b7a28797 tempest-AttachVolumeTestJSON-1425049151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a32bbbc8-11f2-481a-861d-3e5a85149313 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:26 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ad39bbc-5450-4a71-94ee-6d6835a999dd tempest-VolumeQuotasAdminTestJSON-1855871195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:37:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7ad39bbc-5450-4a71-94ee-6d6835a999dd tempest-VolumeQuotasAdminTestJSON-1855871195 None] Flow 'volume_create_manager' (28622cbf-618a-418b-b20b-54aff3e81d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:37:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7ad39bbc-5450-4a71-94ee-6d6835a999dd tempest-VolumeQuotasAdminTestJSON-1855871195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3429b150-bdbc-4049-a2ba-bba351149f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7ad39bbc-5450-4a71-94ee-6d6835a999dd tempest-VolumeQuotasAdminTestJSON-1855871195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3429b150-bdbc-4049-a2ba-bba351149f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-479199275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c89f27ee-be83-4595-9e2d-66f4ce80b0bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6dcd1e99da144a78f024aac1516b740',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:37:27Z,use_quota=True,user_id='0f0e4350c16745eb944920812ed34b42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7ad39bbc-5450-4a71-94ee-6d6835a999dd tempest-VolumeQuotasAdminTestJSON-1855871195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7ddcf60-4a2b-4f88-9a69-a68d0b036aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7ad39bbc-5450-4a71-94ee-6d6835a999dd tempest-VolumeQuotasAdminTestJSON-1855871195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7ddcf60-4a2b-4f88-9a69-a68d0b036aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7ad39bbc-5450-4a71-94ee-6d6835a999dd tempest-VolumeQuotasAdminTestJSON-1855871195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a676f955-5563-4f3d-b919-afb609c80751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7ad39bbc-5450-4a71-94ee-6d6835a999dd tempest-VolumeQuotasAdminTestJSON-1855871195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a676f955-5563-4f3d-b919-afb609c80751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c89f27ee-be83-4595-9e2d-66f4ce80b0bd', 'volume_name': 'volume-c89f27ee-be83-4595-9e2d-66f4ce80b0bd', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7ad39bbc-5450-4a71-94ee-6d6835a999dd tempest-VolumeQuotasAdminTestJSON-1855871195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a16e6f3-33e8-4af4-9263-0c60ee888403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7ad39bbc-5450-4a71-94ee-6d6835a999dd tempest-VolumeQuotasAdminTestJSON-1855871195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a16e6f3-33e8-4af4-9263-0c60ee888403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7ad39bbc-5450-4a71-94ee-6d6835a999dd tempest-VolumeQuotasAdminTestJSON-1855871195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad9b366a-2ef2-4765-b242-b00a1aa85313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:26 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-7ad39bbc-5450-4a71-94ee-6d6835a999dd tempest-VolumeQuotasAdminTestJSON-1855871195 None] Volume c89f27ee-be83-4595-9e2d-66f4ce80b0bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c89f27ee-be83-4595-9e2d-66f4ce80b0bd', 'volume_size': 1} Jul 08 01:37:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-7ad39bbc-5450-4a71-94ee-6d6835a999dd tempest-VolumeQuotasAdminTestJSON-1855871195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:26 devstack sudo[94075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a32bbbc8-11f2-481a-861d-3e5a85149313 Jul 08 01:37:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-7ad39bbc-5450-4a71-94ee-6d6835a999dd tempest-VolumeQuotasAdminTestJSON-1855871195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:26 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-7ad39bbc-5450-4a71-94ee-6d6835a999dd tempest-VolumeQuotasAdminTestJSON-1855871195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-479199275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c89f27ee-be83-4595-9e2d-66f4ce80b0bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6dcd1e99da144a78f024aac1516b740',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:37:27Z,use_quota=True,user_id='0f0e4350c16745eb944920812ed34b42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:37:26 devstack sudo[94075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:26 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-7ad39bbc-5450-4a71-94ee-6d6835a999dd tempest-VolumeQuotasAdminTestJSON-1855871195 None] Creating volume c89f27ee-be83-4595-9e2d-66f4ce80b0bd {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:37:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-7ad39bbc-5450-4a71-94ee-6d6835a999dd tempest-VolumeQuotasAdminTestJSON-1855871195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-7ad39bbc-5450-4a71-94ee-6d6835a999dd tempest-VolumeQuotasAdminTestJSON-1855871195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:26 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-7ad39bbc-5450-4a71-94ee-6d6835a999dd tempest-VolumeQuotasAdminTestJSON-1855871195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:37:26 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-7ad39bbc-5450-4a71-94ee-6d6835a999dd tempest-VolumeQuotasAdminTestJSON-1855871195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:37:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-7ad39bbc-5450-4a71-94ee-6d6835a999dd tempest-VolumeQuotasAdminTestJSON-1855871195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:26 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-7ad39bbc-5450-4a71-94ee-6d6835a999dd tempest-VolumeQuotasAdminTestJSON-1855871195 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:37:26 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-7ad39bbc-5450-4a71-94ee-6d6835a999dd tempest-VolumeQuotasAdminTestJSON-1855871195 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:37:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7ad39bbc-5450-4a71-94ee-6d6835a999dd tempest-VolumeQuotasAdminTestJSON-1855871195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c89f27ee-be83-4595-9e2d-66f4ce80b0bd 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:26 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-14268498-32f9-44b3-befa-e43d1ba267e3 tempest-VolumesSnapshotListTestJSON-74209177 None] Acquiring lock "cinder-512d8be0-7ad7-4699-bdf1-193733ba751f-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:26 devstack sudo[94077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c89f27ee-be83-4595-9e2d-66f4ce80b0bd 1073741824 Jul 08 01:37:26 devstack sudo[94077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:26 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-14268498-32f9-44b3-befa-e43d1ba267e3 tempest-VolumesSnapshotListTestJSON-74209177 None] Lock "cinder-512d8be0-7ad7-4699-bdf1-193733ba751f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:26 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-14268498-32f9-44b3-befa-e43d1ba267e3 tempest-VolumesSnapshotListTestJSON-74209177 None] Acquiring lock "cinder-quobyte-59106196-2e47-45ef-b2b3-28af98f6e2ab" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:26 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-14268498-32f9-44b3-befa-e43d1ba267e3 tempest-VolumesSnapshotListTestJSON-74209177 None] Lock "cinder-quobyte-59106196-2e47-45ef-b2b3-28af98f6e2ab" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:26 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-14268498-32f9-44b3-befa-e43d1ba267e3 tempest-VolumesSnapshotListTestJSON-74209177 None] Acquiring lock "cinder-quobyte-512d8be0-7ad7-4699-bdf1-193733ba751f" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:26 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-14268498-32f9-44b3-befa-e43d1ba267e3 tempest-VolumesSnapshotListTestJSON-74209177 None] Lock "cinder-quobyte-512d8be0-7ad7-4699-bdf1-193733ba751f" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:26 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-14268498-32f9-44b3-befa-e43d1ba267e3 tempest-VolumesSnapshotListTestJSON-74209177 None] Deleting offline snapshot 512d8be0-7ad7-4699-bdf1-193733ba751f of volume 59106196-2e47-45ef-b2b3-28af98f6e2ab {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:37:26 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-14268498-32f9-44b3-befa-e43d1ba267e3 tempest-VolumesSnapshotListTestJSON-74209177 None] snapshot_file for this snap is: volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.512d8be0-7ad7-4699-bdf1-193733ba751f {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:37:27 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8bc472-fe5d-45a4-970b-15ef6c475f63]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:37:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-14268498-32f9-44b3-befa-e43d1ba267e3 tempest-VolumesSnapshotListTestJSON-74209177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.512d8be0-7ad7-4699-bdf1-193733ba751f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:27 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f7381370-173c-48d5-b059-369013dd985d tempest-VolumesTransfersTest-266863303 None] Acquiring lock "cinder-5db58e7e-b719-4b7f-a12e-653600a0dc14-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:27 devstack sudo[94079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.512d8be0-7ad7-4699-bdf1-193733ba751f Jul 08 01:37:27 devstack sudo[94079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:27 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f7381370-173c-48d5-b059-369013dd985d tempest-VolumesTransfersTest-266863303 None] Lock "cinder-5db58e7e-b719-4b7f-a12e-653600a0dc14-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:27 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f7381370-173c-48d5-b059-369013dd985d tempest-VolumesTransfersTest-266863303 None] Acquiring lock "cinder-quobyte-5db58e7e-b719-4b7f-a12e-653600a0dc14" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:27 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f7381370-173c-48d5-b059-369013dd985d tempest-VolumesTransfersTest-266863303 None] Lock "cinder-quobyte-5db58e7e-b719-4b7f-a12e-653600a0dc14" acquired by "delete_volume" :: waited 0.026s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:27 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ee6b9a-03fd-438c-bc71-15f9fdb1ba91]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:37:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f7381370-173c-48d5-b059-369013dd985d tempest-VolumesTransfersTest-266863303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5db58e7e-b719-4b7f-a12e-653600a0dc14 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:27 devstack sudo[94081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5db58e7e-b719-4b7f-a12e-653600a0dc14 Jul 08 01:37:27 devstack sudo[94081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:27 devstack sudo[94075]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e35e26eb-e0b3-45ce-ac90-2e59b7a28797 tempest-AttachVolumeTestJSON-1425049151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a32bbbc8-11f2-481a-861d-3e5a85149313" returned: 0 in 1.086s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e35e26eb-e0b3-45ce-ac90-2e59b7a28797 tempest-AttachVolumeTestJSON-1425049151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a32bbbc8-11f2-481a-861d-3e5a85149313 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:27 devstack sudo[94091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a32bbbc8-11f2-481a-861d-3e5a85149313 Jul 08 01:37:27 devstack sudo[94091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:27 devstack sudo[94077]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7ad39bbc-5450-4a71-94ee-6d6835a999dd tempest-VolumeQuotasAdminTestJSON-1855871195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c89f27ee-be83-4595-9e2d-66f4ce80b0bd 1073741824" returned: 0 in 1.140s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7ad39bbc-5450-4a71-94ee-6d6835a999dd tempest-VolumeQuotasAdminTestJSON-1855871195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c89f27ee-be83-4595-9e2d-66f4ce80b0bd {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:28 devstack sudo[94097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c89f27ee-be83-4595-9e2d-66f4ce80b0bd Jul 08 01:37:28 devstack sudo[94097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:28 devstack sudo[94079]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-14268498-32f9-44b3-befa-e43d1ba267e3 tempest-VolumesSnapshotListTestJSON-74209177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.512d8be0-7ad7-4699-bdf1-193733ba751f" returned: 0 in 1.142s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:28 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-14268498-32f9-44b3-befa-e43d1ba267e3 tempest-VolumesSnapshotListTestJSON-74209177 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59106196-2e47-45ef-b2b3-28af98f6e2ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:37:28 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[5834e6b6-0f15-4d94-8717-092fb11ba7fc]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:37:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-14268498-32f9-44b3-befa-e43d1ba267e3 tempest-VolumesSnapshotListTestJSON-74209177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:28 devstack sudo[94081]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f7381370-173c-48d5-b059-369013dd985d tempest-VolumesTransfersTest-266863303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5db58e7e-b719-4b7f-a12e-653600a0dc14" returned: 0 in 0.922s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f7381370-173c-48d5-b059-369013dd985d tempest-VolumesTransfersTest-266863303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5db58e7e-b719-4b7f-a12e-653600a0dc14 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:28 devstack sudo[94103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5db58e7e-b719-4b7f-a12e-653600a0dc14 Jul 08 01:37:28 devstack sudo[94103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:28 devstack sudo[94102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab Jul 08 01:37:28 devstack sudo[94102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:28 devstack sudo[94091]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e35e26eb-e0b3-45ce-ac90-2e59b7a28797 tempest-AttachVolumeTestJSON-1425049151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a32bbbc8-11f2-481a-861d-3e5a85149313" returned: 0 in 0.787s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:28 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e35e26eb-e0b3-45ce-ac90-2e59b7a28797 tempest-AttachVolumeTestJSON-1425049151 None] Lock "cinder-quobyte-a32bbbc8-11f2-481a-861d-3e5a85149313" released by "delete_volume" :: held 1.927s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:28 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-e35e26eb-e0b3-45ce-ac90-2e59b7a28797 tempest-AttachVolumeTestJSON-1425049151 None] Created reservations ['9de856a4-2c0f-435f-b4b3-bca704c62d9b', '116aa81c-faf0-449c-adb7-23fa240b3b56', 'c812f590-53d8-4c78-9c83-9691aa943a5e', 'f46040f6-8135-44fd-9ff1-df199af96f29'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:37:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e35e26eb-e0b3-45ce-ac90-2e59b7a28797 tempest-AttachVolumeTestJSON-1425049151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e35e26eb-e0b3-45ce-ac90-2e59b7a28797 tempest-AttachVolumeTestJSON-1425049151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:28 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e35e26eb-e0b3-45ce-ac90-2e59b7a28797 tempest-AttachVolumeTestJSON-1425049151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:37:28 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e35e26eb-e0b3-45ce-ac90-2e59b7a28797 tempest-AttachVolumeTestJSON-1425049151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:37:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e35e26eb-e0b3-45ce-ac90-2e59b7a28797 tempest-AttachVolumeTestJSON-1425049151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e35e26eb-e0b3-45ce-ac90-2e59b7a28797 tempest-AttachVolumeTestJSON-1425049151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:28 devstack sudo[94107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:37:28 devstack sudo[94107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:28 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-dd6a7511-364c-4644-b7f6-afa05ffe1a11 tempest-AttachVolumeTestJSON-1425049151 None] Acquiring lock "cinder-036ab950-64f6-4f78-9cd8-39551020e708-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:28 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-dd6a7511-364c-4644-b7f6-afa05ffe1a11 tempest-AttachVolumeTestJSON-1425049151 None] Lock "cinder-036ab950-64f6-4f78-9cd8-39551020e708-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:29 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-dd6a7511-364c-4644-b7f6-afa05ffe1a11 tempest-AttachVolumeTestJSON-1425049151 None] Acquiring lock "cinder-quobyte-036ab950-64f6-4f78-9cd8-39551020e708" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:29 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-dd6a7511-364c-4644-b7f6-afa05ffe1a11 tempest-AttachVolumeTestJSON-1425049151 None] Lock "cinder-quobyte-036ab950-64f6-4f78-9cd8-39551020e708" acquired by "delete_volume" :: waited 0.023s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:29 devstack sudo[94097]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7ad39bbc-5450-4a71-94ee-6d6835a999dd tempest-VolumeQuotasAdminTestJSON-1855871195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c89f27ee-be83-4595-9e2d-66f4ce80b0bd" returned: 0 in 1.042s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:29 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-7ad39bbc-5450-4a71-94ee-6d6835a999dd tempest-VolumeQuotasAdminTestJSON-1855871195 None] <== create_volume: return (2254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:37:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-7ad39bbc-5450-4a71-94ee-6d6835a999dd tempest-VolumeQuotasAdminTestJSON-1855871195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.257s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:29 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc90ddc-84bb-41ec-aecd-340502d03fae]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:37:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-dd6a7511-364c-4644-b7f6-afa05ffe1a11 tempest-AttachVolumeTestJSON-1425049151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-036ab950-64f6-4f78-9cd8-39551020e708 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:29 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7ad39bbc-5450-4a71-94ee-6d6835a999dd tempest-VolumeQuotasAdminTestJSON-1855871195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad9b366a-2ef2-4765-b242-b00a1aa85313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c89f27ee-be83-4595-9e2d-66f4ce80b0bd', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:29 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7ad39bbc-5450-4a71-94ee-6d6835a999dd tempest-VolumeQuotasAdminTestJSON-1855871195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d599b017-a987-4660-988d-983917c34fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:29 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-7ad39bbc-5450-4a71-94ee-6d6835a999dd tempest-VolumeQuotasAdminTestJSON-1855871195 None] Volume volume-c89f27ee-be83-4595-9e2d-66f4ce80b0bd (c89f27ee-be83-4595-9e2d-66f4ce80b0bd): created successfully Jul 08 01:37:29 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7ad39bbc-5450-4a71-94ee-6d6835a999dd tempest-VolumeQuotasAdminTestJSON-1855871195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d599b017-a987-4660-988d-983917c34fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:29 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7ad39bbc-5450-4a71-94ee-6d6835a999dd tempest-VolumeQuotasAdminTestJSON-1855871195 None] Flow 'volume_create_manager' (28622cbf-618a-418b-b20b-54aff3e81d08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:37:29 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-7ad39bbc-5450-4a71-94ee-6d6835a999dd tempest-VolumeQuotasAdminTestJSON-1855871195 None] Created volume successfully. Jul 08 01:37:29 devstack sudo[94103]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f7381370-173c-48d5-b059-369013dd985d tempest-VolumesTransfersTest-266863303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5db58e7e-b719-4b7f-a12e-653600a0dc14" returned: 0 in 0.958s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:29 devstack sudo[94102]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-14268498-32f9-44b3-befa-e43d1ba267e3 tempest-VolumesSnapshotListTestJSON-74209177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab" returned: 0 in 1.071s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-14268498-32f9-44b3-befa-e43d1ba267e3 tempest-VolumesSnapshotListTestJSON-74209177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.512d8be0-7ad7-4699-bdf1-193733ba751f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:29 devstack sudo[94114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-036ab950-64f6-4f78-9cd8-39551020e708 Jul 08 01:37:29 devstack sudo[94114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:29 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f7381370-173c-48d5-b059-369013dd985d tempest-VolumesTransfersTest-266863303 None] Lock "cinder-quobyte-5db58e7e-b719-4b7f-a12e-653600a0dc14" released by "delete_volume" :: held 1.949s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:29 devstack sudo[94116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.512d8be0-7ad7-4699-bdf1-193733ba751f Jul 08 01:37:29 devstack sudo[94116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:29 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-f7381370-173c-48d5-b059-369013dd985d tempest-VolumesTransfersTest-266863303 None] Created reservations ['a810b375-7235-4f0e-b1ed-6c06f56a5b6c', 'e874f168-b7f0-4459-a053-17d43ae94cf3', '0a923f2a-166a-4a90-ab58-b41051bf03cc', 'ba824aad-81fe-4d7a-a3d6-a6e6df774c6c'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:37:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f7381370-173c-48d5-b059-369013dd985d tempest-VolumesTransfersTest-266863303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f7381370-173c-48d5-b059-369013dd985d tempest-VolumesTransfersTest-266863303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:29 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f7381370-173c-48d5-b059-369013dd985d tempest-VolumesTransfersTest-266863303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:37:29 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f7381370-173c-48d5-b059-369013dd985d tempest-VolumesTransfersTest-266863303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:37:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f7381370-173c-48d5-b059-369013dd985d tempest-VolumesTransfersTest-266863303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f7381370-173c-48d5-b059-369013dd985d tempest-VolumesTransfersTest-266863303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:29 devstack sudo[94118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:37:29 devstack sudo[94118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:29 devstack sudo[94107]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e35e26eb-e0b3-45ce-ac90-2e59b7a28797 tempest-AttachVolumeTestJSON-1425049151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.038s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:29 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-e35e26eb-e0b3-45ce-ac90-2e59b7a28797 tempest-AttachVolumeTestJSON-1425049151 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:37:29 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-e35e26eb-e0b3-45ce-ac90-2e59b7a28797 tempest-AttachVolumeTestJSON-1425049151 None] Deleted volume successfully. Jul 08 01:37:29 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e35e26eb-e0b3-45ce-ac90-2e59b7a28797 tempest-AttachVolumeTestJSON-1425049151 None] Lock "cinder-a32bbbc8-11f2-481a-861d-3e5a85149313-delete_volume" released by "delete_volume" :: held 3.317s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:30 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-464d3e9d-b95f-4000-a65b-6fd2321a78a2 tempest-VolumeQuotasAdminTestJSON-1855871195 None] Acquiring lock "cinder-c89f27ee-be83-4595-9e2d-66f4ce80b0bd-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:30 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-464d3e9d-b95f-4000-a65b-6fd2321a78a2 tempest-VolumeQuotasAdminTestJSON-1855871195 None] Lock "cinder-c89f27ee-be83-4595-9e2d-66f4ce80b0bd-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:30 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-464d3e9d-b95f-4000-a65b-6fd2321a78a2 tempest-VolumeQuotasAdminTestJSON-1855871195 None] Acquiring lock "cinder-quobyte-c89f27ee-be83-4595-9e2d-66f4ce80b0bd" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:30 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-464d3e9d-b95f-4000-a65b-6fd2321a78a2 tempest-VolumeQuotasAdminTestJSON-1855871195 None] Lock "cinder-quobyte-c89f27ee-be83-4595-9e2d-66f4ce80b0bd" acquired by "delete_volume" :: waited 0.025s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:30 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa7b7bd-7ce7-47bb-9d3b-7e7096680eac]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:37:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-464d3e9d-b95f-4000-a65b-6fd2321a78a2 tempest-VolumeQuotasAdminTestJSON-1855871195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c89f27ee-be83-4595-9e2d-66f4ce80b0bd {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:30 devstack sudo[94114]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-dd6a7511-364c-4644-b7f6-afa05ffe1a11 tempest-AttachVolumeTestJSON-1425049151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-036ab950-64f6-4f78-9cd8-39551020e708" returned: 0 in 1.304s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-dd6a7511-364c-4644-b7f6-afa05ffe1a11 tempest-AttachVolumeTestJSON-1425049151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-036ab950-64f6-4f78-9cd8-39551020e708 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:30 devstack sudo[94116]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-14268498-32f9-44b3-befa-e43d1ba267e3 tempest-VolumesSnapshotListTestJSON-74209177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.512d8be0-7ad7-4699-bdf1-193733ba751f" returned: 0 in 1.177s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-14268498-32f9-44b3-befa-e43d1ba267e3 tempest-VolumesSnapshotListTestJSON-74209177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.512d8be0-7ad7-4699-bdf1-193733ba751f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:30 devstack sudo[94130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-036ab950-64f6-4f78-9cd8-39551020e708 Jul 08 01:37:30 devstack sudo[94130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:30 devstack sudo[94128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c89f27ee-be83-4595-9e2d-66f4ce80b0bd Jul 08 01:37:30 devstack sudo[94128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:30 devstack sudo[94131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.512d8be0-7ad7-4699-bdf1-193733ba751f Jul 08 01:37:30 devstack sudo[94131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:30 devstack sudo[94118]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f7381370-173c-48d5-b059-369013dd985d tempest-VolumesTransfersTest-266863303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.172s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:30 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-f7381370-173c-48d5-b059-369013dd985d tempest-VolumesTransfersTest-266863303 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:37:30 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-f7381370-173c-48d5-b059-369013dd985d tempest-VolumesTransfersTest-266863303 None] Deleted volume successfully. Jul 08 01:37:30 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f7381370-173c-48d5-b059-369013dd985d tempest-VolumesTransfersTest-266863303 None] Lock "cinder-5db58e7e-b719-4b7f-a12e-653600a0dc14-delete_volume" released by "delete_volume" :: held 3.479s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:31 devstack sudo[94130]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-dd6a7511-364c-4644-b7f6-afa05ffe1a11 tempest-AttachVolumeTestJSON-1425049151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-036ab950-64f6-4f78-9cd8-39551020e708" returned: 0 in 0.805s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:31 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-dd6a7511-364c-4644-b7f6-afa05ffe1a11 tempest-AttachVolumeTestJSON-1425049151 None] Lock "cinder-quobyte-036ab950-64f6-4f78-9cd8-39551020e708" released by "delete_volume" :: held 2.183s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:31 devstack sudo[94131]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-14268498-32f9-44b3-befa-e43d1ba267e3 tempest-VolumesSnapshotListTestJSON-74209177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab.512d8be0-7ad7-4699-bdf1-193733ba751f" returned: 0 in 0.864s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:31 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-14268498-32f9-44b3-befa-e43d1ba267e3 tempest-VolumesSnapshotListTestJSON-74209177 None] Lock "cinder-quobyte-512d8be0-7ad7-4699-bdf1-193733ba751f" released by "_delete_snapshot" :: held 4.434s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:31 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-dd6a7511-364c-4644-b7f6-afa05ffe1a11 tempest-AttachVolumeTestJSON-1425049151 None] Created reservations ['5c22005a-d524-4d85-96af-f1502a4c4b28', 'b2a3ce18-2c98-4f3b-87ef-246c1c26009d', 'ba09be0d-80bc-40ce-9877-c0ee3c2b12ca', '22b5ab4d-d2f1-400f-8620-8f8797757920'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:37:31 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-14268498-32f9-44b3-befa-e43d1ba267e3 tempest-VolumesSnapshotListTestJSON-74209177 None] Lock "cinder-quobyte-59106196-2e47-45ef-b2b3-28af98f6e2ab" released by "delete_snapshot" :: held 4.475s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:31 devstack sudo[94128]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-464d3e9d-b95f-4000-a65b-6fd2321a78a2 tempest-VolumeQuotasAdminTestJSON-1855871195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c89f27ee-be83-4595-9e2d-66f4ce80b0bd" returned: 0 in 1.230s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-464d3e9d-b95f-4000-a65b-6fd2321a78a2 tempest-VolumeQuotasAdminTestJSON-1855871195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c89f27ee-be83-4595-9e2d-66f4ce80b0bd {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:31 devstack sudo[94140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c89f27ee-be83-4595-9e2d-66f4ce80b0bd Jul 08 01:37:31 devstack sudo[94140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-dd6a7511-364c-4644-b7f6-afa05ffe1a11 tempest-AttachVolumeTestJSON-1425049151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-dd6a7511-364c-4644-b7f6-afa05ffe1a11 tempest-AttachVolumeTestJSON-1425049151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:31 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-dd6a7511-364c-4644-b7f6-afa05ffe1a11 tempest-AttachVolumeTestJSON-1425049151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:37:31 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-dd6a7511-364c-4644-b7f6-afa05ffe1a11 tempest-AttachVolumeTestJSON-1425049151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:37:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-dd6a7511-364c-4644-b7f6-afa05ffe1a11 tempest-AttachVolumeTestJSON-1425049151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-dd6a7511-364c-4644-b7f6-afa05ffe1a11 tempest-AttachVolumeTestJSON-1425049151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:31 devstack sudo[94142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:37:31 devstack sudo[94142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:31 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-14268498-32f9-44b3-befa-e43d1ba267e3 tempest-VolumesSnapshotListTestJSON-74209177 None] Created reservations ['d63c2da5-3c76-4114-b5c7-127b4d4ab986', '024781fb-9ad8-4bf5-af81-9b60ab1dc7c1', '97063bb0-1da9-493d-ac20-1a9895e8a97b', '60f38a37-8178-4449-b7e2-3d0687384029'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:37:31 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-14268498-32f9-44b3-befa-e43d1ba267e3 tempest-VolumesSnapshotListTestJSON-74209177 None] Delete snapshot completed successfully. Jul 08 01:37:31 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-14268498-32f9-44b3-befa-e43d1ba267e3 tempest-VolumesSnapshotListTestJSON-74209177 None] Lock "cinder-512d8be0-7ad7-4699-bdf1-193733ba751f-delete_snapshot" released by "delete_snapshot" :: held 4.829s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:32 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-64b803c5-89d6-490f-b5a0-6270698954a5 tempest-VolumesSnapshotListTestJSON-74209177 None] Acquiring lock "cinder-59106196-2e47-45ef-b2b3-28af98f6e2ab-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:32 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-64b803c5-89d6-490f-b5a0-6270698954a5 tempest-VolumesSnapshotListTestJSON-74209177 None] Lock "cinder-59106196-2e47-45ef-b2b3-28af98f6e2ab-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:32 devstack sudo[94140]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-464d3e9d-b95f-4000-a65b-6fd2321a78a2 tempest-VolumeQuotasAdminTestJSON-1855871195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c89f27ee-be83-4595-9e2d-66f4ce80b0bd" returned: 0 in 1.012s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:32 devstack sudo[94142]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-dd6a7511-364c-4644-b7f6-afa05ffe1a11 tempest-AttachVolumeTestJSON-1425049151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.978s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:32 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-dd6a7511-364c-4644-b7f6-afa05ffe1a11 tempest-AttachVolumeTestJSON-1425049151 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:37:32 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-464d3e9d-b95f-4000-a65b-6fd2321a78a2 tempest-VolumeQuotasAdminTestJSON-1855871195 None] Lock "cinder-quobyte-c89f27ee-be83-4595-9e2d-66f4ce80b0bd" released by "delete_volume" :: held 2.321s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:32 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-dd6a7511-364c-4644-b7f6-afa05ffe1a11 tempest-AttachVolumeTestJSON-1425049151 None] Deleted volume successfully. Jul 08 01:37:32 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-64b803c5-89d6-490f-b5a0-6270698954a5 tempest-VolumesSnapshotListTestJSON-74209177 None] Acquiring lock "cinder-quobyte-59106196-2e47-45ef-b2b3-28af98f6e2ab" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:32 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-64b803c5-89d6-490f-b5a0-6270698954a5 tempest-VolumesSnapshotListTestJSON-74209177 None] Lock "cinder-quobyte-59106196-2e47-45ef-b2b3-28af98f6e2ab" acquired by "delete_volume" :: waited 0.029s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:32 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-464d3e9d-b95f-4000-a65b-6fd2321a78a2 tempest-VolumeQuotasAdminTestJSON-1855871195 None] Created reservations ['5442932e-03f1-481a-979e-519af5d553b3', '7ced0aca-d0f6-466a-a3eb-002e8c7f2b03', '46460e31-0b56-4370-a781-0f627af52790', 'c7dfc89d-cd9d-4722-b9d5-46d298604462'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:37:32 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-dd6a7511-364c-4644-b7f6-afa05ffe1a11 tempest-AttachVolumeTestJSON-1425049151 None] Lock "cinder-036ab950-64f6-4f78-9cd8-39551020e708-delete_volume" released by "delete_volume" :: held 3.783s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:32 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e660d4fa-951e-4d02-8b6d-df4ad6746861 tempest-AttachVolumeTestJSON-1425049151 None] Acquiring lock "cinder-68b3c324-a6de-4211-8f85-4bc60c11bbe6-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:32 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[3807ecda-9ea0-4720-ae93-b2b8dc2691e9]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:37:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-64b803c5-89d6-490f-b5a0-6270698954a5 tempest-VolumesSnapshotListTestJSON-74209177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:32 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e660d4fa-951e-4d02-8b6d-df4ad6746861 tempest-AttachVolumeTestJSON-1425049151 None] Lock "cinder-68b3c324-a6de-4211-8f85-4bc60c11bbe6-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:32 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e660d4fa-951e-4d02-8b6d-df4ad6746861 tempest-AttachVolumeTestJSON-1425049151 None] Acquiring lock "cinder-quobyte-68b3c324-a6de-4211-8f85-4bc60c11bbe6" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:32 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e660d4fa-951e-4d02-8b6d-df4ad6746861 tempest-AttachVolumeTestJSON-1425049151 None] Lock "cinder-quobyte-68b3c324-a6de-4211-8f85-4bc60c11bbe6" acquired by "delete_volume" :: waited 0.031s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-464d3e9d-b95f-4000-a65b-6fd2321a78a2 tempest-VolumeQuotasAdminTestJSON-1855871195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-464d3e9d-b95f-4000-a65b-6fd2321a78a2 tempest-VolumeQuotasAdminTestJSON-1855871195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:32 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-464d3e9d-b95f-4000-a65b-6fd2321a78a2 tempest-VolumeQuotasAdminTestJSON-1855871195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:37:32 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-464d3e9d-b95f-4000-a65b-6fd2321a78a2 tempest-VolumeQuotasAdminTestJSON-1855871195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:37:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-464d3e9d-b95f-4000-a65b-6fd2321a78a2 tempest-VolumeQuotasAdminTestJSON-1855871195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-464d3e9d-b95f-4000-a65b-6fd2321a78a2 tempest-VolumeQuotasAdminTestJSON-1855871195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:32 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42c9fdf-f2b4-4690-b492-3bc9fcc707a4]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:37:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e660d4fa-951e-4d02-8b6d-df4ad6746861 tempest-AttachVolumeTestJSON-1425049151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68b3c324-a6de-4211-8f85-4bc60c11bbe6 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:32 devstack sudo[94147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab Jul 08 01:37:32 devstack sudo[94147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:32 devstack sudo[94148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:37:32 devstack sudo[94148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:33 devstack sudo[94149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68b3c324-a6de-4211-8f85-4bc60c11bbe6 Jul 08 01:37:33 devstack sudo[94149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:33 devstack sudo[94148]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-464d3e9d-b95f-4000-a65b-6fd2321a78a2 tempest-VolumeQuotasAdminTestJSON-1855871195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.942s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:33 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-464d3e9d-b95f-4000-a65b-6fd2321a78a2 tempest-VolumeQuotasAdminTestJSON-1855871195 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:37:33 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-464d3e9d-b95f-4000-a65b-6fd2321a78a2 tempest-VolumeQuotasAdminTestJSON-1855871195 None] Deleted volume successfully. Jul 08 01:37:33 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=119,cinder:INSERT=39,cinder:UPDATE=148,cinder:DELETE=12 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:37:33 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-464d3e9d-b95f-4000-a65b-6fd2321a78a2 tempest-VolumeQuotasAdminTestJSON-1855871195 None] Lock "cinder-c89f27ee-be83-4595-9e2d-66f4ce80b0bd-delete_volume" released by "delete_volume" :: held 3.808s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:34 devstack sudo[94149]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e660d4fa-951e-4d02-8b6d-df4ad6746861 tempest-AttachVolumeTestJSON-1425049151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68b3c324-a6de-4211-8f85-4bc60c11bbe6" returned: 0 in 1.184s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e660d4fa-951e-4d02-8b6d-df4ad6746861 tempest-AttachVolumeTestJSON-1425049151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68b3c324-a6de-4211-8f85-4bc60c11bbe6 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:34 devstack sudo[94147]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-64b803c5-89d6-490f-b5a0-6270698954a5 tempest-VolumesSnapshotListTestJSON-74209177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab" returned: 0 in 1.376s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-64b803c5-89d6-490f-b5a0-6270698954a5 tempest-VolumesSnapshotListTestJSON-74209177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:34 devstack sudo[94160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68b3c324-a6de-4211-8f85-4bc60c11bbe6 Jul 08 01:37:34 devstack sudo[94160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:34 devstack sudo[94161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab Jul 08 01:37:34 devstack sudo[94161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:34 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b7dfad9-b62e-4584-8a9d-2c2579e29edf tempest-VolumeQuotasAdminTestJSON-1855871195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:37:34 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0b7dfad9-b62e-4584-8a9d-2c2579e29edf tempest-VolumeQuotasAdminTestJSON-1855871195 None] Flow 'volume_create_manager' (93903b72-fc0c-4e8f-b540-d4147cf2d319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:37:34 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0b7dfad9-b62e-4584-8a9d-2c2579e29edf tempest-VolumeQuotasAdminTestJSON-1855871195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ac1e2ea-4b67-475c-b435-04b002498991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:34 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0b7dfad9-b62e-4584-8a9d-2c2579e29edf tempest-VolumeQuotasAdminTestJSON-1855871195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ac1e2ea-4b67-475c-b435-04b002498991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1143678537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba5a725-b78d-447f-9f0d-c03b1652e0da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6dcd1e99da144a78f024aac1516b740',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:37:34Z,use_quota=True,user_id='0f0e4350c16745eb944920812ed34b42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:34 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0b7dfad9-b62e-4584-8a9d-2c2579e29edf tempest-VolumeQuotasAdminTestJSON-1855871195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (908892df-808e-438c-83c9-e4d52579e0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:34 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0b7dfad9-b62e-4584-8a9d-2c2579e29edf tempest-VolumeQuotasAdminTestJSON-1855871195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (908892df-808e-438c-83c9-e4d52579e0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:34 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0b7dfad9-b62e-4584-8a9d-2c2579e29edf tempest-VolumeQuotasAdminTestJSON-1855871195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b6c9c47-7ee4-4bb7-98b8-60564abb9ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:34 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0b7dfad9-b62e-4584-8a9d-2c2579e29edf tempest-VolumeQuotasAdminTestJSON-1855871195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b6c9c47-7ee4-4bb7-98b8-60564abb9ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bba5a725-b78d-447f-9f0d-c03b1652e0da', 'volume_name': 'volume-bba5a725-b78d-447f-9f0d-c03b1652e0da', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:34 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0b7dfad9-b62e-4584-8a9d-2c2579e29edf tempest-VolumeQuotasAdminTestJSON-1855871195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b56788b-048f-497e-9984-1dd3674851c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:34 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0b7dfad9-b62e-4584-8a9d-2c2579e29edf tempest-VolumeQuotasAdminTestJSON-1855871195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b56788b-048f-497e-9984-1dd3674851c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:34 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0b7dfad9-b62e-4584-8a9d-2c2579e29edf tempest-VolumeQuotasAdminTestJSON-1855871195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b5541a-1c1c-4b8f-a741-55d9412bbbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:34 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-0b7dfad9-b62e-4584-8a9d-2c2579e29edf tempest-VolumeQuotasAdminTestJSON-1855871195 None] Volume bba5a725-b78d-447f-9f0d-c03b1652e0da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bba5a725-b78d-447f-9f0d-c03b1652e0da', 'volume_size': 1} Jul 08 01:37:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0b7dfad9-b62e-4584-8a9d-2c2579e29edf tempest-VolumeQuotasAdminTestJSON-1855871195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0b7dfad9-b62e-4584-8a9d-2c2579e29edf tempest-VolumeQuotasAdminTestJSON-1855871195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:34 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0b7dfad9-b62e-4584-8a9d-2c2579e29edf tempest-VolumeQuotasAdminTestJSON-1855871195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1143678537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba5a725-b78d-447f-9f0d-c03b1652e0da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6dcd1e99da144a78f024aac1516b740',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:37:34Z,use_quota=True,user_id='0f0e4350c16745eb944920812ed34b42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:37:34 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-0b7dfad9-b62e-4584-8a9d-2c2579e29edf tempest-VolumeQuotasAdminTestJSON-1855871195 None] Creating volume bba5a725-b78d-447f-9f0d-c03b1652e0da {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:37:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0b7dfad9-b62e-4584-8a9d-2c2579e29edf tempest-VolumeQuotasAdminTestJSON-1855871195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0b7dfad9-b62e-4584-8a9d-2c2579e29edf tempest-VolumeQuotasAdminTestJSON-1855871195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:34 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0b7dfad9-b62e-4584-8a9d-2c2579e29edf tempest-VolumeQuotasAdminTestJSON-1855871195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:37:34 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0b7dfad9-b62e-4584-8a9d-2c2579e29edf tempest-VolumeQuotasAdminTestJSON-1855871195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:37:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0b7dfad9-b62e-4584-8a9d-2c2579e29edf tempest-VolumeQuotasAdminTestJSON-1855871195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:34 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0b7dfad9-b62e-4584-8a9d-2c2579e29edf tempest-VolumeQuotasAdminTestJSON-1855871195 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:37:34 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-0b7dfad9-b62e-4584-8a9d-2c2579e29edf tempest-VolumeQuotasAdminTestJSON-1855871195 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:37:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0b7dfad9-b62e-4584-8a9d-2c2579e29edf tempest-VolumeQuotasAdminTestJSON-1855871195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bba5a725-b78d-447f-9f0d-c03b1652e0da 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:34 devstack sudo[94165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bba5a725-b78d-447f-9f0d-c03b1652e0da 1073741824 Jul 08 01:37:34 devstack sudo[94165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:35 devstack sudo[94160]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e660d4fa-951e-4d02-8b6d-df4ad6746861 tempest-AttachVolumeTestJSON-1425049151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68b3c324-a6de-4211-8f85-4bc60c11bbe6" returned: 0 in 0.933s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:35 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e660d4fa-951e-4d02-8b6d-df4ad6746861 tempest-AttachVolumeTestJSON-1425049151 None] Lock "cinder-quobyte-68b3c324-a6de-4211-8f85-4bc60c11bbe6" released by "delete_volume" :: held 2.183s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:35 devstack sudo[94161]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-64b803c5-89d6-490f-b5a0-6270698954a5 tempest-VolumesSnapshotListTestJSON-74209177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-59106196-2e47-45ef-b2b3-28af98f6e2ab" returned: 0 in 0.977s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:35 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-64b803c5-89d6-490f-b5a0-6270698954a5 tempest-VolumesSnapshotListTestJSON-74209177 None] Lock "cinder-quobyte-59106196-2e47-45ef-b2b3-28af98f6e2ab" released by "delete_volume" :: held 2.475s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:35 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-e660d4fa-951e-4d02-8b6d-df4ad6746861 tempest-AttachVolumeTestJSON-1425049151 None] Created reservations ['031cbb64-d409-4b87-a721-f7cd37f537e1', 'f8707844-f42c-43c2-a591-acac9135cb2b', 'b760a128-0dce-452b-85d4-b05c96d93fc5', '2d793316-d061-43ef-b4c5-190a4d62ed0d'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:37:35 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-64b803c5-89d6-490f-b5a0-6270698954a5 tempest-VolumesSnapshotListTestJSON-74209177 None] Created reservations ['34f00591-c309-467d-a83a-43bbd377e880', '8e842a97-5f91-49f2-8882-e4ad0699078e', '50446c12-594e-4733-9f5c-e78983f97e6f', '8adc4072-9260-4401-afd5-94932220f373'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:37:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e660d4fa-951e-4d02-8b6d-df4ad6746861 tempest-AttachVolumeTestJSON-1425049151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e660d4fa-951e-4d02-8b6d-df4ad6746861 tempest-AttachVolumeTestJSON-1425049151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:35 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e660d4fa-951e-4d02-8b6d-df4ad6746861 tempest-AttachVolumeTestJSON-1425049151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:37:35 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e660d4fa-951e-4d02-8b6d-df4ad6746861 tempest-AttachVolumeTestJSON-1425049151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:37:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e660d4fa-951e-4d02-8b6d-df4ad6746861 tempest-AttachVolumeTestJSON-1425049151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e660d4fa-951e-4d02-8b6d-df4ad6746861 tempest-AttachVolumeTestJSON-1425049151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:35 devstack sudo[94171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:37:35 devstack sudo[94171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-64b803c5-89d6-490f-b5a0-6270698954a5 tempest-VolumesSnapshotListTestJSON-74209177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-64b803c5-89d6-490f-b5a0-6270698954a5 tempest-VolumesSnapshotListTestJSON-74209177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:35 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-64b803c5-89d6-490f-b5a0-6270698954a5 tempest-VolumesSnapshotListTestJSON-74209177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:37:35 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-64b803c5-89d6-490f-b5a0-6270698954a5 tempest-VolumesSnapshotListTestJSON-74209177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:37:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-64b803c5-89d6-490f-b5a0-6270698954a5 tempest-VolumesSnapshotListTestJSON-74209177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-64b803c5-89d6-490f-b5a0-6270698954a5 tempest-VolumesSnapshotListTestJSON-74209177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:35 devstack sudo[94174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:37:35 devstack sudo[94174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:35 devstack sudo[94165]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0b7dfad9-b62e-4584-8a9d-2c2579e29edf tempest-VolumeQuotasAdminTestJSON-1855871195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bba5a725-b78d-447f-9f0d-c03b1652e0da 1073741824" returned: 0 in 1.110s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0b7dfad9-b62e-4584-8a9d-2c2579e29edf tempest-VolumeQuotasAdminTestJSON-1855871195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bba5a725-b78d-447f-9f0d-c03b1652e0da {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:35 devstack sudo[94177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bba5a725-b78d-447f-9f0d-c03b1652e0da Jul 08 01:37:35 devstack sudo[94177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:36 devstack sudo[94174]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:36 devstack sudo[94171]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-64b803c5-89d6-490f-b5a0-6270698954a5 tempest-VolumesSnapshotListTestJSON-74209177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.093s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:36 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-64b803c5-89d6-490f-b5a0-6270698954a5 tempest-VolumesSnapshotListTestJSON-74209177 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:37:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e660d4fa-951e-4d02-8b6d-df4ad6746861 tempest-AttachVolumeTestJSON-1425049151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.223s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:36 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-e660d4fa-951e-4d02-8b6d-df4ad6746861 tempest-AttachVolumeTestJSON-1425049151 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:37:36 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-64b803c5-89d6-490f-b5a0-6270698954a5 tempest-VolumesSnapshotListTestJSON-74209177 None] Deleted volume successfully. Jul 08 01:37:36 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-64b803c5-89d6-490f-b5a0-6270698954a5 tempest-VolumesSnapshotListTestJSON-74209177 None] Lock "cinder-59106196-2e47-45ef-b2b3-28af98f6e2ab-delete_volume" released by "delete_volume" :: held 4.279s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:36 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-e660d4fa-951e-4d02-8b6d-df4ad6746861 tempest-AttachVolumeTestJSON-1425049151 None] Deleted volume successfully. Jul 08 01:37:36 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e660d4fa-951e-4d02-8b6d-df4ad6746861 tempest-AttachVolumeTestJSON-1425049151 None] Lock "cinder-68b3c324-a6de-4211-8f85-4bc60c11bbe6-delete_volume" released by "delete_volume" :: held 3.954s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:37 devstack sudo[94177]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0b7dfad9-b62e-4584-8a9d-2c2579e29edf tempest-VolumeQuotasAdminTestJSON-1855871195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bba5a725-b78d-447f-9f0d-c03b1652e0da" returned: 0 in 1.211s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:37 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0b7dfad9-b62e-4584-8a9d-2c2579e29edf tempest-VolumeQuotasAdminTestJSON-1855871195 None] <== create_volume: return (2382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:37:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0b7dfad9-b62e-4584-8a9d-2c2579e29edf tempest-VolumeQuotasAdminTestJSON-1855871195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.383s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:37 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0b7dfad9-b62e-4584-8a9d-2c2579e29edf tempest-VolumeQuotasAdminTestJSON-1855871195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b5541a-1c1c-4b8f-a741-55d9412bbbcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bba5a725-b78d-447f-9f0d-c03b1652e0da', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:37 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0b7dfad9-b62e-4584-8a9d-2c2579e29edf tempest-VolumeQuotasAdminTestJSON-1855871195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92cdd6f2-816c-4030-9995-fa597240ac61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:37 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-0b7dfad9-b62e-4584-8a9d-2c2579e29edf tempest-VolumeQuotasAdminTestJSON-1855871195 None] Volume volume-bba5a725-b78d-447f-9f0d-c03b1652e0da (bba5a725-b78d-447f-9f0d-c03b1652e0da): created successfully Jul 08 01:37:37 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0b7dfad9-b62e-4584-8a9d-2c2579e29edf tempest-VolumeQuotasAdminTestJSON-1855871195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92cdd6f2-816c-4030-9995-fa597240ac61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:37 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0b7dfad9-b62e-4584-8a9d-2c2579e29edf tempest-VolumeQuotasAdminTestJSON-1855871195 None] Flow 'volume_create_manager' (93903b72-fc0c-4e8f-b540-d4147cf2d319) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:37:37 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-0b7dfad9-b62e-4584-8a9d-2c2579e29edf tempest-VolumeQuotasAdminTestJSON-1855871195 None] Created volume successfully. Jul 08 01:37:39 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-f430e52f-dc47-4d39-aea9-0ca820d8fab3 tempest-VolumeQuotasAdminTestJSON-1383253366 None] Transfer volume completed successfully. Jul 08 01:37:40 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-66383fa0-97d8-4905-b1f3-47b538de7fa6 tempest-VolumesTransfersV357Test-1821859764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:37:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-66383fa0-97d8-4905-b1f3-47b538de7fa6 tempest-VolumesTransfersV357Test-1821859764 None] Flow 'volume_create_manager' (e8d52482-7246-437e-9350-3fcedde7731d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:37:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-66383fa0-97d8-4905-b1f3-47b538de7fa6 tempest-VolumesTransfersV357Test-1821859764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df2c1a88-de49-4d2c-adb7-b1c9653e8a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-66383fa0-97d8-4905-b1f3-47b538de7fa6 tempest-VolumesTransfersV357Test-1821859764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df2c1a88-de49-4d2c-adb7-b1c9653e8a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1895104574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7cd596b-2795-4c2e-a0e4-aa04300503e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01964fdeda9c426fbde3efc46fa994ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:37:41Z,use_quota=True,user_id='2bfc8d56de0d45eebc867b3a1eaade4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-66383fa0-97d8-4905-b1f3-47b538de7fa6 tempest-VolumesTransfersV357Test-1821859764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41a089d1-efba-4284-ac91-8a560ceb6875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-66383fa0-97d8-4905-b1f3-47b538de7fa6 tempest-VolumesTransfersV357Test-1821859764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41a089d1-efba-4284-ac91-8a560ceb6875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-66383fa0-97d8-4905-b1f3-47b538de7fa6 tempest-VolumesTransfersV357Test-1821859764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5771cb4f-08e0-4d1e-aaff-fdac50df0475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-66383fa0-97d8-4905-b1f3-47b538de7fa6 tempest-VolumesTransfersV357Test-1821859764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5771cb4f-08e0-4d1e-aaff-fdac50df0475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7cd596b-2795-4c2e-a0e4-aa04300503e5', 'volume_name': 'volume-f7cd596b-2795-4c2e-a0e4-aa04300503e5', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-66383fa0-97d8-4905-b1f3-47b538de7fa6 tempest-VolumesTransfersV357Test-1821859764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cb26b85-7f44-4d23-a8b8-54f6c93edd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-66383fa0-97d8-4905-b1f3-47b538de7fa6 tempest-VolumesTransfersV357Test-1821859764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cb26b85-7f44-4d23-a8b8-54f6c93edd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-66383fa0-97d8-4905-b1f3-47b538de7fa6 tempest-VolumesTransfersV357Test-1821859764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bfd5bbd-d9f4-417d-bade-71ea5186d335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:40 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-66383fa0-97d8-4905-b1f3-47b538de7fa6 tempest-VolumesTransfersV357Test-1821859764 None] Volume f7cd596b-2795-4c2e-a0e4-aa04300503e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7cd596b-2795-4c2e-a0e4-aa04300503e5', 'volume_size': 1} Jul 08 01:37:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-66383fa0-97d8-4905-b1f3-47b538de7fa6 tempest-VolumesTransfersV357Test-1821859764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-66383fa0-97d8-4905-b1f3-47b538de7fa6 tempest-VolumesTransfersV357Test-1821859764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:40 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-66383fa0-97d8-4905-b1f3-47b538de7fa6 tempest-VolumesTransfersV357Test-1821859764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1895104574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7cd596b-2795-4c2e-a0e4-aa04300503e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01964fdeda9c426fbde3efc46fa994ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:37:41Z,use_quota=True,user_id='2bfc8d56de0d45eebc867b3a1eaade4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:37:40 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-66383fa0-97d8-4905-b1f3-47b538de7fa6 tempest-VolumesTransfersV357Test-1821859764 None] Creating volume f7cd596b-2795-4c2e-a0e4-aa04300503e5 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:37:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-66383fa0-97d8-4905-b1f3-47b538de7fa6 tempest-VolumesTransfersV357Test-1821859764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-66383fa0-97d8-4905-b1f3-47b538de7fa6 tempest-VolumesTransfersV357Test-1821859764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:40 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-66383fa0-97d8-4905-b1f3-47b538de7fa6 tempest-VolumesTransfersV357Test-1821859764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:37:40 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-66383fa0-97d8-4905-b1f3-47b538de7fa6 tempest-VolumesTransfersV357Test-1821859764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:37:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-66383fa0-97d8-4905-b1f3-47b538de7fa6 tempest-VolumesTransfersV357Test-1821859764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:40 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-66383fa0-97d8-4905-b1f3-47b538de7fa6 tempest-VolumesTransfersV357Test-1821859764 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:37:40 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-66383fa0-97d8-4905-b1f3-47b538de7fa6 tempest-VolumesTransfersV357Test-1821859764 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:37:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-66383fa0-97d8-4905-b1f3-47b538de7fa6 tempest-VolumesTransfersV357Test-1821859764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f7cd596b-2795-4c2e-a0e4-aa04300503e5 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:40 devstack sudo[94185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f7cd596b-2795-4c2e-a0e4-aa04300503e5 1073741824 Jul 08 01:37:40 devstack sudo[94185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:40 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2bd5f8d2-bbed-42e6-8cc8-98b7f70104c0 tempest-VolumeQuotasAdminTestJSON-244241276 None] Acquiring lock "cinder-bba5a725-b78d-447f-9f0d-c03b1652e0da-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:40 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2bd5f8d2-bbed-42e6-8cc8-98b7f70104c0 tempest-VolumeQuotasAdminTestJSON-244241276 None] Lock "cinder-bba5a725-b78d-447f-9f0d-c03b1652e0da-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:40 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2bd5f8d2-bbed-42e6-8cc8-98b7f70104c0 tempest-VolumeQuotasAdminTestJSON-244241276 None] Acquiring lock "cinder-quobyte-bba5a725-b78d-447f-9f0d-c03b1652e0da" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:40 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2bd5f8d2-bbed-42e6-8cc8-98b7f70104c0 tempest-VolumeQuotasAdminTestJSON-244241276 None] Lock "cinder-quobyte-bba5a725-b78d-447f-9f0d-c03b1652e0da" acquired by "delete_volume" :: waited 0.030s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:40 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d16558a-3852-48cb-bda6-a86cc1d7ddd9]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:37:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2bd5f8d2-bbed-42e6-8cc8-98b7f70104c0 tempest-VolumeQuotasAdminTestJSON-244241276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bba5a725-b78d-447f-9f0d-c03b1652e0da {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:41 devstack sudo[94187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bba5a725-b78d-447f-9f0d-c03b1652e0da Jul 08 01:37:41 devstack sudo[94187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:42 devstack sudo[94185]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-66383fa0-97d8-4905-b1f3-47b538de7fa6 tempest-VolumesTransfersV357Test-1821859764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f7cd596b-2795-4c2e-a0e4-aa04300503e5 1073741824" returned: 0 in 1.408s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-66383fa0-97d8-4905-b1f3-47b538de7fa6 tempest-VolumesTransfersV357Test-1821859764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f7cd596b-2795-4c2e-a0e4-aa04300503e5 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:42 devstack sudo[94198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f7cd596b-2795-4c2e-a0e4-aa04300503e5 Jul 08 01:37:42 devstack sudo[94198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:42 devstack sudo[94187]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2bd5f8d2-bbed-42e6-8cc8-98b7f70104c0 tempest-VolumeQuotasAdminTestJSON-244241276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bba5a725-b78d-447f-9f0d-c03b1652e0da" returned: 0 in 1.312s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2bd5f8d2-bbed-42e6-8cc8-98b7f70104c0 tempest-VolumeQuotasAdminTestJSON-244241276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bba5a725-b78d-447f-9f0d-c03b1652e0da {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:42 devstack sudo[94200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bba5a725-b78d-447f-9f0d-c03b1652e0da Jul 08 01:37:42 devstack sudo[94200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:43 devstack sudo[94198]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-66383fa0-97d8-4905-b1f3-47b538de7fa6 tempest-VolumesTransfersV357Test-1821859764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f7cd596b-2795-4c2e-a0e4-aa04300503e5" returned: 0 in 1.039s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:43 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-66383fa0-97d8-4905-b1f3-47b538de7fa6 tempest-VolumesTransfersV357Test-1821859764 None] <== create_volume: return (2533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:37:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-66383fa0-97d8-4905-b1f3-47b538de7fa6 tempest-VolumesTransfersV357Test-1821859764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.536s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:43 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-66383fa0-97d8-4905-b1f3-47b538de7fa6 tempest-VolumesTransfersV357Test-1821859764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bfd5bbd-d9f4-417d-bade-71ea5186d335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7cd596b-2795-4c2e-a0e4-aa04300503e5', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:43 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-66383fa0-97d8-4905-b1f3-47b538de7fa6 tempest-VolumesTransfersV357Test-1821859764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a52260-4e94-4cd4-8015-12253825c9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:43 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-66383fa0-97d8-4905-b1f3-47b538de7fa6 tempest-VolumesTransfersV357Test-1821859764 None] Volume volume-f7cd596b-2795-4c2e-a0e4-aa04300503e5 (f7cd596b-2795-4c2e-a0e4-aa04300503e5): created successfully Jul 08 01:37:43 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-66383fa0-97d8-4905-b1f3-47b538de7fa6 tempest-VolumesTransfersV357Test-1821859764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a52260-4e94-4cd4-8015-12253825c9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:43 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-66383fa0-97d8-4905-b1f3-47b538de7fa6 tempest-VolumesTransfersV357Test-1821859764 None] Flow 'volume_create_manager' (e8d52482-7246-437e-9350-3fcedde7731d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:37:43 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-66383fa0-97d8-4905-b1f3-47b538de7fa6 tempest-VolumesTransfersV357Test-1821859764 None] Created volume successfully. Jul 08 01:37:43 devstack sudo[94200]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2bd5f8d2-bbed-42e6-8cc8-98b7f70104c0 tempest-VolumeQuotasAdminTestJSON-244241276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bba5a725-b78d-447f-9f0d-c03b1652e0da" returned: 0 in 1.081s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:43 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2bd5f8d2-bbed-42e6-8cc8-98b7f70104c0 tempest-VolumeQuotasAdminTestJSON-244241276 None] Lock "cinder-quobyte-bba5a725-b78d-447f-9f0d-c03b1652e0da" released by "delete_volume" :: held 2.466s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:43 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-2bd5f8d2-bbed-42e6-8cc8-98b7f70104c0 tempest-VolumeQuotasAdminTestJSON-244241276 None] Created reservations ['748cbe94-d70c-4f65-b10c-38c5f9af7ca6', 'e7ee6656-e504-4a7b-b8c5-adcfb6d7b2cb', 'ca888b41-fae4-4a95-822c-9e7cf9b56f96', 'e7f680ba-1c4c-45e1-8fd5-41fdb2a852be'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:37:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2bd5f8d2-bbed-42e6-8cc8-98b7f70104c0 tempest-VolumeQuotasAdminTestJSON-244241276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2bd5f8d2-bbed-42e6-8cc8-98b7f70104c0 tempest-VolumeQuotasAdminTestJSON-244241276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:43 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2bd5f8d2-bbed-42e6-8cc8-98b7f70104c0 tempest-VolumeQuotasAdminTestJSON-244241276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:37:43 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2bd5f8d2-bbed-42e6-8cc8-98b7f70104c0 tempest-VolumeQuotasAdminTestJSON-244241276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:37:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2bd5f8d2-bbed-42e6-8cc8-98b7f70104c0 tempest-VolumeQuotasAdminTestJSON-244241276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2bd5f8d2-bbed-42e6-8cc8-98b7f70104c0 tempest-VolumeQuotasAdminTestJSON-244241276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:43 devstack sudo[94205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:37:43 devstack sudo[94205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:44 devstack sudo[94205]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2bd5f8d2-bbed-42e6-8cc8-98b7f70104c0 tempest-VolumeQuotasAdminTestJSON-244241276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.095s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:44 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-2bd5f8d2-bbed-42e6-8cc8-98b7f70104c0 tempest-VolumeQuotasAdminTestJSON-244241276 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:37:44 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-2bd5f8d2-bbed-42e6-8cc8-98b7f70104c0 tempest-VolumeQuotasAdminTestJSON-244241276 None] Deleted volume successfully. Jul 08 01:37:44 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2bd5f8d2-bbed-42e6-8cc8-98b7f70104c0 tempest-VolumeQuotasAdminTestJSON-244241276 None] Lock "cinder-bba5a725-b78d-447f-9f0d-c03b1652e0da-delete_volume" released by "delete_volume" :: held 3.911s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:45 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-9cc2b5f1-8024-4d2d-a7c2-5834263bd9f7 tempest-VolumesTransfersV357Test-385441294 None] Transfer volume completed successfully. Jul 08 01:37:46 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-412b8ef2-e3f0-46c5-a3c1-6871f36e18c4 tempest-VolumesTransfersV357Test-1580553833 None] Acquiring lock "cinder-f7cd596b-2795-4c2e-a0e4-aa04300503e5-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:46 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-412b8ef2-e3f0-46c5-a3c1-6871f36e18c4 tempest-VolumesTransfersV357Test-1580553833 None] Lock "cinder-f7cd596b-2795-4c2e-a0e4-aa04300503e5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:46 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-412b8ef2-e3f0-46c5-a3c1-6871f36e18c4 tempest-VolumesTransfersV357Test-1580553833 None] Acquiring lock "cinder-quobyte-f7cd596b-2795-4c2e-a0e4-aa04300503e5" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:46 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-412b8ef2-e3f0-46c5-a3c1-6871f36e18c4 tempest-VolumesTransfersV357Test-1580553833 None] Lock "cinder-quobyte-f7cd596b-2795-4c2e-a0e4-aa04300503e5" acquired by "delete_volume" :: waited 0.025s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:46 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23a7bc9-d6c9-4c69-978f-89a9a59ea82c]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:37:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-412b8ef2-e3f0-46c5-a3c1-6871f36e18c4 tempest-VolumesTransfersV357Test-1580553833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f7cd596b-2795-4c2e-a0e4-aa04300503e5 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:47 devstack sudo[94209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f7cd596b-2795-4c2e-a0e4-aa04300503e5 Jul 08 01:37:47 devstack sudo[94209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:48 devstack sudo[94209]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-412b8ef2-e3f0-46c5-a3c1-6871f36e18c4 tempest-VolumesTransfersV357Test-1580553833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f7cd596b-2795-4c2e-a0e4-aa04300503e5" returned: 0 in 1.037s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-412b8ef2-e3f0-46c5-a3c1-6871f36e18c4 tempest-VolumesTransfersV357Test-1580553833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f7cd596b-2795-4c2e-a0e4-aa04300503e5 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:48 devstack sudo[94214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f7cd596b-2795-4c2e-a0e4-aa04300503e5 Jul 08 01:37:48 devstack sudo[94214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:48 devstack sudo[94214]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-412b8ef2-e3f0-46c5-a3c1-6871f36e18c4 tempest-VolumesTransfersV357Test-1580553833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f7cd596b-2795-4c2e-a0e4-aa04300503e5" returned: 0 in 0.934s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:48 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-412b8ef2-e3f0-46c5-a3c1-6871f36e18c4 tempest-VolumesTransfersV357Test-1580553833 None] Lock "cinder-quobyte-f7cd596b-2795-4c2e-a0e4-aa04300503e5" released by "delete_volume" :: held 2.044s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:49 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-412b8ef2-e3f0-46c5-a3c1-6871f36e18c4 tempest-VolumesTransfersV357Test-1580553833 None] Created reservations ['b51080de-aab5-4cd2-a37e-93e342359128', 'd2b41ed8-35d6-4c30-847b-f4d4d45ea363', '7c10cb15-36f3-4cb4-b82f-bfb1ac2c75f4', '1a1f8139-9ae5-4b3a-8d4d-d9b0c67378d1'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:37:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-412b8ef2-e3f0-46c5-a3c1-6871f36e18c4 tempest-VolumesTransfersV357Test-1580553833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-412b8ef2-e3f0-46c5-a3c1-6871f36e18c4 tempest-VolumesTransfersV357Test-1580553833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:49 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-412b8ef2-e3f0-46c5-a3c1-6871f36e18c4 tempest-VolumesTransfersV357Test-1580553833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:37:49 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-412b8ef2-e3f0-46c5-a3c1-6871f36e18c4 tempest-VolumesTransfersV357Test-1580553833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:37:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-412b8ef2-e3f0-46c5-a3c1-6871f36e18c4 tempest-VolumesTransfersV357Test-1580553833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-412b8ef2-e3f0-46c5-a3c1-6871f36e18c4 tempest-VolumesTransfersV357Test-1580553833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:49 devstack sudo[94217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:37:49 devstack sudo[94217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:50 devstack sudo[94217]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-412b8ef2-e3f0-46c5-a3c1-6871f36e18c4 tempest-VolumesTransfersV357Test-1580553833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.861s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:50 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-412b8ef2-e3f0-46c5-a3c1-6871f36e18c4 tempest-VolumesTransfersV357Test-1580553833 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:37:50 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-412b8ef2-e3f0-46c5-a3c1-6871f36e18c4 tempest-VolumesTransfersV357Test-1580553833 None] Deleted volume successfully. Jul 08 01:37:50 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-412b8ef2-e3f0-46c5-a3c1-6871f36e18c4 tempest-VolumesTransfersV357Test-1580553833 None] Lock "cinder-f7cd596b-2795-4c2e-a0e4-aa04300503e5-delete_volume" released by "delete_volume" :: held 3.267s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:50 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-25056a51-345d-44aa-95c1-d0938e9c30c1 tempest-VolumesTransfersV357Test-1821859764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:37:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-25056a51-345d-44aa-95c1-d0938e9c30c1 tempest-VolumesTransfersV357Test-1821859764 None] Flow 'volume_create_manager' (20d93c69-a64c-4a57-ae52-c20f823a3af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:37:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-25056a51-345d-44aa-95c1-d0938e9c30c1 tempest-VolumesTransfersV357Test-1821859764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57ffa122-b383-496c-acdf-25300886b16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:51 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-25056a51-345d-44aa-95c1-d0938e9c30c1 tempest-VolumesTransfersV357Test-1821859764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57ffa122-b383-496c-acdf-25300886b16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1792689951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5318a7e-fa12-4bdc-bdac-764cbc8a9b06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01964fdeda9c426fbde3efc46fa994ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:37:51Z,use_quota=True,user_id='2bfc8d56de0d45eebc867b3a1eaade4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:51 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-25056a51-345d-44aa-95c1-d0938e9c30c1 tempest-VolumesTransfersV357Test-1821859764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b9c5ddf-8195-451c-b04f-5ad792e54167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:51 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-25056a51-345d-44aa-95c1-d0938e9c30c1 tempest-VolumesTransfersV357Test-1821859764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b9c5ddf-8195-451c-b04f-5ad792e54167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:51 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-25056a51-345d-44aa-95c1-d0938e9c30c1 tempest-VolumesTransfersV357Test-1821859764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d76c5868-eb00-4eb5-a771-abe7f7d5453e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:51 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-25056a51-345d-44aa-95c1-d0938e9c30c1 tempest-VolumesTransfersV357Test-1821859764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d76c5868-eb00-4eb5-a771-abe7f7d5453e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5318a7e-fa12-4bdc-bdac-764cbc8a9b06', 'volume_name': 'volume-f5318a7e-fa12-4bdc-bdac-764cbc8a9b06', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:51 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-25056a51-345d-44aa-95c1-d0938e9c30c1 tempest-VolumesTransfersV357Test-1821859764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f70ee85-66bd-4a2e-a7a7-3076f8cc371d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:51 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-25056a51-345d-44aa-95c1-d0938e9c30c1 tempest-VolumesTransfersV357Test-1821859764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f70ee85-66bd-4a2e-a7a7-3076f8cc371d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:51 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-25056a51-345d-44aa-95c1-d0938e9c30c1 tempest-VolumesTransfersV357Test-1821859764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e87e686-e08c-4074-bb97-37824baa2b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:51 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-25056a51-345d-44aa-95c1-d0938e9c30c1 tempest-VolumesTransfersV357Test-1821859764 None] Volume f5318a7e-fa12-4bdc-bdac-764cbc8a9b06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5318a7e-fa12-4bdc-bdac-764cbc8a9b06', 'volume_size': 1} Jul 08 01:37:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-25056a51-345d-44aa-95c1-d0938e9c30c1 tempest-VolumesTransfersV357Test-1821859764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-25056a51-345d-44aa-95c1-d0938e9c30c1 tempest-VolumesTransfersV357Test-1821859764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:51 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-25056a51-345d-44aa-95c1-d0938e9c30c1 tempest-VolumesTransfersV357Test-1821859764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1792689951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5318a7e-fa12-4bdc-bdac-764cbc8a9b06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01964fdeda9c426fbde3efc46fa994ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:37:51Z,use_quota=True,user_id='2bfc8d56de0d45eebc867b3a1eaade4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:37:51 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-25056a51-345d-44aa-95c1-d0938e9c30c1 tempest-VolumesTransfersV357Test-1821859764 None] Creating volume f5318a7e-fa12-4bdc-bdac-764cbc8a9b06 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:37:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-25056a51-345d-44aa-95c1-d0938e9c30c1 tempest-VolumesTransfersV357Test-1821859764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-25056a51-345d-44aa-95c1-d0938e9c30c1 tempest-VolumesTransfersV357Test-1821859764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:51 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-25056a51-345d-44aa-95c1-d0938e9c30c1 tempest-VolumesTransfersV357Test-1821859764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:37:51 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-25056a51-345d-44aa-95c1-d0938e9c30c1 tempest-VolumesTransfersV357Test-1821859764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:37:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-25056a51-345d-44aa-95c1-d0938e9c30c1 tempest-VolumesTransfersV357Test-1821859764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:51 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-25056a51-345d-44aa-95c1-d0938e9c30c1 tempest-VolumesTransfersV357Test-1821859764 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:37:51 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-25056a51-345d-44aa-95c1-d0938e9c30c1 tempest-VolumesTransfersV357Test-1821859764 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:37:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-25056a51-345d-44aa-95c1-d0938e9c30c1 tempest-VolumesTransfersV357Test-1821859764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f5318a7e-fa12-4bdc-bdac-764cbc8a9b06 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:51 devstack sudo[94220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f5318a7e-fa12-4bdc-bdac-764cbc8a9b06 1073741824 Jul 08 01:37:51 devstack sudo[94220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:52 devstack sudo[94220]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-25056a51-345d-44aa-95c1-d0938e9c30c1 tempest-VolumesTransfersV357Test-1821859764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f5318a7e-fa12-4bdc-bdac-764cbc8a9b06 1073741824" returned: 0 in 1.172s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-25056a51-345d-44aa-95c1-d0938e9c30c1 tempest-VolumesTransfersV357Test-1821859764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f5318a7e-fa12-4bdc-bdac-764cbc8a9b06 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:52 devstack sudo[94226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f5318a7e-fa12-4bdc-bdac-764cbc8a9b06 Jul 08 01:37:52 devstack sudo[94226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:53 devstack sudo[94226]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-25056a51-345d-44aa-95c1-d0938e9c30c1 tempest-VolumesTransfersV357Test-1821859764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f5318a7e-fa12-4bdc-bdac-764cbc8a9b06" returned: 0 in 0.998s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:53 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-25056a51-345d-44aa-95c1-d0938e9c30c1 tempest-VolumesTransfersV357Test-1821859764 None] <== create_volume: return (2230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:37:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-25056a51-345d-44aa-95c1-d0938e9c30c1 tempest-VolumesTransfersV357Test-1821859764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.237s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:53 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-25056a51-345d-44aa-95c1-d0938e9c30c1 tempest-VolumesTransfersV357Test-1821859764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e87e686-e08c-4074-bb97-37824baa2b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5318a7e-fa12-4bdc-bdac-764cbc8a9b06', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:53 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-25056a51-345d-44aa-95c1-d0938e9c30c1 tempest-VolumesTransfersV357Test-1821859764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d254fc5c-10e7-41a7-bc53-c044b39b7e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:37:53 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-25056a51-345d-44aa-95c1-d0938e9c30c1 tempest-VolumesTransfersV357Test-1821859764 None] Volume volume-f5318a7e-fa12-4bdc-bdac-764cbc8a9b06 (f5318a7e-fa12-4bdc-bdac-764cbc8a9b06): created successfully Jul 08 01:37:53 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-25056a51-345d-44aa-95c1-d0938e9c30c1 tempest-VolumesTransfersV357Test-1821859764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d254fc5c-10e7-41a7-bc53-c044b39b7e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:37:53 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-25056a51-345d-44aa-95c1-d0938e9c30c1 tempest-VolumesTransfersV357Test-1821859764 None] Flow 'volume_create_manager' (20d93c69-a64c-4a57-ae52-c20f823a3af7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:37:53 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-25056a51-345d-44aa-95c1-d0938e9c30c1 tempest-VolumesTransfersV357Test-1821859764 None] Created volume successfully. Jul 08 01:37:54 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-dd160072-35cb-42d2-83b1-6b76558f263c tempest-VolumesTransfersV357Test-1580553833 None] Acquiring lock "cinder-f5318a7e-fa12-4bdc-bdac-764cbc8a9b06-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:54 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-dd160072-35cb-42d2-83b1-6b76558f263c tempest-VolumesTransfersV357Test-1580553833 None] Lock "cinder-f5318a7e-fa12-4bdc-bdac-764cbc8a9b06-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:54 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-dd160072-35cb-42d2-83b1-6b76558f263c tempest-VolumesTransfersV357Test-1580553833 None] Acquiring lock "cinder-quobyte-f5318a7e-fa12-4bdc-bdac-764cbc8a9b06" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:37:54 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-dd160072-35cb-42d2-83b1-6b76558f263c tempest-VolumesTransfersV357Test-1580553833 None] Lock "cinder-quobyte-f5318a7e-fa12-4bdc-bdac-764cbc8a9b06" acquired by "delete_volume" :: waited 0.025s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:37:54 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b93423-e8f4-4b75-b316-bc4321449148]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:37:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-dd160072-35cb-42d2-83b1-6b76558f263c tempest-VolumesTransfersV357Test-1580553833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f5318a7e-fa12-4bdc-bdac-764cbc8a9b06 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:55 devstack sudo[94231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f5318a7e-fa12-4bdc-bdac-764cbc8a9b06 Jul 08 01:37:55 devstack sudo[94231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:55 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:37:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:37:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:37:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:55 devstack sudo[94233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:37:55 devstack sudo[94233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:56 devstack sudo[94231]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-dd160072-35cb-42d2-83b1-6b76558f263c tempest-VolumesTransfersV357Test-1580553833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f5318a7e-fa12-4bdc-bdac-764cbc8a9b06" returned: 0 in 1.103s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-dd160072-35cb-42d2-83b1-6b76558f263c tempest-VolumesTransfersV357Test-1580553833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f5318a7e-fa12-4bdc-bdac-764cbc8a9b06 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:56 devstack sudo[94240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f5318a7e-fa12-4bdc-bdac-764cbc8a9b06 Jul 08 01:37:56 devstack sudo[94240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:56 devstack sudo[94233]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.965s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:56 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:37:56 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager._thread_info {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:37:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread count: 9 {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:37:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread info: [<_MainThread(MainThread, started 127058402500736)>, , , , , , , , ] {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:37:57 devstack sudo[94240]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-dd160072-35cb-42d2-83b1-6b76558f263c tempest-VolumesTransfersV357Test-1580553833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f5318a7e-fa12-4bdc-bdac-764cbc8a9b06" returned: 0 in 0.974s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:57 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-dd160072-35cb-42d2-83b1-6b76558f263c tempest-VolumesTransfersV357Test-1580553833 None] Lock "cinder-quobyte-f5318a7e-fa12-4bdc-bdac-764cbc8a9b06" released by "delete_volume" :: held 2.168s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:37:57 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-dd160072-35cb-42d2-83b1-6b76558f263c tempest-VolumesTransfersV357Test-1580553833 None] Created reservations ['89ac5332-5a7b-4fcd-afe1-a1f8df2b7336', '7d55b0eb-772a-4be7-acc7-ebb80f9660a9', 'aa0a47d7-8506-4ad8-a25d-b97148e486db', 'ecea2ceb-1445-44ed-bfbf-d695c5807406'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:37:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-dd160072-35cb-42d2-83b1-6b76558f263c tempest-VolumesTransfersV357Test-1580553833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:37:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-dd160072-35cb-42d2-83b1-6b76558f263c tempest-VolumesTransfersV357Test-1580553833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:37:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-dd160072-35cb-42d2-83b1-6b76558f263c tempest-VolumesTransfersV357Test-1580553833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:37:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-dd160072-35cb-42d2-83b1-6b76558f263c tempest-VolumesTransfersV357Test-1580553833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:37:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-dd160072-35cb-42d2-83b1-6b76558f263c tempest-VolumesTransfersV357Test-1580553833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:37:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-dd160072-35cb-42d2-83b1-6b76558f263c tempest-VolumesTransfersV357Test-1580553833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:57 devstack sudo[94243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:37:57 devstack sudo[94243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:58 devstack sudo[94243]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-dd160072-35cb-42d2-83b1-6b76558f263c tempest-VolumesTransfersV357Test-1580553833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.956s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:58 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-dd160072-35cb-42d2-83b1-6b76558f263c tempest-VolumesTransfersV357Test-1580553833 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:37:58 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-dd160072-35cb-42d2-83b1-6b76558f263c tempest-VolumesTransfersV357Test-1580553833 None] Deleted volume successfully. Jul 08 01:37:58 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-dd160072-35cb-42d2-83b1-6b76558f263c tempest-VolumesTransfersV357Test-1580553833 None] Lock "cinder-f5318a7e-fa12-4bdc-bdac-764cbc8a9b06-delete_volume" released by "delete_volume" :: held 3.473s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:07 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=21,cinder:UPDATE=48,cinder:INSERT=10,cinder:DELETE=4 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:38:08 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=86,cinder:INSERT=28,cinder:UPDATE=116,cinder:DELETE=8 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:38:13 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-074742d8-a73f-42a5-b403-b7bfbf1bfd1d tempest-SnapshotMetadataTestJSON-828920269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:38:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-074742d8-a73f-42a5-b403-b7bfbf1bfd1d tempest-SnapshotMetadataTestJSON-828920269 None] Flow 'volume_create_manager' (d95b383f-ba5a-4b5e-bd39-a9b95d1c5cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:38:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-074742d8-a73f-42a5-b403-b7bfbf1bfd1d tempest-SnapshotMetadataTestJSON-828920269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab2b8cb7-d878-43ec-b143-33ffed0279ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-074742d8-a73f-42a5-b403-b7bfbf1bfd1d tempest-SnapshotMetadataTestJSON-828920269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab2b8cb7-d878-43ec-b143-33ffed0279ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1872079160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9917769-9b26-4b4e-b7aa-4443eb9e78fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd66c49253f7400e81f87b1864124b4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:38:13Z,use_quota=True,user_id='bc436a154ee743968213a6477dd04526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-074742d8-a73f-42a5-b403-b7bfbf1bfd1d tempest-SnapshotMetadataTestJSON-828920269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f79fbebb-1fa3-4b21-846e-dc920866d8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-074742d8-a73f-42a5-b403-b7bfbf1bfd1d tempest-SnapshotMetadataTestJSON-828920269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f79fbebb-1fa3-4b21-846e-dc920866d8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-074742d8-a73f-42a5-b403-b7bfbf1bfd1d tempest-SnapshotMetadataTestJSON-828920269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55de9d93-100d-4b13-b673-7f773a8a80c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-074742d8-a73f-42a5-b403-b7bfbf1bfd1d tempest-SnapshotMetadataTestJSON-828920269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55de9d93-100d-4b13-b673-7f773a8a80c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9917769-9b26-4b4e-b7aa-4443eb9e78fb', 'volume_name': 'volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-074742d8-a73f-42a5-b403-b7bfbf1bfd1d tempest-SnapshotMetadataTestJSON-828920269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b52f44-c286-45cb-8fba-baa27f1c6d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-074742d8-a73f-42a5-b403-b7bfbf1bfd1d tempest-SnapshotMetadataTestJSON-828920269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b52f44-c286-45cb-8fba-baa27f1c6d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-074742d8-a73f-42a5-b403-b7bfbf1bfd1d tempest-SnapshotMetadataTestJSON-828920269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (511fb3eb-f088-47f8-b370-8c371eaede46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:13 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-074742d8-a73f-42a5-b403-b7bfbf1bfd1d tempest-SnapshotMetadataTestJSON-828920269 None] Volume a9917769-9b26-4b4e-b7aa-4443eb9e78fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb', 'volume_size': 1} Jul 08 01:38:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-074742d8-a73f-42a5-b403-b7bfbf1bfd1d tempest-SnapshotMetadataTestJSON-828920269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-074742d8-a73f-42a5-b403-b7bfbf1bfd1d tempest-SnapshotMetadataTestJSON-828920269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:13 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-074742d8-a73f-42a5-b403-b7bfbf1bfd1d tempest-SnapshotMetadataTestJSON-828920269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1872079160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9917769-9b26-4b4e-b7aa-4443eb9e78fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd66c49253f7400e81f87b1864124b4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:38:13Z,use_quota=True,user_id='bc436a154ee743968213a6477dd04526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:38:13 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-074742d8-a73f-42a5-b403-b7bfbf1bfd1d tempest-SnapshotMetadataTestJSON-828920269 None] Creating volume a9917769-9b26-4b4e-b7aa-4443eb9e78fb {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:38:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-074742d8-a73f-42a5-b403-b7bfbf1bfd1d tempest-SnapshotMetadataTestJSON-828920269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-074742d8-a73f-42a5-b403-b7bfbf1bfd1d tempest-SnapshotMetadataTestJSON-828920269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:13 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-074742d8-a73f-42a5-b403-b7bfbf1bfd1d tempest-SnapshotMetadataTestJSON-828920269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:38:13 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-074742d8-a73f-42a5-b403-b7bfbf1bfd1d tempest-SnapshotMetadataTestJSON-828920269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:38:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-074742d8-a73f-42a5-b403-b7bfbf1bfd1d tempest-SnapshotMetadataTestJSON-828920269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:13 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-074742d8-a73f-42a5-b403-b7bfbf1bfd1d tempest-SnapshotMetadataTestJSON-828920269 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:38:13 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-074742d8-a73f-42a5-b403-b7bfbf1bfd1d tempest-SnapshotMetadataTestJSON-828920269 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:38:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-074742d8-a73f-42a5-b403-b7bfbf1bfd1d tempest-SnapshotMetadataTestJSON-828920269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:13 devstack sudo[94250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb 1073741824 Jul 08 01:38:13 devstack sudo[94250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:13 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7e21ad9-4a64-4e55-b74f-717ae5d08948 tempest-VolumesCloneNegativeTest-1125115035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:38:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a7e21ad9-4a64-4e55-b74f-717ae5d08948 tempest-VolumesCloneNegativeTest-1125115035 None] Flow 'volume_create_manager' (f1fccd2b-6012-4a9f-913c-699e86b66b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:38:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a7e21ad9-4a64-4e55-b74f-717ae5d08948 tempest-VolumesCloneNegativeTest-1125115035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4669163-0843-4519-9fe6-44a5d9836d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a7e21ad9-4a64-4e55-b74f-717ae5d08948 tempest-VolumesCloneNegativeTest-1125115035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4669163-0843-4519-9fe6-44a5d9836d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-476825147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19445a1e-272f-487b-a061-dacb039e4269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd425cd0d68c4cc18871e019e4def1f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:38:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:38:14Z,use_quota=True,user_id='2edfbe2d0c8e478eb857267a840c2d20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a7e21ad9-4a64-4e55-b74f-717ae5d08948 tempest-VolumesCloneNegativeTest-1125115035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82ba7091-faf6-4ecd-922c-c294e563c1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a7e21ad9-4a64-4e55-b74f-717ae5d08948 tempest-VolumesCloneNegativeTest-1125115035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82ba7091-faf6-4ecd-922c-c294e563c1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a7e21ad9-4a64-4e55-b74f-717ae5d08948 tempest-VolumesCloneNegativeTest-1125115035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3d2041f-d01b-4ec2-bbea-3dd9244e60b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a7e21ad9-4a64-4e55-b74f-717ae5d08948 tempest-VolumesCloneNegativeTest-1125115035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3d2041f-d01b-4ec2-bbea-3dd9244e60b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19445a1e-272f-487b-a061-dacb039e4269', 'volume_name': 'volume-19445a1e-272f-487b-a061-dacb039e4269', 'volume_size': 2}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a7e21ad9-4a64-4e55-b74f-717ae5d08948 tempest-VolumesCloneNegativeTest-1125115035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06667784-c2a9-4f24-9a21-d8388a74a2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a7e21ad9-4a64-4e55-b74f-717ae5d08948 tempest-VolumesCloneNegativeTest-1125115035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06667784-c2a9-4f24-9a21-d8388a74a2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a7e21ad9-4a64-4e55-b74f-717ae5d08948 tempest-VolumesCloneNegativeTest-1125115035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe9f6de-5834-4c0e-85cf-a480d85f195c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:13 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-a7e21ad9-4a64-4e55-b74f-717ae5d08948 tempest-VolumesCloneNegativeTest-1125115035 None] Volume 19445a1e-272f-487b-a061-dacb039e4269: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19445a1e-272f-487b-a061-dacb039e4269', 'volume_size': 2} Jul 08 01:38:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a7e21ad9-4a64-4e55-b74f-717ae5d08948 tempest-VolumesCloneNegativeTest-1125115035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:14 devstack sudo[94250]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-074742d8-a73f-42a5-b403-b7bfbf1bfd1d tempest-SnapshotMetadataTestJSON-828920269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb 1073741824" returned: 0 in 1.230s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-074742d8-a73f-42a5-b403-b7bfbf1bfd1d tempest-SnapshotMetadataTestJSON-828920269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:14 devstack sudo[94262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb Jul 08 01:38:14 devstack sudo[94262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:15 devstack sudo[94262]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-074742d8-a73f-42a5-b403-b7bfbf1bfd1d tempest-SnapshotMetadataTestJSON-828920269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb" returned: 0 in 0.842s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:15 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-074742d8-a73f-42a5-b403-b7bfbf1bfd1d tempest-SnapshotMetadataTestJSON-828920269 None] <== create_volume: return (2133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:38:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-074742d8-a73f-42a5-b403-b7bfbf1bfd1d tempest-SnapshotMetadataTestJSON-828920269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.138s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a7e21ad9-4a64-4e55-b74f-717ae5d08948 tempest-VolumesCloneNegativeTest-1125115035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.830s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:15 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a7e21ad9-4a64-4e55-b74f-717ae5d08948 tempest-VolumesCloneNegativeTest-1125115035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-476825147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19445a1e-272f-487b-a061-dacb039e4269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd425cd0d68c4cc18871e019e4def1f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:38:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:38:14Z,use_quota=True,user_id='2edfbe2d0c8e478eb857267a840c2d20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:38:15 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-a7e21ad9-4a64-4e55-b74f-717ae5d08948 tempest-VolumesCloneNegativeTest-1125115035 None] Creating volume 19445a1e-272f-487b-a061-dacb039e4269 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:38:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a7e21ad9-4a64-4e55-b74f-717ae5d08948 tempest-VolumesCloneNegativeTest-1125115035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a7e21ad9-4a64-4e55-b74f-717ae5d08948 tempest-VolumesCloneNegativeTest-1125115035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:15 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a7e21ad9-4a64-4e55-b74f-717ae5d08948 tempest-VolumesCloneNegativeTest-1125115035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:38:15 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a7e21ad9-4a64-4e55-b74f-717ae5d08948 tempest-VolumesCloneNegativeTest-1125115035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:38:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a7e21ad9-4a64-4e55-b74f-717ae5d08948 tempest-VolumesCloneNegativeTest-1125115035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:15 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a7e21ad9-4a64-4e55-b74f-717ae5d08948 tempest-VolumesCloneNegativeTest-1125115035 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:38:15 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-a7e21ad9-4a64-4e55-b74f-717ae5d08948 tempest-VolumesCloneNegativeTest-1125115035 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:38:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a7e21ad9-4a64-4e55-b74f-717ae5d08948 tempest-VolumesCloneNegativeTest-1125115035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-19445a1e-272f-487b-a061-dacb039e4269 2147483648 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:15 devstack sudo[94265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-19445a1e-272f-487b-a061-dacb039e4269 2147483648 Jul 08 01:38:15 devstack sudo[94265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-074742d8-a73f-42a5-b403-b7bfbf1bfd1d tempest-SnapshotMetadataTestJSON-828920269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (511fb3eb-f088-47f8-b370-8c371eaede46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-074742d8-a73f-42a5-b403-b7bfbf1bfd1d tempest-SnapshotMetadataTestJSON-828920269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87f6b18f-21ae-4675-b373-dec5f51ebf71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:15 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-074742d8-a73f-42a5-b403-b7bfbf1bfd1d tempest-SnapshotMetadataTestJSON-828920269 None] Volume volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb (a9917769-9b26-4b4e-b7aa-4443eb9e78fb): created successfully Jul 08 01:38:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-074742d8-a73f-42a5-b403-b7bfbf1bfd1d tempest-SnapshotMetadataTestJSON-828920269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87f6b18f-21ae-4675-b373-dec5f51ebf71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-074742d8-a73f-42a5-b403-b7bfbf1bfd1d tempest-SnapshotMetadataTestJSON-828920269 None] Flow 'volume_create_manager' (d95b383f-ba5a-4b5e-bd39-a9b95d1c5cf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:38:15 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-074742d8-a73f-42a5-b403-b7bfbf1bfd1d tempest-SnapshotMetadataTestJSON-828920269 None] Created volume successfully. Jul 08 01:38:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-19fa0399-3c84-45fc-8bcf-bd22dc347a48 tempest-SnapshotMetadataTestJSON-828920269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:16 devstack sudo[94265]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a7e21ad9-4a64-4e55-b74f-717ae5d08948 tempest-VolumesCloneNegativeTest-1125115035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-19445a1e-272f-487b-a061-dacb039e4269 2147483648" returned: 0 in 1.165s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a7e21ad9-4a64-4e55-b74f-717ae5d08948 tempest-VolumesCloneNegativeTest-1125115035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-19445a1e-272f-487b-a061-dacb039e4269 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:16 devstack sudo[94271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-19445a1e-272f-487b-a061-dacb039e4269 Jul 08 01:38:16 devstack sudo[94271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:17 devstack sudo[94271]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a7e21ad9-4a64-4e55-b74f-717ae5d08948 tempest-VolumesCloneNegativeTest-1125115035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-19445a1e-272f-487b-a061-dacb039e4269" returned: 0 in 0.758s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:17 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a7e21ad9-4a64-4e55-b74f-717ae5d08948 tempest-VolumesCloneNegativeTest-1125115035 None] <== create_volume: return (1975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:38:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a7e21ad9-4a64-4e55-b74f-717ae5d08948 tempest-VolumesCloneNegativeTest-1125115035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.981s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-19fa0399-3c84-45fc-8bcf-bd22dc347a48 tempest-SnapshotMetadataTestJSON-828920269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.922s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:17 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-19fa0399-3c84-45fc-8bcf-bd22dc347a48 tempest-SnapshotMetadataTestJSON-828920269 None] Creating offline snapshot 37dbceca-6722-4ae4-9082-e939784a7372 of volume a9917769-9b26-4b4e-b7aa-4443eb9e78fb {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:38:17 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a7e21ad9-4a64-4e55-b74f-717ae5d08948 tempest-VolumesCloneNegativeTest-1125115035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe9f6de-5834-4c0e-85cf-a480d85f195c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19445a1e-272f-487b-a061-dacb039e4269', 'volume_size': 2}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:17 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a7e21ad9-4a64-4e55-b74f-717ae5d08948 tempest-VolumesCloneNegativeTest-1125115035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d8840f0-bc54-480a-842e-4ba59965b598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:17 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[909db434-aca9-4f6c-b349-0d1bf9d32e22]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:38:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-19fa0399-3c84-45fc-8bcf-bd22dc347a48 tempest-SnapshotMetadataTestJSON-828920269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:17 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-a7e21ad9-4a64-4e55-b74f-717ae5d08948 tempest-VolumesCloneNegativeTest-1125115035 None] Volume volume-19445a1e-272f-487b-a061-dacb039e4269 (19445a1e-272f-487b-a061-dacb039e4269): created successfully Jul 08 01:38:17 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a7e21ad9-4a64-4e55-b74f-717ae5d08948 tempest-VolumesCloneNegativeTest-1125115035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d8840f0-bc54-480a-842e-4ba59965b598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:17 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a7e21ad9-4a64-4e55-b74f-717ae5d08948 tempest-VolumesCloneNegativeTest-1125115035 None] Flow 'volume_create_manager' (f1fccd2b-6012-4a9f-913c-699e86b66b86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:38:17 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-a7e21ad9-4a64-4e55-b74f-717ae5d08948 tempest-VolumesCloneNegativeTest-1125115035 None] Created volume successfully. Jul 08 01:38:17 devstack sudo[94277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb Jul 08 01:38:17 devstack sudo[94277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:18 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d33ad773-8af4-46f8-b144-cce473722f00 tempest-VolumesCloneNegativeTest-1125115035 None] Acquiring lock "cinder-19445a1e-272f-487b-a061-dacb039e4269-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:18 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d33ad773-8af4-46f8-b144-cce473722f00 tempest-VolumesCloneNegativeTest-1125115035 None] Lock "cinder-19445a1e-272f-487b-a061-dacb039e4269-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:18 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d33ad773-8af4-46f8-b144-cce473722f00 tempest-VolumesCloneNegativeTest-1125115035 None] Acquiring lock "cinder-quobyte-19445a1e-272f-487b-a061-dacb039e4269" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:18 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d33ad773-8af4-46f8-b144-cce473722f00 tempest-VolumesCloneNegativeTest-1125115035 None] Lock "cinder-quobyte-19445a1e-272f-487b-a061-dacb039e4269" acquired by "delete_volume" :: waited 0.031s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:18 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d472fe-5823-42c2-9727-17ae41f0725d]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:38:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d33ad773-8af4-46f8-b144-cce473722f00 tempest-VolumesCloneNegativeTest-1125115035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-19445a1e-272f-487b-a061-dacb039e4269 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:18 devstack sudo[94279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-19445a1e-272f-487b-a061-dacb039e4269 Jul 08 01:38:18 devstack sudo[94279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:18 devstack sudo[94277]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-19fa0399-3c84-45fc-8bcf-bd22dc347a48 tempest-SnapshotMetadataTestJSON-828920269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb" returned: 0 in 1.207s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-19fa0399-3c84-45fc-8bcf-bd22dc347a48 tempest-SnapshotMetadataTestJSON-828920269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb.37dbceca-6722-4ae4-9082-e939784a7372 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:19 devstack sudo[94286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb.37dbceca-6722-4ae4-9082-e939784a7372 1G Jul 08 01:38:19 devstack sudo[94286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:19 devstack sudo[94279]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d33ad773-8af4-46f8-b144-cce473722f00 tempest-VolumesCloneNegativeTest-1125115035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-19445a1e-272f-487b-a061-dacb039e4269" returned: 0 in 0.960s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d33ad773-8af4-46f8-b144-cce473722f00 tempest-VolumesCloneNegativeTest-1125115035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-19445a1e-272f-487b-a061-dacb039e4269 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:19 devstack sudo[94292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-19445a1e-272f-487b-a061-dacb039e4269 Jul 08 01:38:19 devstack sudo[94292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:20 devstack sudo[94286]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-19fa0399-3c84-45fc-8bcf-bd22dc347a48 tempest-SnapshotMetadataTestJSON-828920269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb.37dbceca-6722-4ae4-9082-e939784a7372 1G" returned: 0 in 1.360s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-19fa0399-3c84-45fc-8bcf-bd22dc347a48 tempest-SnapshotMetadataTestJSON-828920269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb.37dbceca-6722-4ae4-9082-e939784a7372 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:20 devstack sudo[94298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb.37dbceca-6722-4ae4-9082-e939784a7372 Jul 08 01:38:20 devstack sudo[94298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:20 devstack sudo[94292]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d33ad773-8af4-46f8-b144-cce473722f00 tempest-VolumesCloneNegativeTest-1125115035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-19445a1e-272f-487b-a061-dacb039e4269" returned: 0 in 0.969s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:20 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d33ad773-8af4-46f8-b144-cce473722f00 tempest-VolumesCloneNegativeTest-1125115035 None] Lock "cinder-quobyte-19445a1e-272f-487b-a061-dacb039e4269" released by "delete_volume" :: held 2.009s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:20 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-d33ad773-8af4-46f8-b144-cce473722f00 tempest-VolumesCloneNegativeTest-1125115035 None] Created reservations ['beeb247d-c337-43e7-ac1b-a6605e373f41', 'c0d2cc68-2859-42f3-be3a-ebf8dc997552', '49d8d67c-c4e7-44a7-b2dd-c23ca125eac3', 'c9bf6abf-7ae0-4790-8b59-46eb93acfc2e'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:38:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-d33ad773-8af4-46f8-b144-cce473722f00 tempest-VolumesCloneNegativeTest-1125115035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-d33ad773-8af4-46f8-b144-cce473722f00 tempest-VolumesCloneNegativeTest-1125115035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:20 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-d33ad773-8af4-46f8-b144-cce473722f00 tempest-VolumesCloneNegativeTest-1125115035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:38:20 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-d33ad773-8af4-46f8-b144-cce473722f00 tempest-VolumesCloneNegativeTest-1125115035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:38:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-d33ad773-8af4-46f8-b144-cce473722f00 tempest-VolumesCloneNegativeTest-1125115035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d33ad773-8af4-46f8-b144-cce473722f00 tempest-VolumesCloneNegativeTest-1125115035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:20 devstack sudo[94300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:38:20 devstack sudo[94300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:21 devstack sudo[94298]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-19fa0399-3c84-45fc-8bcf-bd22dc347a48 tempest-SnapshotMetadataTestJSON-828920269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb.37dbceca-6722-4ae4-9082-e939784a7372" returned: 0 in 1.164s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:21 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-19fa0399-3c84-45fc-8bcf-bd22dc347a48 tempest-SnapshotMetadataTestJSON-828920269 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb.37dbceca-6722-4ae4-9082-e939784a7372 is being set with open permissions: ugo+rw Jul 08 01:38:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-19fa0399-3c84-45fc-8bcf-bd22dc347a48 tempest-SnapshotMetadataTestJSON-828920269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb.37dbceca-6722-4ae4-9082-e939784a7372 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:21 devstack sudo[94305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb.37dbceca-6722-4ae4-9082-e939784a7372 Jul 08 01:38:21 devstack sudo[94305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:21 devstack sudo[94300]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d33ad773-8af4-46f8-b144-cce473722f00 tempest-VolumesCloneNegativeTest-1125115035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.036s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:21 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-d33ad773-8af4-46f8-b144-cce473722f00 tempest-VolumesCloneNegativeTest-1125115035 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:38:21 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-d33ad773-8af4-46f8-b144-cce473722f00 tempest-VolumesCloneNegativeTest-1125115035 None] Deleted volume successfully. Jul 08 01:38:21 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d33ad773-8af4-46f8-b144-cce473722f00 tempest-VolumesCloneNegativeTest-1125115035 None] Lock "cinder-19445a1e-272f-487b-a061-dacb039e4269-delete_volume" released by "delete_volume" :: held 3.446s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:22 devstack sudo[94305]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-19fa0399-3c84-45fc-8bcf-bd22dc347a48 tempest-SnapshotMetadataTestJSON-828920269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb.37dbceca-6722-4ae4-9082-e939784a7372" returned: 0 in 0.999s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-19fa0399-3c84-45fc-8bcf-bd22dc347a48 tempest-SnapshotMetadataTestJSON-828920269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:22 devstack sudo[94331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb.info Jul 08 01:38:22 devstack sudo[94331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:23 devstack sudo[94331]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-19fa0399-3c84-45fc-8bcf-bd22dc347a48 tempest-SnapshotMetadataTestJSON-828920269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb.info" returned: 0 in 0.982s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:23 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-19fa0399-3c84-45fc-8bcf-bd22dc347a48 tempest-SnapshotMetadataTestJSON-828920269 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb.info is being set with open permissions: ugo+rw Jul 08 01:38:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-19fa0399-3c84-45fc-8bcf-bd22dc347a48 tempest-SnapshotMetadataTestJSON-828920269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:23 devstack sudo[94347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb.info Jul 08 01:38:23 devstack sudo[94347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:24 devstack sudo[94347]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-19fa0399-3c84-45fc-8bcf-bd22dc347a48 tempest-SnapshotMetadataTestJSON-828920269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb.info" returned: 0 in 0.875s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-19fa0399-3c84-45fc-8bcf-bd22dc347a48 tempest-SnapshotMetadataTestJSON-828920269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.783s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:24 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-19fa0399-3c84-45fc-8bcf-bd22dc347a48 tempest-SnapshotMetadataTestJSON-828920269 None] Create snapshot completed successfully Jul 08 01:38:26 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-9a60d8d1-b03a-41f2-93a7-2c03462bbe57 tempest-SnapshotMetadataTestJSON-828920269 None] Acquiring lock "cinder-37dbceca-6722-4ae4-9082-e939784a7372-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:26 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-9a60d8d1-b03a-41f2-93a7-2c03462bbe57 tempest-SnapshotMetadataTestJSON-828920269 None] Lock "cinder-37dbceca-6722-4ae4-9082-e939784a7372-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:26 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-9a60d8d1-b03a-41f2-93a7-2c03462bbe57 tempest-SnapshotMetadataTestJSON-828920269 None] Acquiring lock "cinder-quobyte-a9917769-9b26-4b4e-b7aa-4443eb9e78fb" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:26 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-9a60d8d1-b03a-41f2-93a7-2c03462bbe57 tempest-SnapshotMetadataTestJSON-828920269 None] Lock "cinder-quobyte-a9917769-9b26-4b4e-b7aa-4443eb9e78fb" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:26 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-9a60d8d1-b03a-41f2-93a7-2c03462bbe57 tempest-SnapshotMetadataTestJSON-828920269 None] Acquiring lock "cinder-quobyte-37dbceca-6722-4ae4-9082-e939784a7372" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:26 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-9a60d8d1-b03a-41f2-93a7-2c03462bbe57 tempest-SnapshotMetadataTestJSON-828920269 None] Lock "cinder-quobyte-37dbceca-6722-4ae4-9082-e939784a7372" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:26 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-9a60d8d1-b03a-41f2-93a7-2c03462bbe57 tempest-SnapshotMetadataTestJSON-828920269 None] Deleting offline snapshot 37dbceca-6722-4ae4-9082-e939784a7372 of volume a9917769-9b26-4b4e-b7aa-4443eb9e78fb {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:38:26 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-9a60d8d1-b03a-41f2-93a7-2c03462bbe57 tempest-SnapshotMetadataTestJSON-828920269 None] snapshot_file for this snap is: volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb.37dbceca-6722-4ae4-9082-e939784a7372 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:38:26 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a95ce4d-0b7a-4605-b2bb-f62ec6dbc2c5]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:38:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9a60d8d1-b03a-41f2-93a7-2c03462bbe57 tempest-SnapshotMetadataTestJSON-828920269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb.37dbceca-6722-4ae4-9082-e939784a7372 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:26 devstack sudo[94406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb.37dbceca-6722-4ae4-9082-e939784a7372 Jul 08 01:38:26 devstack sudo[94406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:28 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:38:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Flow 'volume_create_manager' (5c8eb763-a172-47f7-9125-5962ae93d763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:38:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (909a05e4-4e30-4968-b2ea-45e215c2bf05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (909a05e4-4e30-4968-b2ea-45e215c2bf05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-96366616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06ff8373-7874-4dd3-addf-7a086036f482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d73b03f0a5344b6e8bc17c5ab2599e87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:38:28Z,use_quota=True,user_id='efbaf101d3e9495fbd52ccd809d63bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a1a9cad-506d-4c96-a325-ab42a4de7130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a1a9cad-506d-4c96-a325-ab42a4de7130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c5df2e7-ad1a-4d40-a8c9-42f20826ec3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:28 devstack cinder-volume[87284]: DEBUG cinder.image.glance [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Creating Keystone auth plugin from conf {{(pid=87284) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:38:28 devstack sudo[94406]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9a60d8d1-b03a-41f2-93a7-2c03462bbe57 tempest-SnapshotMetadataTestJSON-828920269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb.37dbceca-6722-4ae4-9082-e939784a7372" returned: 0 in 1.479s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:28 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-9a60d8d1-b03a-41f2-93a7-2c03462bbe57 tempest-SnapshotMetadataTestJSON-828920269 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:38:28 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c4ce98-94a9-44e0-913c-a0213ff3f18f]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:38:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9a60d8d1-b03a-41f2-93a7-2c03462bbe57 tempest-SnapshotMetadataTestJSON-828920269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:28 devstack sudo[94475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb Jul 08 01:38:28 devstack sudo[94475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c5df2e7-ad1a-4d40-a8c9-42f20826ec3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '06ff8373-7874-4dd3-addf-7a086036f482', 'volume_name': 'volume-06ff8373-7874-4dd3-addf-7a086036f482', 'volume_size': 1, 'image_id': '24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '083157d49fd649eb95508535e9c547e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'created_at': datetime.datetime(2026, 7, 7, 23, 23, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 23, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24b75d01-af4a-40ff-909b-cfbb4c8e9193/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b444ad-e8a2-4b9e-af4d-25a72d0236a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b444ad-e8a2-4b9e-af4d-25a72d0236a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5988c6d-70f4-40c9-b215-9185223b18be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:28 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Volume 06ff8373-7874-4dd3-addf-7a086036f482: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-06ff8373-7874-4dd3-addf-7a086036f482', 'volume_size': 1, 'image_id': '24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '083157d49fd649eb95508535e9c547e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'created_at': datetime.datetime(2026, 7, 7, 23, 23, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 23, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24b75d01-af4a-40ff-909b-cfbb4c8e9193/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 01:38:28 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Trying to clone 06ff8373-7874-4dd3-addf-7a086036f482 from image 24b75d01-af4a-40ff-909b-cfbb4c8e9193 at location (None, [{'url': 'file:///opt/stack/data/glance/images/24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'metadata': {}}]). {{(pid=87284) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:38:29 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_mixf1h00devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87284) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:38:29 devstack cinder-volume[87284]: INFO cinder.image.image_utils [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Image download 20.69 MB at 20.69 MB/s Jul 08 01:38:29 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d93cf9-a3e6-43cd-b44e-6fd769a17dff]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:38:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_mixf1h00devstack@QuobyteHD {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:29 devstack sudo[94475]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9a60d8d1-b03a-41f2-93a7-2c03462bbe57 tempest-SnapshotMetadataTestJSON-828920269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb" returned: 0 in 1.293s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9a60d8d1-b03a-41f2-93a7-2c03462bbe57 tempest-SnapshotMetadataTestJSON-828920269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb.37dbceca-6722-4ae4-9082-e939784a7372 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:29 devstack sudo[94514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb.37dbceca-6722-4ae4-9082-e939784a7372 Jul 08 01:38:29 devstack sudo[94514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:29 devstack sudo[94511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_mixf1h00devstack@QuobyteHD Jul 08 01:38:29 devstack sudo[94511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:31 devstack sudo[94511]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_mixf1h00devstack@QuobyteHD" returned: 0 in 1.826s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:31 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Temporary image 24b75d01-af4a-40ff-909b-cfbb4c8e9193 is fetched for user efbaf101d3e9495fbd52ccd809d63bb6. {{(pid=87284) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:38:31 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[184e2c81-eec2-4853-a190-418d9cb193d8]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:38:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_mixf1h00devstack@QuobyteHD {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:31 devstack sudo[94514]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9a60d8d1-b03a-41f2-93a7-2c03462bbe57 tempest-SnapshotMetadataTestJSON-828920269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb.37dbceca-6722-4ae4-9082-e939784a7372" returned: 0 in 2.233s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9a60d8d1-b03a-41f2-93a7-2c03462bbe57 tempest-SnapshotMetadataTestJSON-828920269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb.37dbceca-6722-4ae4-9082-e939784a7372 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:31 devstack sudo[94555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_mixf1h00devstack@QuobyteHD Jul 08 01:38:31 devstack sudo[94555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:31 devstack sudo[94568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb.37dbceca-6722-4ae4-9082-e939784a7372 Jul 08 01:38:31 devstack sudo[94568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:32 devstack sudo[94568]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9a60d8d1-b03a-41f2-93a7-2c03462bbe57 tempest-SnapshotMetadataTestJSON-828920269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb.37dbceca-6722-4ae4-9082-e939784a7372" returned: 0 in 1.122s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:32 devstack sudo[94555]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_mixf1h00devstack@QuobyteHD" returned: 0 in 1.320s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:32 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-96366616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06ff8373-7874-4dd3-addf-7a086036f482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d73b03f0a5344b6e8bc17c5ab2599e87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:38:28Z,use_quota=True,user_id='efbaf101d3e9495fbd52ccd809d63bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:38:32 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Creating volume 06ff8373-7874-4dd3-addf-7a086036f482 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:38:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:32 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:38:32 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:38:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:32 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:38:32 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:38:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-06ff8373-7874-4dd3-addf-7a086036f482 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:32 devstack sudo[94591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-06ff8373-7874-4dd3-addf-7a086036f482 1073741824 Jul 08 01:38:32 devstack sudo[94591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:32 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-9a60d8d1-b03a-41f2-93a7-2c03462bbe57 tempest-SnapshotMetadataTestJSON-828920269 None] Lock "cinder-quobyte-37dbceca-6722-4ae4-9082-e939784a7372" released by "_delete_snapshot" :: held 6.363s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:32 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-9a60d8d1-b03a-41f2-93a7-2c03462bbe57 tempest-SnapshotMetadataTestJSON-828920269 None] Lock "cinder-quobyte-a9917769-9b26-4b4e-b7aa-4443eb9e78fb" released by "delete_snapshot" :: held 6.413s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:33 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-9a60d8d1-b03a-41f2-93a7-2c03462bbe57 tempest-SnapshotMetadataTestJSON-828920269 None] Created reservations ['89549fbd-d105-4732-a677-4ca423fa2db8', 'eec30291-7f14-4db8-828b-e8d0520a4a1e', 'f180741c-d532-48e3-9b08-eb8b0f38ec84', '1240f004-612f-498a-9c11-e6436da6bc76'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:38:33 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-9a60d8d1-b03a-41f2-93a7-2c03462bbe57 tempest-SnapshotMetadataTestJSON-828920269 None] Delete snapshot completed successfully. Jul 08 01:38:33 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-9a60d8d1-b03a-41f2-93a7-2c03462bbe57 tempest-SnapshotMetadataTestJSON-828920269 None] Lock "cinder-37dbceca-6722-4ae4-9082-e939784a7372-delete_snapshot" released by "delete_snapshot" :: held 6.753s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:33 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-62069b91-d481-4cde-b495-f690e610a163 tempest-SnapshotMetadataTestJSON-828920269 None] Acquiring lock "cinder-a9917769-9b26-4b4e-b7aa-4443eb9e78fb-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:33 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-62069b91-d481-4cde-b495-f690e610a163 tempest-SnapshotMetadataTestJSON-828920269 None] Lock "cinder-a9917769-9b26-4b4e-b7aa-4443eb9e78fb-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:33 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-62069b91-d481-4cde-b495-f690e610a163 tempest-SnapshotMetadataTestJSON-828920269 None] Acquiring lock "cinder-quobyte-a9917769-9b26-4b4e-b7aa-4443eb9e78fb" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:33 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-62069b91-d481-4cde-b495-f690e610a163 tempest-SnapshotMetadataTestJSON-828920269 None] Lock "cinder-quobyte-a9917769-9b26-4b4e-b7aa-4443eb9e78fb" acquired by "delete_volume" :: waited 0.048s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:33 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7932c3-2a87-4b5c-9836-f20bed3beec4]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:38:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-62069b91-d481-4cde-b495-f690e610a163 tempest-SnapshotMetadataTestJSON-828920269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:34 devstack sudo[94595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb Jul 08 01:38:34 devstack sudo[94595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:34 devstack sudo[94591]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-06ff8373-7874-4dd3-addf-7a086036f482 1073741824" returned: 0 in 2.051s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-06ff8373-7874-4dd3-addf-7a086036f482 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:35 devstack sudo[94601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-06ff8373-7874-4dd3-addf-7a086036f482 Jul 08 01:38:35 devstack sudo[94601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:35 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-45129832-4198-4863-94fb-1b83e69202db tempest-TestMinimumBasicScenario-176295214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:38:35 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-45129832-4198-4863-94fb-1b83e69202db tempest-TestMinimumBasicScenario-176295214 None] Flow 'volume_create_manager' (1f41b96d-2a6d-4446-aa7a-742a948195c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:38:35 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-45129832-4198-4863-94fb-1b83e69202db tempest-TestMinimumBasicScenario-176295214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c84868eb-da84-4ad2-95db-ca9b9f47b2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:35 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-45129832-4198-4863-94fb-1b83e69202db tempest-TestMinimumBasicScenario-176295214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c84868eb-da84-4ad2-95db-ca9b9f47b2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-394999343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d33871f4-8d20-4910-b977-cb6b63faa17b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='511992021d344cbf8f0bd56352dad6ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:38:36Z,use_quota=True,user_id='df98b97a72264df7868b6771a2194117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:35 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-45129832-4198-4863-94fb-1b83e69202db tempest-TestMinimumBasicScenario-176295214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd966f2e-a9d8-449b-a092-ac872da65379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:35 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-45129832-4198-4863-94fb-1b83e69202db tempest-TestMinimumBasicScenario-176295214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd966f2e-a9d8-449b-a092-ac872da65379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:35 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-45129832-4198-4863-94fb-1b83e69202db tempest-TestMinimumBasicScenario-176295214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb8e74dc-1b75-4d47-8534-56dee2cc0966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:35 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-45129832-4198-4863-94fb-1b83e69202db tempest-TestMinimumBasicScenario-176295214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb8e74dc-1b75-4d47-8534-56dee2cc0966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd33871f4-8d20-4910-b977-cb6b63faa17b', 'volume_name': 'volume-d33871f4-8d20-4910-b977-cb6b63faa17b', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:35 devstack sudo[94595]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:35 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-45129832-4198-4863-94fb-1b83e69202db tempest-TestMinimumBasicScenario-176295214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cf02258-16da-4aa2-bfdc-f0a6dc0e2179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:35 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-45129832-4198-4863-94fb-1b83e69202db tempest-TestMinimumBasicScenario-176295214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cf02258-16da-4aa2-bfdc-f0a6dc0e2179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:35 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-45129832-4198-4863-94fb-1b83e69202db tempest-TestMinimumBasicScenario-176295214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (183cc81e-a9c3-43ba-95aa-5228509eecf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:35 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-45129832-4198-4863-94fb-1b83e69202db tempest-TestMinimumBasicScenario-176295214 None] Volume d33871f4-8d20-4910-b977-cb6b63faa17b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d33871f4-8d20-4910-b977-cb6b63faa17b', 'volume_size': 1} Jul 08 01:38:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-45129832-4198-4863-94fb-1b83e69202db tempest-TestMinimumBasicScenario-176295214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-62069b91-d481-4cde-b495-f690e610a163 tempest-SnapshotMetadataTestJSON-828920269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb" returned: 0 in 1.982s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-62069b91-d481-4cde-b495-f690e610a163 tempest-SnapshotMetadataTestJSON-828920269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:36 devstack sudo[94606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb Jul 08 01:38:36 devstack sudo[94606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:36 devstack sudo[94601]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-06ff8373-7874-4dd3-addf-7a086036f482" returned: 0 in 1.707s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] <== create_volume: return (3896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:38:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.900s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-45129832-4198-4863-94fb-1b83e69202db tempest-TestMinimumBasicScenario-176295214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.838s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-45129832-4198-4863-94fb-1b83e69202db tempest-TestMinimumBasicScenario-176295214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-394999343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d33871f4-8d20-4910-b977-cb6b63faa17b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='511992021d344cbf8f0bd56352dad6ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:38:36Z,use_quota=True,user_id='df98b97a72264df7868b6771a2194117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:38:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-45129832-4198-4863-94fb-1b83e69202db tempest-TestMinimumBasicScenario-176295214 None] Creating volume d33871f4-8d20-4910-b977-cb6b63faa17b {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:38:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-45129832-4198-4863-94fb-1b83e69202db tempest-TestMinimumBasicScenario-176295214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-45129832-4198-4863-94fb-1b83e69202db tempest-TestMinimumBasicScenario-176295214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-45129832-4198-4863-94fb-1b83e69202db tempest-TestMinimumBasicScenario-176295214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:38:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-45129832-4198-4863-94fb-1b83e69202db tempest-TestMinimumBasicScenario-176295214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:38:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-45129832-4198-4863-94fb-1b83e69202db tempest-TestMinimumBasicScenario-176295214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-45129832-4198-4863-94fb-1b83e69202db tempest-TestMinimumBasicScenario-176295214 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:38:36 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-45129832-4198-4863-94fb-1b83e69202db tempest-TestMinimumBasicScenario-176295214 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:38:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-45129832-4198-4863-94fb-1b83e69202db tempest-TestMinimumBasicScenario-176295214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d33871f4-8d20-4910-b977-cb6b63faa17b 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:36 devstack sudo[94609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d33871f4-8d20-4910-b977-cb6b63faa17b 1073741824 Jul 08 01:38:36 devstack sudo[94609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:36 devstack cinder-volume[87284]: DEBUG cinder.volume.volume_utils [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Attempting download of 24b75d01-af4a-40ff-909b-cfbb4c8e9193 ((None, [{'url': 'file:///opt/stack/data/glance/images/24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'metadata': {}}])) to volume 06ff8373-7874-4dd3-addf-7a086036f482. {{(pid=87284) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:38:37 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6f0b72-8325-43a4-b9f1-e6285d8c82b3]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:38:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24b75d01-af4a-40ff-909b-cfbb4c8e9193_usms57kv {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:37 devstack sudo[94611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24b75d01-af4a-40ff-909b-cfbb4c8e9193_usms57kv Jul 08 01:38:37 devstack sudo[94611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:38 devstack sudo[94606]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-62069b91-d481-4cde-b495-f690e610a163 tempest-SnapshotMetadataTestJSON-828920269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9917769-9b26-4b4e-b7aa-4443eb9e78fb" returned: 0 in 2.060s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:38 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-62069b91-d481-4cde-b495-f690e610a163 tempest-SnapshotMetadataTestJSON-828920269 None] Lock "cinder-quobyte-a9917769-9b26-4b4e-b7aa-4443eb9e78fb" released by "delete_volume" :: held 4.294s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:38 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-62069b91-d481-4cde-b495-f690e610a163 tempest-SnapshotMetadataTestJSON-828920269 None] Created reservations ['9d535b6d-63af-4e06-8b09-564ab289519c', '071041ab-2941-4d09-aa7d-bc7f216578c1', '3e767e21-7eb0-4e27-bac8-0e4dddc828af', '4541c50d-d957-4257-ac04-7ae6e341b705'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:38:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-62069b91-d481-4cde-b495-f690e610a163 tempest-SnapshotMetadataTestJSON-828920269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-62069b91-d481-4cde-b495-f690e610a163 tempest-SnapshotMetadataTestJSON-828920269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:38 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-62069b91-d481-4cde-b495-f690e610a163 tempest-SnapshotMetadataTestJSON-828920269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:38:38 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-62069b91-d481-4cde-b495-f690e610a163 tempest-SnapshotMetadataTestJSON-828920269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:38:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-62069b91-d481-4cde-b495-f690e610a163 tempest-SnapshotMetadataTestJSON-828920269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-62069b91-d481-4cde-b495-f690e610a163 tempest-SnapshotMetadataTestJSON-828920269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:38 devstack sudo[94619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:38:38 devstack sudo[94619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:38 devstack sudo[94611]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24b75d01-af4a-40ff-909b-cfbb4c8e9193_usms57kv" returned: 0 in 1.695s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24b75d01-af4a-40ff-909b-cfbb4c8e9193_usms57kv {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:39 devstack sudo[94622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24b75d01-af4a-40ff-909b-cfbb4c8e9193_usms57kv Jul 08 01:38:39 devstack sudo[94622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:39 devstack sudo[94609]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-45129832-4198-4863-94fb-1b83e69202db tempest-TestMinimumBasicScenario-176295214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d33871f4-8d20-4910-b977-cb6b63faa17b 1073741824" returned: 0 in 2.457s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-45129832-4198-4863-94fb-1b83e69202db tempest-TestMinimumBasicScenario-176295214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d33871f4-8d20-4910-b977-cb6b63faa17b {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:39 devstack sudo[94624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d33871f4-8d20-4910-b977-cb6b63faa17b Jul 08 01:38:39 devstack sudo[94624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:40 devstack sudo[94619]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-62069b91-d481-4cde-b495-f690e610a163 tempest-SnapshotMetadataTestJSON-828920269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.515s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:40 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-62069b91-d481-4cde-b495-f690e610a163 tempest-SnapshotMetadataTestJSON-828920269 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:38:40 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-62069b91-d481-4cde-b495-f690e610a163 tempest-SnapshotMetadataTestJSON-828920269 None] Deleted volume successfully. Jul 08 01:38:40 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-62069b91-d481-4cde-b495-f690e610a163 tempest-SnapshotMetadataTestJSON-828920269 None] Lock "cinder-a9917769-9b26-4b4e-b7aa-4443eb9e78fb-delete_volume" released by "delete_volume" :: held 6.556s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:40 devstack sudo[94624]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-45129832-4198-4863-94fb-1b83e69202db tempest-TestMinimumBasicScenario-176295214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d33871f4-8d20-4910-b977-cb6b63faa17b" returned: 0 in 1.589s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:40 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-45129832-4198-4863-94fb-1b83e69202db tempest-TestMinimumBasicScenario-176295214 None] <== create_volume: return (4189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:38:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-45129832-4198-4863-94fb-1b83e69202db tempest-TestMinimumBasicScenario-176295214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.196s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:41 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-45129832-4198-4863-94fb-1b83e69202db tempest-TestMinimumBasicScenario-176295214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (183cc81e-a9c3-43ba-95aa-5228509eecf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d33871f4-8d20-4910-b977-cb6b63faa17b', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:41 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-45129832-4198-4863-94fb-1b83e69202db tempest-TestMinimumBasicScenario-176295214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e40ffa-8913-4b5c-8694-528f7a8e2cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:41 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-45129832-4198-4863-94fb-1b83e69202db tempest-TestMinimumBasicScenario-176295214 None] Volume volume-d33871f4-8d20-4910-b977-cb6b63faa17b (d33871f4-8d20-4910-b977-cb6b63faa17b): created successfully Jul 08 01:38:41 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-45129832-4198-4863-94fb-1b83e69202db tempest-TestMinimumBasicScenario-176295214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e40ffa-8913-4b5c-8694-528f7a8e2cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:41 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-45129832-4198-4863-94fb-1b83e69202db tempest-TestMinimumBasicScenario-176295214 None] Flow 'volume_create_manager' (1f41b96d-2a6d-4446-aa7a-742a948195c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:38:41 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-45129832-4198-4863-94fb-1b83e69202db tempest-TestMinimumBasicScenario-176295214 None] Created volume successfully. Jul 08 01:38:41 devstack sudo[94622]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24b75d01-af4a-40ff-909b-cfbb4c8e9193_usms57kv" returned: 1 in 2.509s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24b75d01-af4a-40ff-909b-cfbb4c8e9193_usms57kv' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:38:41 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[097b8b68-cc51-4f05-9996-c51fe0e83c6c]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:38:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_mixf1h00devstack@QuobyteHD {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:41 devstack sudo[94640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_mixf1h00devstack@QuobyteHD Jul 08 01:38:41 devstack sudo[94640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:42 devstack sudo[94640]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_mixf1h00devstack@QuobyteHD" returned: 0 in 1.394s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:42 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] 24b75d01-af4a-40ff-909b-cfbb4c8e9193 was qcow2, converting to raw {{(pid=87284) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:38:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_mixf1h00devstack@QuobyteHD /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-06ff8373-7874-4dd3-addf-7a086036f482 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:42 devstack sudo[94657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_mixf1h00devstack@QuobyteHD /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-06ff8373-7874-4dd3-addf-7a086036f482 Jul 08 01:38:42 devstack sudo[94657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-7f64a9ff-8bf0-4485-a6da-61b17fc88b5a req-c549acfe-e4bb-4afa-bcd3-0fcd59ec271e tempest-TestMinimumBasicScenario-176295214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-7f64a9ff-8bf0-4485-a6da-61b17fc88b5a req-c549acfe-e4bb-4afa-bcd3-0fcd59ec271e tempest-TestMinimumBasicScenario-176295214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:45 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdbccec-e0aa-46f6-9d1c-f306a455923d]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:38:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-7f64a9ff-8bf0-4485-a6da-61b17fc88b5a req-c549acfe-e4bb-4afa-bcd3-0fcd59ec271e tempest-TestMinimumBasicScenario-176295214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d33871f4-8d20-4910-b977-cb6b63faa17b {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:46 devstack sudo[94700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d33871f4-8d20-4910-b977-cb6b63faa17b Jul 08 01:38:46 devstack sudo[94700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:46 devstack sudo[94657]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_mixf1h00devstack@QuobyteHD /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-06ff8373-7874-4dd3-addf-7a086036f482" returned: 0 in 3.503s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:46 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_mixf1h00devstack@QuobyteHD, size 112.00 MB, duration 3.51 sec, destination /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-06ff8373-7874-4dd3-addf-7a086036f482 {{(pid=87284) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:38:46 devstack cinder-volume[87284]: INFO cinder.image.image_utils [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Converted 112.00 MB image at 31.94 MB/s Jul 08 01:38:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-06ff8373-7874-4dd3-addf-7a086036f482 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:46 devstack sudo[94702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-06ff8373-7874-4dd3-addf-7a086036f482 1G Jul 08 01:38:46 devstack sudo[94702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:47 devstack sudo[94700]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-7f64a9ff-8bf0-4485-a6da-61b17fc88b5a req-c549acfe-e4bb-4afa-bcd3-0fcd59ec271e tempest-TestMinimumBasicScenario-176295214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d33871f4-8d20-4910-b977-cb6b63faa17b" returned: 0 in 1.259s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-7f64a9ff-8bf0-4485-a6da-61b17fc88b5a req-c549acfe-e4bb-4afa-bcd3-0fcd59ec271e tempest-TestMinimumBasicScenario-176295214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.287s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-7f64a9ff-8bf0-4485-a6da-61b17fc88b5a req-c549acfe-e4bb-4afa-bcd3-0fcd59ec271e tempest-TestMinimumBasicScenario-176295214 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96', 'name': 'volume-d33871f4-8d20-4910-b977-cb6b63faa17b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '402fc5cd-daee-4470-97f7-111183649464', 'enforce_multipath': True} {{(pid=87284) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:38:47 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-7f64a9ff-8bf0-4485-a6da-61b17fc88b5a req-c549acfe-e4bb-4afa-bcd3-0fcd59ec271e tempest-TestMinimumBasicScenario-176295214 None] attachment_update completed successfully. Jul 08 01:38:47 devstack sudo[94702]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-06ff8373-7874-4dd3-addf-7a086036f482 1G" returned: 0 in 1.224s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:47 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c48446-395a-4cc5-9362-ebf846a85136]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:38:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-06ff8373-7874-4dd3-addf-7a086036f482 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:47 devstack sudo[94739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-06ff8373-7874-4dd3-addf-7a086036f482 Jul 08 01:38:47 devstack sudo[94739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:48 devstack sudo[94739]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-06ff8373-7874-4dd3-addf-7a086036f482" returned: 0 in 0.977s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-06ff8373-7874-4dd3-addf-7a086036f482 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:48 devstack sudo[95099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-06ff8373-7874-4dd3-addf-7a086036f482 Jul 08 01:38:48 devstack sudo[95099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:49 devstack sudo[95099]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-06ff8373-7874-4dd3-addf-7a086036f482" returned: 1 in 0.880s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-06ff8373-7874-4dd3-addf-7a086036f482' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:38:49 devstack cinder-volume[87284]: DEBUG cinder.volume.volume_utils [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Downloaded image 24b75d01-af4a-40ff-909b-cfbb4c8e9193 ((None, [{'url': 'file:///opt/stack/data/glance/images/24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'metadata': {}}])) to volume 06ff8373-7874-4dd3-addf-7a086036f482 successfully. {{(pid=87284) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:38:49 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Temporary image 24b75d01-af4a-40ff-909b-cfbb4c8e9193 for user efbaf101d3e9495fbd52ccd809d63bb6 is deleted. {{(pid=87284) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:38:49 devstack cinder-volume[87284]: DEBUG cinder.volume.volume_utils [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Marking volume 06ff8373-7874-4dd3-addf-7a086036f482 as bootable. {{(pid=87284) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:38:49 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Copying metadata from image 24b75d01-af4a-40ff-909b-cfbb4c8e9193 to 06ff8373-7874-4dd3-addf-7a086036f482. {{(pid=87284) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:38:49 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Creating volume glance metadata for volume 06ff8373-7874-4dd3-addf-7a086036f482 backed by image 24b75d01-af4a-40ff-909b-cfbb4c8e9193 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87284) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:38:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5988c6d-70f4-40c9-b215-9185223b18be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06ff8373-7874-4dd3-addf-7a086036f482', 'volume_size': 1, 'image_id': '24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '083157d49fd649eb95508535e9c547e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'created_at': datetime.datetime(2026, 7, 7, 23, 23, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 23, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24b75d01-af4a-40ff-909b-cfbb4c8e9193/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a1880d4-0c92-4ce6-bd41-e80f6023207d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:49 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Volume volume-06ff8373-7874-4dd3-addf-7a086036f482 (06ff8373-7874-4dd3-addf-7a086036f482): created successfully Jul 08 01:38:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a1880d4-0c92-4ce6-bd41-e80f6023207d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Flow 'volume_create_manager' (5c8eb763-a172-47f7-9125-5962ae93d763) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:38:49 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-a64e29f1-b31a-4075-8cf6-7b17ecc32f6d tempest-VolumesExtendTest-568362243 None] Created volume successfully. Jul 08 01:38:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c5b3fedf-7333-43b2-ad37-621bbbf7c50f tempest-VolumesExtendTest-568362243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c5b3fedf-7333-43b2-ad37-621bbbf7c50f tempest-VolumesExtendTest-568362243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:50 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadb99f5-7d5a-4d28-ad26-f4a3a4631a86]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:38:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c5b3fedf-7333-43b2-ad37-621bbbf7c50f tempest-VolumesExtendTest-568362243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-06ff8373-7874-4dd3-addf-7a086036f482 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:50 devstack sudo[95122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-06ff8373-7874-4dd3-addf-7a086036f482 Jul 08 01:38:50 devstack sudo[95122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:51 devstack sudo[95122]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c5b3fedf-7333-43b2-ad37-621bbbf7c50f tempest-VolumesExtendTest-568362243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-06ff8373-7874-4dd3-addf-7a086036f482" returned: 0 in 0.933s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c5b3fedf-7333-43b2-ad37-621bbbf7c50f tempest-VolumesExtendTest-568362243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-06ff8373-7874-4dd3-addf-7a086036f482 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:51 devstack sudo[95126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-06ff8373-7874-4dd3-addf-7a086036f482 Jul 08 01:38:51 devstack sudo[95126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:51 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c716060-bd47-47b7-a014-0c7c7fdd61aa tempest-VolumesTransfersV355Test-592413814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:38:51 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3c716060-bd47-47b7-a014-0c7c7fdd61aa tempest-VolumesTransfersV355Test-592413814 None] Flow 'volume_create_manager' (8001b163-99ee-4cf3-99d6-bb6322afcdd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:38:51 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3c716060-bd47-47b7-a014-0c7c7fdd61aa tempest-VolumesTransfersV355Test-592413814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da9f8a3-dbdb-403c-929c-0a75d08e8d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:51 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3c716060-bd47-47b7-a014-0c7c7fdd61aa tempest-VolumesTransfersV355Test-592413814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da9f8a3-dbdb-403c-929c-0a75d08e8d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1299670401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aaf62d9-aa52-43ff-a4f2-44b09bd44013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b7cd41135e2493d82cd65169bbfb95e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:38:52Z,use_quota=True,user_id='86eae5f97c724bbd810175abebbabbf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:51 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3c716060-bd47-47b7-a014-0c7c7fdd61aa tempest-VolumesTransfersV355Test-592413814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec2a45fa-c323-4ae6-b0ce-9cd72f1a8795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:51 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3c716060-bd47-47b7-a014-0c7c7fdd61aa tempest-VolumesTransfersV355Test-592413814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec2a45fa-c323-4ae6-b0ce-9cd72f1a8795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:51 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3c716060-bd47-47b7-a014-0c7c7fdd61aa tempest-VolumesTransfersV355Test-592413814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (936fce8d-61a1-4977-bc75-b00c0f7bb47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:51 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3c716060-bd47-47b7-a014-0c7c7fdd61aa tempest-VolumesTransfersV355Test-592413814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (936fce8d-61a1-4977-bc75-b00c0f7bb47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5aaf62d9-aa52-43ff-a4f2-44b09bd44013', 'volume_name': 'volume-5aaf62d9-aa52-43ff-a4f2-44b09bd44013', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:51 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3c716060-bd47-47b7-a014-0c7c7fdd61aa tempest-VolumesTransfersV355Test-592413814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10c1b9f6-ed81-4ce9-b52f-c1324ae40741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:51 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3c716060-bd47-47b7-a014-0c7c7fdd61aa tempest-VolumesTransfersV355Test-592413814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10c1b9f6-ed81-4ce9-b52f-c1324ae40741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:51 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3c716060-bd47-47b7-a014-0c7c7fdd61aa tempest-VolumesTransfersV355Test-592413814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fed2f39-6c81-4443-8459-b9e9e677d29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:51 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-3c716060-bd47-47b7-a014-0c7c7fdd61aa tempest-VolumesTransfersV355Test-592413814 None] Volume 5aaf62d9-aa52-43ff-a4f2-44b09bd44013: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5aaf62d9-aa52-43ff-a4f2-44b09bd44013', 'volume_size': 1} Jul 08 01:38:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3c716060-bd47-47b7-a014-0c7c7fdd61aa tempest-VolumesTransfersV355Test-592413814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:52 devstack sudo[95126]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c5b3fedf-7333-43b2-ad37-621bbbf7c50f tempest-VolumesExtendTest-568362243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-06ff8373-7874-4dd3-addf-7a086036f482" returned: 1 in 0.966s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c5b3fedf-7333-43b2-ad37-621bbbf7c50f tempest-VolumesExtendTest-568362243 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-06ff8373-7874-4dd3-addf-7a086036f482' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:38:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c5b3fedf-7333-43b2-ad37-621bbbf7c50f tempest-VolumesExtendTest-568362243 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-06ff8373-7874-4dd3-addf-7a086036f482 2G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c5b3fedf-7333-43b2-ad37-621bbbf7c50f tempest-VolumesExtendTest-568362243 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-06ff8373-7874-4dd3-addf-7a086036f482 2G" returned: 0 in 0.058s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c5b3fedf-7333-43b2-ad37-621bbbf7c50f tempest-VolumesExtendTest-568362243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.025s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3c716060-bd47-47b7-a014-0c7c7fdd61aa tempest-VolumesTransfersV355Test-592413814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.476s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3c716060-bd47-47b7-a014-0c7c7fdd61aa tempest-VolumesTransfersV355Test-592413814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1299670401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aaf62d9-aa52-43ff-a4f2-44b09bd44013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b7cd41135e2493d82cd65169bbfb95e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:38:52Z,use_quota=True,user_id='86eae5f97c724bbd810175abebbabbf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:38:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-3c716060-bd47-47b7-a014-0c7c7fdd61aa tempest-VolumesTransfersV355Test-592413814 None] Creating volume 5aaf62d9-aa52-43ff-a4f2-44b09bd44013 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:38:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3c716060-bd47-47b7-a014-0c7c7fdd61aa tempest-VolumesTransfersV355Test-592413814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3c716060-bd47-47b7-a014-0c7c7fdd61aa tempest-VolumesTransfersV355Test-592413814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3c716060-bd47-47b7-a014-0c7c7fdd61aa tempest-VolumesTransfersV355Test-592413814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:38:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3c716060-bd47-47b7-a014-0c7c7fdd61aa tempest-VolumesTransfersV355Test-592413814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:38:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3c716060-bd47-47b7-a014-0c7c7fdd61aa tempest-VolumesTransfersV355Test-592413814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3c716060-bd47-47b7-a014-0c7c7fdd61aa tempest-VolumesTransfersV355Test-592413814 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:38:52 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-3c716060-bd47-47b7-a014-0c7c7fdd61aa tempest-VolumesTransfersV355Test-592413814 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:38:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3c716060-bd47-47b7-a014-0c7c7fdd61aa tempest-VolumesTransfersV355Test-592413814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5aaf62d9-aa52-43ff-a4f2-44b09bd44013 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:52 devstack sudo[95137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5aaf62d9-aa52-43ff-a4f2-44b09bd44013 1073741824 Jul 08 01:38:52 devstack sudo[95137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:52 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-c5b3fedf-7333-43b2-ad37-621bbbf7c50f tempest-VolumesExtendTest-568362243 None] Extend volume completed successfully. Jul 08 01:38:52 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b72b2bde-7b49-4398-99d0-d3b55045fc93 tempest-VolumesExtendTest-568362243 None] Acquiring lock "cinder-06ff8373-7874-4dd3-addf-7a086036f482-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:52 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b72b2bde-7b49-4398-99d0-d3b55045fc93 tempest-VolumesExtendTest-568362243 None] Lock "cinder-06ff8373-7874-4dd3-addf-7a086036f482-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:52 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b72b2bde-7b49-4398-99d0-d3b55045fc93 tempest-VolumesExtendTest-568362243 None] Acquiring lock "cinder-quobyte-06ff8373-7874-4dd3-addf-7a086036f482" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:52 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b72b2bde-7b49-4398-99d0-d3b55045fc93 tempest-VolumesExtendTest-568362243 None] Lock "cinder-quobyte-06ff8373-7874-4dd3-addf-7a086036f482" acquired by "delete_volume" :: waited 0.019s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:53 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[421dcd0f-cf0a-4a06-8457-d407e738e74b]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:38:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b72b2bde-7b49-4398-99d0-d3b55045fc93 tempest-VolumesExtendTest-568362243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-06ff8373-7874-4dd3-addf-7a086036f482 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:53 devstack sudo[95141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-06ff8373-7874-4dd3-addf-7a086036f482 Jul 08 01:38:53 devstack sudo[95141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:53 devstack sudo[95137]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3c716060-bd47-47b7-a014-0c7c7fdd61aa tempest-VolumesTransfersV355Test-592413814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5aaf62d9-aa52-43ff-a4f2-44b09bd44013 1073741824" returned: 0 in 1.157s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3c716060-bd47-47b7-a014-0c7c7fdd61aa tempest-VolumesTransfersV355Test-592413814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5aaf62d9-aa52-43ff-a4f2-44b09bd44013 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:53 devstack sudo[95147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5aaf62d9-aa52-43ff-a4f2-44b09bd44013 Jul 08 01:38:53 devstack sudo[95147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:53 devstack sudo[95141]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b72b2bde-7b49-4398-99d0-d3b55045fc93 tempest-VolumesExtendTest-568362243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-06ff8373-7874-4dd3-addf-7a086036f482" returned: 0 in 0.915s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b72b2bde-7b49-4398-99d0-d3b55045fc93 tempest-VolumesExtendTest-568362243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-06ff8373-7874-4dd3-addf-7a086036f482 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:54 devstack sudo[95151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-06ff8373-7874-4dd3-addf-7a086036f482 Jul 08 01:38:54 devstack sudo[95151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:54 devstack sudo[95147]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3c716060-bd47-47b7-a014-0c7c7fdd61aa tempest-VolumesTransfersV355Test-592413814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5aaf62d9-aa52-43ff-a4f2-44b09bd44013" returned: 0 in 0.820s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:54 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3c716060-bd47-47b7-a014-0c7c7fdd61aa tempest-VolumesTransfersV355Test-592413814 None] <== create_volume: return (2031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:38:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3c716060-bd47-47b7-a014-0c7c7fdd61aa tempest-VolumesTransfersV355Test-592413814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.036s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3c716060-bd47-47b7-a014-0c7c7fdd61aa tempest-VolumesTransfersV355Test-592413814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fed2f39-6c81-4443-8459-b9e9e677d29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5aaf62d9-aa52-43ff-a4f2-44b09bd44013', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3c716060-bd47-47b7-a014-0c7c7fdd61aa tempest-VolumesTransfersV355Test-592413814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a8820e-7198-4391-94dc-d47f8de144fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:54 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-3c716060-bd47-47b7-a014-0c7c7fdd61aa tempest-VolumesTransfersV355Test-592413814 None] Volume volume-5aaf62d9-aa52-43ff-a4f2-44b09bd44013 (5aaf62d9-aa52-43ff-a4f2-44b09bd44013): created successfully Jul 08 01:38:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3c716060-bd47-47b7-a014-0c7c7fdd61aa tempest-VolumesTransfersV355Test-592413814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a8820e-7198-4391-94dc-d47f8de144fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3c716060-bd47-47b7-a014-0c7c7fdd61aa tempest-VolumesTransfersV355Test-592413814 None] Flow 'volume_create_manager' (8001b163-99ee-4cf3-99d6-bb6322afcdd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:38:54 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-3c716060-bd47-47b7-a014-0c7c7fdd61aa tempest-VolumesTransfersV355Test-592413814 None] Created volume successfully. Jul 08 01:38:54 devstack sudo[95151]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b72b2bde-7b49-4398-99d0-d3b55045fc93 tempest-VolumesExtendTest-568362243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-06ff8373-7874-4dd3-addf-7a086036f482" returned: 1 in 0.866s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b72b2bde-7b49-4398-99d0-d3b55045fc93 tempest-VolumesExtendTest-568362243 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-06ff8373-7874-4dd3-addf-7a086036f482' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:38:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b72b2bde-7b49-4398-99d0-d3b55045fc93 tempest-VolumesExtendTest-568362243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-06ff8373-7874-4dd3-addf-7a086036f482 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:54 devstack sudo[95158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-06ff8373-7874-4dd3-addf-7a086036f482 Jul 08 01:38:54 devstack sudo[95158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:55 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:38:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:38:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:38:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:55 devstack sudo[95161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:38:55 devstack sudo[95161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:55 devstack sudo[95158]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b72b2bde-7b49-4398-99d0-d3b55045fc93 tempest-VolumesExtendTest-568362243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-06ff8373-7874-4dd3-addf-7a086036f482" returned: 0 in 1.027s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:55 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b72b2bde-7b49-4398-99d0-d3b55045fc93 tempest-VolumesExtendTest-568362243 None] Lock "cinder-quobyte-06ff8373-7874-4dd3-addf-7a086036f482" released by "delete_volume" :: held 2.899s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:55 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-b72b2bde-7b49-4398-99d0-d3b55045fc93 tempest-VolumesExtendTest-568362243 None] Created reservations ['35144a09-8e2c-464d-b4c8-79cce603ef73', '6c840bac-cdde-4109-b885-a552f12335ea', 'f167534f-6001-4e83-ad7e-43f09638d307', '4fe7e6b3-d026-4f81-ba4f-990885dd29ff'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:38:55 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-8bc227a6-9749-43a1-a010-646c53eff0f6 tempest-VolumesTransfersV355Test-1147380792 None] Transfer volume completed successfully. Jul 08 01:38:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b72b2bde-7b49-4398-99d0-d3b55045fc93 tempest-VolumesExtendTest-568362243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b72b2bde-7b49-4398-99d0-d3b55045fc93 tempest-VolumesExtendTest-568362243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:56 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b72b2bde-7b49-4398-99d0-d3b55045fc93 tempest-VolumesExtendTest-568362243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:38:56 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b72b2bde-7b49-4398-99d0-d3b55045fc93 tempest-VolumesExtendTest-568362243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:38:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b72b2bde-7b49-4398-99d0-d3b55045fc93 tempest-VolumesExtendTest-568362243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b72b2bde-7b49-4398-99d0-d3b55045fc93 tempest-VolumesExtendTest-568362243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:56 devstack sudo[95166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:38:56 devstack sudo[95166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:56 devstack sudo[95161]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.449s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:56 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:38:56 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager._thread_info {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:38:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread count: 29 {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:38:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread info: [<_MainThread(MainThread, started 127058402500736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:38:57 devstack sudo[95166]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b72b2bde-7b49-4398-99d0-d3b55045fc93 tempest-VolumesExtendTest-568362243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.362s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:57 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-b72b2bde-7b49-4398-99d0-d3b55045fc93 tempest-VolumesExtendTest-568362243 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:38:57 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-b72b2bde-7b49-4398-99d0-d3b55045fc93 tempest-VolumesExtendTest-568362243 None] Deleted volume successfully. Jul 08 01:38:57 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a9f37f7-0fbe-4bbd-8db1-e9094c233b35 tempest-VolumesExtendTest-568362243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:38:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6a9f37f7-0fbe-4bbd-8db1-e9094c233b35 tempest-VolumesExtendTest-568362243 None] Flow 'volume_create_manager' (eedc003b-6ede-4bd1-ad65-1123d66ff8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:38:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6a9f37f7-0fbe-4bbd-8db1-e9094c233b35 tempest-VolumesExtendTest-568362243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1b38a9c-7f0e-4d06-a3c1-5e7c5a102b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:57 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-7da01931-13ea-4044-b9ed-5c341416a178 tempest-VolumesTransfersV355Test-369531010 None] Acquiring lock "cinder-5aaf62d9-aa52-43ff-a4f2-44b09bd44013-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:57 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b72b2bde-7b49-4398-99d0-d3b55045fc93 tempest-VolumesExtendTest-568362243 None] Lock "cinder-06ff8373-7874-4dd3-addf-7a086036f482-delete_volume" released by "delete_volume" :: held 4.634s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6a9f37f7-0fbe-4bbd-8db1-e9094c233b35 tempest-VolumesExtendTest-568362243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1b38a9c-7f0e-4d06-a3c1-5e7c5a102b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-260527478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0d17dba-cc40-4a05-8277-908b9aeb3d8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d73b03f0a5344b6e8bc17c5ab2599e87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:38:57Z,use_quota=True,user_id='efbaf101d3e9495fbd52ccd809d63bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6a9f37f7-0fbe-4bbd-8db1-e9094c233b35 tempest-VolumesExtendTest-568362243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81cd24ce-f003-41f9-967d-81e09a26bde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6a9f37f7-0fbe-4bbd-8db1-e9094c233b35 tempest-VolumesExtendTest-568362243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81cd24ce-f003-41f9-967d-81e09a26bde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6a9f37f7-0fbe-4bbd-8db1-e9094c233b35 tempest-VolumesExtendTest-568362243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66a3fcdf-6032-408f-aea6-302b29d1dd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6a9f37f7-0fbe-4bbd-8db1-e9094c233b35 tempest-VolumesExtendTest-568362243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66a3fcdf-6032-408f-aea6-302b29d1dd5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0d17dba-cc40-4a05-8277-908b9aeb3d8d', 'volume_name': 'volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6a9f37f7-0fbe-4bbd-8db1-e9094c233b35 tempest-VolumesExtendTest-568362243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef5604d3-2287-4123-94d8-4fdd0d76b8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6a9f37f7-0fbe-4bbd-8db1-e9094c233b35 tempest-VolumesExtendTest-568362243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef5604d3-2287-4123-94d8-4fdd0d76b8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6a9f37f7-0fbe-4bbd-8db1-e9094c233b35 tempest-VolumesExtendTest-568362243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75377906-6a41-4332-bdf3-eb6601b5b5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:57 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-6a9f37f7-0fbe-4bbd-8db1-e9094c233b35 tempest-VolumesExtendTest-568362243 None] Volume f0d17dba-cc40-4a05-8277-908b9aeb3d8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d', 'volume_size': 1} Jul 08 01:38:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6a9f37f7-0fbe-4bbd-8db1-e9094c233b35 tempest-VolumesExtendTest-568362243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6a9f37f7-0fbe-4bbd-8db1-e9094c233b35 tempest-VolumesExtendTest-568362243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-6a9f37f7-0fbe-4bbd-8db1-e9094c233b35 tempest-VolumesExtendTest-568362243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-260527478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0d17dba-cc40-4a05-8277-908b9aeb3d8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d73b03f0a5344b6e8bc17c5ab2599e87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:38:57Z,use_quota=True,user_id='efbaf101d3e9495fbd52ccd809d63bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:38:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-6a9f37f7-0fbe-4bbd-8db1-e9094c233b35 tempest-VolumesExtendTest-568362243 None] Creating volume f0d17dba-cc40-4a05-8277-908b9aeb3d8d {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:38:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6a9f37f7-0fbe-4bbd-8db1-e9094c233b35 tempest-VolumesExtendTest-568362243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6a9f37f7-0fbe-4bbd-8db1-e9094c233b35 tempest-VolumesExtendTest-568362243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-6a9f37f7-0fbe-4bbd-8db1-e9094c233b35 tempest-VolumesExtendTest-568362243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:38:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-6a9f37f7-0fbe-4bbd-8db1-e9094c233b35 tempest-VolumesExtendTest-568362243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:38:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6a9f37f7-0fbe-4bbd-8db1-e9094c233b35 tempest-VolumesExtendTest-568362243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-6a9f37f7-0fbe-4bbd-8db1-e9094c233b35 tempest-VolumesExtendTest-568362243 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:38:57 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-6a9f37f7-0fbe-4bbd-8db1-e9094c233b35 tempest-VolumesExtendTest-568362243 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:38:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6a9f37f7-0fbe-4bbd-8db1-e9094c233b35 tempest-VolumesExtendTest-568362243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:57 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-7da01931-13ea-4044-b9ed-5c341416a178 tempest-VolumesTransfersV355Test-369531010 None] Lock "cinder-5aaf62d9-aa52-43ff-a4f2-44b09bd44013-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:57 devstack sudo[95170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d 1073741824 Jul 08 01:38:57 devstack sudo[95170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:57 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-7da01931-13ea-4044-b9ed-5c341416a178 tempest-VolumesTransfersV355Test-369531010 None] Acquiring lock "cinder-quobyte-5aaf62d9-aa52-43ff-a4f2-44b09bd44013" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:38:57 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-7da01931-13ea-4044-b9ed-5c341416a178 tempest-VolumesTransfersV355Test-369531010 None] Lock "cinder-quobyte-5aaf62d9-aa52-43ff-a4f2-44b09bd44013" acquired by "delete_volume" :: waited 0.025s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:38:57 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d88bd11-32b4-4260-9831-27c71951a22b]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:38:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7da01931-13ea-4044-b9ed-5c341416a178 tempest-VolumesTransfersV355Test-369531010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5aaf62d9-aa52-43ff-a4f2-44b09bd44013 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:57 devstack sudo[95172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5aaf62d9-aa52-43ff-a4f2-44b09bd44013 Jul 08 01:38:57 devstack sudo[95172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:58 devstack sudo[95172]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7da01931-13ea-4044-b9ed-5c341416a178 tempest-VolumesTransfersV355Test-369531010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5aaf62d9-aa52-43ff-a4f2-44b09bd44013" returned: 0 in 1.059s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7da01931-13ea-4044-b9ed-5c341416a178 tempest-VolumesTransfersV355Test-369531010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5aaf62d9-aa52-43ff-a4f2-44b09bd44013 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:58 devstack sudo[95183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5aaf62d9-aa52-43ff-a4f2-44b09bd44013 Jul 08 01:38:58 devstack sudo[95183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:58 devstack sudo[95170]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6a9f37f7-0fbe-4bbd-8db1-e9094c233b35 tempest-VolumesExtendTest-568362243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d 1073741824" returned: 0 in 1.211s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6a9f37f7-0fbe-4bbd-8db1-e9094c233b35 tempest-VolumesExtendTest-568362243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:58 devstack sudo[95185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d Jul 08 01:38:58 devstack sudo[95185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:59 devstack sudo[95183]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7da01931-13ea-4044-b9ed-5c341416a178 tempest-VolumesTransfersV355Test-369531010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5aaf62d9-aa52-43ff-a4f2-44b09bd44013" returned: 0 in 0.757s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:59 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-7da01931-13ea-4044-b9ed-5c341416a178 tempest-VolumesTransfersV355Test-369531010 None] Lock "cinder-quobyte-5aaf62d9-aa52-43ff-a4f2-44b09bd44013" released by "delete_volume" :: held 1.862s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:38:59 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-7da01931-13ea-4044-b9ed-5c341416a178 tempest-VolumesTransfersV355Test-369531010 None] Created reservations ['57c6c380-9779-47b8-8014-7a0ac9a12892', '30a41019-0841-4ef3-b6ff-734c8c375a87', '0967e453-488d-42d2-af7c-6fa1c1aa2247', '6743dc80-5cad-45f8-97b7-6e959f92de66'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:38:59 devstack sudo[95185]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6a9f37f7-0fbe-4bbd-8db1-e9094c233b35 tempest-VolumesExtendTest-568362243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d" returned: 0 in 0.797s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:59 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-6a9f37f7-0fbe-4bbd-8db1-e9094c233b35 tempest-VolumesExtendTest-568362243 None] <== create_volume: return (2054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:38:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6a9f37f7-0fbe-4bbd-8db1-e9094c233b35 tempest-VolumesExtendTest-568362243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.057s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6a9f37f7-0fbe-4bbd-8db1-e9094c233b35 tempest-VolumesExtendTest-568362243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75377906-6a41-4332-bdf3-eb6601b5b5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6a9f37f7-0fbe-4bbd-8db1-e9094c233b35 tempest-VolumesExtendTest-568362243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2793163-2084-4cf6-9f4b-8c63c98da752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:38:59 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-6a9f37f7-0fbe-4bbd-8db1-e9094c233b35 tempest-VolumesExtendTest-568362243 None] Volume volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d (f0d17dba-cc40-4a05-8277-908b9aeb3d8d): created successfully Jul 08 01:38:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6a9f37f7-0fbe-4bbd-8db1-e9094c233b35 tempest-VolumesExtendTest-568362243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2793163-2084-4cf6-9f4b-8c63c98da752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:38:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6a9f37f7-0fbe-4bbd-8db1-e9094c233b35 tempest-VolumesExtendTest-568362243 None] Flow 'volume_create_manager' (eedc003b-6ede-4bd1-ad65-1123d66ff8c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:38:59 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-6a9f37f7-0fbe-4bbd-8db1-e9094c233b35 tempest-VolumesExtendTest-568362243 None] Created volume successfully. Jul 08 01:38:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-7da01931-13ea-4044-b9ed-5c341416a178 tempest-VolumesTransfersV355Test-369531010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:38:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-7da01931-13ea-4044-b9ed-5c341416a178 tempest-VolumesTransfersV355Test-369531010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:38:59 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-7da01931-13ea-4044-b9ed-5c341416a178 tempest-VolumesTransfersV355Test-369531010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:38:59 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-7da01931-13ea-4044-b9ed-5c341416a178 tempest-VolumesTransfersV355Test-369531010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:38:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-7da01931-13ea-4044-b9ed-5c341416a178 tempest-VolumesTransfersV355Test-369531010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:38:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7da01931-13ea-4044-b9ed-5c341416a178 tempest-VolumesTransfersV355Test-369531010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:59 devstack sudo[95189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:38:59 devstack sudo[95189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:00 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-f15f3dbf-94a6-4bd5-b2c3-49f7380ab61e tempest-VolumesTransfersV355Test-592413814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:39:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f15f3dbf-94a6-4bd5-b2c3-49f7380ab61e tempest-VolumesTransfersV355Test-592413814 None] Flow 'volume_create_manager' (9b6c67fb-598d-4856-8e3c-78842a17c4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:39:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f15f3dbf-94a6-4bd5-b2c3-49f7380ab61e tempest-VolumesTransfersV355Test-592413814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2db61613-b014-4f40-a1ed-a26400edb1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f15f3dbf-94a6-4bd5-b2c3-49f7380ab61e tempest-VolumesTransfersV355Test-592413814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2db61613-b014-4f40-a1ed-a26400edb1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-223016301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6fb015b-4263-456c-9ecc-96ef482bcbd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b7cd41135e2493d82cd65169bbfb95e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:39:00Z,use_quota=True,user_id='86eae5f97c724bbd810175abebbabbf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f15f3dbf-94a6-4bd5-b2c3-49f7380ab61e tempest-VolumesTransfersV355Test-592413814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (694f4964-d613-4261-b3a5-b73cbb5768fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f15f3dbf-94a6-4bd5-b2c3-49f7380ab61e tempest-VolumesTransfersV355Test-592413814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (694f4964-d613-4261-b3a5-b73cbb5768fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f15f3dbf-94a6-4bd5-b2c3-49f7380ab61e tempest-VolumesTransfersV355Test-592413814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61269ad5-0bf0-4613-bc40-2271a9a54020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f15f3dbf-94a6-4bd5-b2c3-49f7380ab61e tempest-VolumesTransfersV355Test-592413814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61269ad5-0bf0-4613-bc40-2271a9a54020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6fb015b-4263-456c-9ecc-96ef482bcbd1', 'volume_name': 'volume-a6fb015b-4263-456c-9ecc-96ef482bcbd1', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f15f3dbf-94a6-4bd5-b2c3-49f7380ab61e tempest-VolumesTransfersV355Test-592413814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f28d685e-d06f-4e89-a01b-5b783b6bb280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f15f3dbf-94a6-4bd5-b2c3-49f7380ab61e tempest-VolumesTransfersV355Test-592413814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f28d685e-d06f-4e89-a01b-5b783b6bb280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f15f3dbf-94a6-4bd5-b2c3-49f7380ab61e tempest-VolumesTransfersV355Test-592413814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd72fb0f-825a-42c4-9851-d772b15fad47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:00 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-f15f3dbf-94a6-4bd5-b2c3-49f7380ab61e tempest-VolumesTransfersV355Test-592413814 None] Volume a6fb015b-4263-456c-9ecc-96ef482bcbd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6fb015b-4263-456c-9ecc-96ef482bcbd1', 'volume_size': 1} Jul 08 01:39:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f15f3dbf-94a6-4bd5-b2c3-49f7380ab61e tempest-VolumesTransfersV355Test-592413814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f15f3dbf-94a6-4bd5-b2c3-49f7380ab61e tempest-VolumesTransfersV355Test-592413814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f15f3dbf-94a6-4bd5-b2c3-49f7380ab61e tempest-VolumesTransfersV355Test-592413814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-223016301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6fb015b-4263-456c-9ecc-96ef482bcbd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b7cd41135e2493d82cd65169bbfb95e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:39:00Z,use_quota=True,user_id='86eae5f97c724bbd810175abebbabbf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:39:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-f15f3dbf-94a6-4bd5-b2c3-49f7380ab61e tempest-VolumesTransfersV355Test-592413814 None] Creating volume a6fb015b-4263-456c-9ecc-96ef482bcbd1 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:39:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f15f3dbf-94a6-4bd5-b2c3-49f7380ab61e tempest-VolumesTransfersV355Test-592413814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f15f3dbf-94a6-4bd5-b2c3-49f7380ab61e tempest-VolumesTransfersV355Test-592413814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f15f3dbf-94a6-4bd5-b2c3-49f7380ab61e tempest-VolumesTransfersV355Test-592413814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:39:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f15f3dbf-94a6-4bd5-b2c3-49f7380ab61e tempest-VolumesTransfersV355Test-592413814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:39:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f15f3dbf-94a6-4bd5-b2c3-49f7380ab61e tempest-VolumesTransfersV355Test-592413814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f15f3dbf-94a6-4bd5-b2c3-49f7380ab61e tempest-VolumesTransfersV355Test-592413814 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:39:00 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-f15f3dbf-94a6-4bd5-b2c3-49f7380ab61e tempest-VolumesTransfersV355Test-592413814 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:39:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f15f3dbf-94a6-4bd5-b2c3-49f7380ab61e tempest-VolumesTransfersV355Test-592413814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6fb015b-4263-456c-9ecc-96ef482bcbd1 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:00 devstack sudo[95189]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7da01931-13ea-4044-b9ed-5c341416a178 tempest-VolumesTransfersV355Test-369531010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.858s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:00 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-7da01931-13ea-4044-b9ed-5c341416a178 tempest-VolumesTransfersV355Test-369531010 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:39:00 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-7da01931-13ea-4044-b9ed-5c341416a178 tempest-VolumesTransfersV355Test-369531010 None] Deleted volume successfully. Jul 08 01:39:00 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-7da01931-13ea-4044-b9ed-5c341416a178 tempest-VolumesTransfersV355Test-369531010 None] Lock "cinder-5aaf62d9-aa52-43ff-a4f2-44b09bd44013-delete_volume" released by "delete_volume" :: held 3.056s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:39:00 devstack sudo[95195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6fb015b-4263-456c-9ecc-96ef482bcbd1 1073741824 Jul 08 01:39:00 devstack sudo[95195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-696e0d62-4c49-4d54-ae1d-bd075d682693 tempest-VolumesExtendTest-568362243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:01 devstack sudo[95195]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f15f3dbf-94a6-4bd5-b2c3-49f7380ab61e tempest-VolumesTransfersV355Test-592413814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6fb015b-4263-456c-9ecc-96ef482bcbd1 1073741824" returned: 0 in 1.095s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f15f3dbf-94a6-4bd5-b2c3-49f7380ab61e tempest-VolumesTransfersV355Test-592413814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6fb015b-4263-456c-9ecc-96ef482bcbd1 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:01 devstack sudo[95205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6fb015b-4263-456c-9ecc-96ef482bcbd1 Jul 08 01:39:01 devstack sudo[95205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:02 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-c54a8a3a-88eb-4ab8-9b4c-49a76e878b76 tempest-AttachVolumeNegativeTest-1884741045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:39:02 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c54a8a3a-88eb-4ab8-9b4c-49a76e878b76 tempest-AttachVolumeNegativeTest-1884741045 None] Flow 'volume_create_manager' (42f613df-395c-4858-9673-1f8517618e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:39:02 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c54a8a3a-88eb-4ab8-9b4c-49a76e878b76 tempest-AttachVolumeNegativeTest-1884741045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed0ea97f-05d0-4123-b2c2-2800a93dd44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:02 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c54a8a3a-88eb-4ab8-9b4c-49a76e878b76 tempest-AttachVolumeNegativeTest-1884741045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed0ea97f-05d0-4123-b2c2-2800a93dd44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-991650572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cf1dc8e-a1a6-4fd1-a222-1d0e82849437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b132a62bc75f428690d4a973fa99e0a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:39:02Z,use_quota=True,user_id='321acf045e5e4ab099b9a076a97db13e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:02 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c54a8a3a-88eb-4ab8-9b4c-49a76e878b76 tempest-AttachVolumeNegativeTest-1884741045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cca6e7e2-69dc-4219-b5dd-c93d69437bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:02 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c54a8a3a-88eb-4ab8-9b4c-49a76e878b76 tempest-AttachVolumeNegativeTest-1884741045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cca6e7e2-69dc-4219-b5dd-c93d69437bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:02 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c54a8a3a-88eb-4ab8-9b4c-49a76e878b76 tempest-AttachVolumeNegativeTest-1884741045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eded8d8-63ec-4298-a940-f2b4fd66b62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:02 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c54a8a3a-88eb-4ab8-9b4c-49a76e878b76 tempest-AttachVolumeNegativeTest-1884741045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eded8d8-63ec-4298-a940-f2b4fd66b62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cf1dc8e-a1a6-4fd1-a222-1d0e82849437', 'volume_name': 'volume-0cf1dc8e-a1a6-4fd1-a222-1d0e82849437', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:02 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c54a8a3a-88eb-4ab8-9b4c-49a76e878b76 tempest-AttachVolumeNegativeTest-1884741045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9c9d469-07be-42b6-9d76-912be899a66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:02 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c54a8a3a-88eb-4ab8-9b4c-49a76e878b76 tempest-AttachVolumeNegativeTest-1884741045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9c9d469-07be-42b6-9d76-912be899a66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:02 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c54a8a3a-88eb-4ab8-9b4c-49a76e878b76 tempest-AttachVolumeNegativeTest-1884741045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b3ab474-016e-49d8-9967-5c50d97048af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:02 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-c54a8a3a-88eb-4ab8-9b4c-49a76e878b76 tempest-AttachVolumeNegativeTest-1884741045 None] Volume 0cf1dc8e-a1a6-4fd1-a222-1d0e82849437: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cf1dc8e-a1a6-4fd1-a222-1d0e82849437', 'volume_size': 1} Jul 08 01:39:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c54a8a3a-88eb-4ab8-9b4c-49a76e878b76 tempest-AttachVolumeNegativeTest-1884741045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:02 devstack sudo[95205]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f15f3dbf-94a6-4bd5-b2c3-49f7380ab61e tempest-VolumesTransfersV355Test-592413814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6fb015b-4263-456c-9ecc-96ef482bcbd1" returned: 0 in 0.807s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:02 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f15f3dbf-94a6-4bd5-b2c3-49f7380ab61e tempest-VolumesTransfersV355Test-592413814 None] <== create_volume: return (1961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:39:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f15f3dbf-94a6-4bd5-b2c3-49f7380ab61e tempest-VolumesTransfersV355Test-592413814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.965s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-696e0d62-4c49-4d54-ae1d-bd075d682693 tempest-VolumesExtendTest-568362243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.527s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:02 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f15f3dbf-94a6-4bd5-b2c3-49f7380ab61e tempest-VolumesTransfersV355Test-592413814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd72fb0f-825a-42c4-9851-d772b15fad47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6fb015b-4263-456c-9ecc-96ef482bcbd1', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:02 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f15f3dbf-94a6-4bd5-b2c3-49f7380ab61e tempest-VolumesTransfersV355Test-592413814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f40824d2-3078-4b2f-8967-80487a47da5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:02 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-696e0d62-4c49-4d54-ae1d-bd075d682693 tempest-VolumesExtendTest-568362243 None] Creating offline snapshot 1f6f1674-2610-4af8-be6b-703aaa62c180 of volume f0d17dba-cc40-4a05-8277-908b9aeb3d8d {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:39:02 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-f15f3dbf-94a6-4bd5-b2c3-49f7380ab61e tempest-VolumesTransfersV355Test-592413814 None] Volume volume-a6fb015b-4263-456c-9ecc-96ef482bcbd1 (a6fb015b-4263-456c-9ecc-96ef482bcbd1): created successfully Jul 08 01:39:02 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f15f3dbf-94a6-4bd5-b2c3-49f7380ab61e tempest-VolumesTransfersV355Test-592413814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f40824d2-3078-4b2f-8967-80487a47da5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:02 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f15f3dbf-94a6-4bd5-b2c3-49f7380ab61e tempest-VolumesTransfersV355Test-592413814 None] Flow 'volume_create_manager' (9b6c67fb-598d-4856-8e3c-78842a17c4dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:39:02 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b85416-b109-4535-88ac-fe50784a1c7f]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:39:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-696e0d62-4c49-4d54-ae1d-bd075d682693 tempest-VolumesExtendTest-568362243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:02 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-f15f3dbf-94a6-4bd5-b2c3-49f7380ab61e tempest-VolumesTransfersV355Test-592413814 None] Created volume successfully. Jul 08 01:39:02 devstack sudo[95208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d Jul 08 01:39:02 devstack sudo[95208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:03 devstack sudo[95208]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-696e0d62-4c49-4d54-ae1d-bd075d682693 tempest-VolumesExtendTest-568362243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d" returned: 0 in 0.867s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-696e0d62-4c49-4d54-ae1d-bd075d682693 tempest-VolumesExtendTest-568362243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d.1f6f1674-2610-4af8-be6b-703aaa62c180 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:03 devstack sudo[95213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d.1f6f1674-2610-4af8-be6b-703aaa62c180 1G Jul 08 01:39:03 devstack sudo[95213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:03 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2fe52383-5967-483e-a326-3805caa5b393 tempest-VolumesTransfersV355Test-369531010 None] Acquiring lock "cinder-a6fb015b-4263-456c-9ecc-96ef482bcbd1-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:39:04 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2fe52383-5967-483e-a326-3805caa5b393 tempest-VolumesTransfersV355Test-369531010 None] Lock "cinder-a6fb015b-4263-456c-9ecc-96ef482bcbd1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:39:04 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2fe52383-5967-483e-a326-3805caa5b393 tempest-VolumesTransfersV355Test-369531010 None] Acquiring lock "cinder-quobyte-a6fb015b-4263-456c-9ecc-96ef482bcbd1" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:39:04 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2fe52383-5967-483e-a326-3805caa5b393 tempest-VolumesTransfersV355Test-369531010 None] Lock "cinder-quobyte-a6fb015b-4263-456c-9ecc-96ef482bcbd1" acquired by "delete_volume" :: waited 0.016s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:39:04 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d2856c-639d-4d3e-872d-b96143d3bb79]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:39:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2fe52383-5967-483e-a326-3805caa5b393 tempest-VolumesTransfersV355Test-369531010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6fb015b-4263-456c-9ecc-96ef482bcbd1 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:04 devstack sudo[95215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6fb015b-4263-456c-9ecc-96ef482bcbd1 Jul 08 01:39:04 devstack sudo[95215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:04 devstack sudo[95213]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-696e0d62-4c49-4d54-ae1d-bd075d682693 tempest-VolumesExtendTest-568362243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d.1f6f1674-2610-4af8-be6b-703aaa62c180 1G" returned: 0 in 0.899s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-696e0d62-4c49-4d54-ae1d-bd075d682693 tempest-VolumesExtendTest-568362243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d.1f6f1674-2610-4af8-be6b-703aaa62c180 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:04 devstack sudo[95222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d.1f6f1674-2610-4af8-be6b-703aaa62c180 Jul 08 01:39:04 devstack sudo[95222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:04 devstack sudo[95215]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2fe52383-5967-483e-a326-3805caa5b393 tempest-VolumesTransfersV355Test-369531010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6fb015b-4263-456c-9ecc-96ef482bcbd1" returned: 0 in 0.890s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2fe52383-5967-483e-a326-3805caa5b393 tempest-VolumesTransfersV355Test-369531010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6fb015b-4263-456c-9ecc-96ef482bcbd1 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:05 devstack sudo[95228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6fb015b-4263-456c-9ecc-96ef482bcbd1 Jul 08 01:39:05 devstack sudo[95228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:05 devstack sudo[95222]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-696e0d62-4c49-4d54-ae1d-bd075d682693 tempest-VolumesExtendTest-568362243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d.1f6f1674-2610-4af8-be6b-703aaa62c180" returned: 0 in 0.798s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:05 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-696e0d62-4c49-4d54-ae1d-bd075d682693 tempest-VolumesExtendTest-568362243 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d.1f6f1674-2610-4af8-be6b-703aaa62c180 is being set with open permissions: ugo+rw Jul 08 01:39:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-696e0d62-4c49-4d54-ae1d-bd075d682693 tempest-VolumesExtendTest-568362243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d.1f6f1674-2610-4af8-be6b-703aaa62c180 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:05 devstack sudo[95233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d.1f6f1674-2610-4af8-be6b-703aaa62c180 Jul 08 01:39:05 devstack sudo[95233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:05 devstack sudo[95228]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2fe52383-5967-483e-a326-3805caa5b393 tempest-VolumesTransfersV355Test-369531010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a6fb015b-4263-456c-9ecc-96ef482bcbd1" returned: 0 in 0.695s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:05 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2fe52383-5967-483e-a326-3805caa5b393 tempest-VolumesTransfersV355Test-369531010 None] Lock "cinder-quobyte-a6fb015b-4263-456c-9ecc-96ef482bcbd1" released by "delete_volume" :: held 1.630s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:39:05 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-2fe52383-5967-483e-a326-3805caa5b393 tempest-VolumesTransfersV355Test-369531010 None] Created reservations ['64a00a98-c1aa-4faf-9ee2-fcfd6c63f3da', 'e8b34a6a-4bb9-4db6-a075-72513d05905d', '3a6e3ae3-60bf-4502-8476-f5617fc48d2e', '2db9b04e-2f7b-47ec-8613-98f5c7c32b31'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:39:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2fe52383-5967-483e-a326-3805caa5b393 tempest-VolumesTransfersV355Test-369531010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2fe52383-5967-483e-a326-3805caa5b393 tempest-VolumesTransfersV355Test-369531010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:05 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2fe52383-5967-483e-a326-3805caa5b393 tempest-VolumesTransfersV355Test-369531010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:39:05 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2fe52383-5967-483e-a326-3805caa5b393 tempest-VolumesTransfersV355Test-369531010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:39:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2fe52383-5967-483e-a326-3805caa5b393 tempest-VolumesTransfersV355Test-369531010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2fe52383-5967-483e-a326-3805caa5b393 tempest-VolumesTransfersV355Test-369531010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:05 devstack sudo[95237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:39:05 devstack sudo[95237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:05 devstack sudo[95233]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-696e0d62-4c49-4d54-ae1d-bd075d682693 tempest-VolumesExtendTest-568362243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d.1f6f1674-2610-4af8-be6b-703aaa62c180" returned: 0 in 0.732s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-696e0d62-4c49-4d54-ae1d-bd075d682693 tempest-VolumesExtendTest-568362243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:06 devstack sudo[95239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d.info Jul 08 01:39:06 devstack sudo[95239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:06 devstack sudo[95237]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2fe52383-5967-483e-a326-3805caa5b393 tempest-VolumesTransfersV355Test-369531010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.774s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:06 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-2fe52383-5967-483e-a326-3805caa5b393 tempest-VolumesTransfersV355Test-369531010 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:39:06 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-2fe52383-5967-483e-a326-3805caa5b393 tempest-VolumesTransfersV355Test-369531010 None] Deleted volume successfully. Jul 08 01:39:06 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2fe52383-5967-483e-a326-3805caa5b393 tempest-VolumesTransfersV355Test-369531010 None] Lock "cinder-a6fb015b-4263-456c-9ecc-96ef482bcbd1-delete_volume" released by "delete_volume" :: held 2.662s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:39:06 devstack sudo[95239]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-696e0d62-4c49-4d54-ae1d-bd075d682693 tempest-VolumesExtendTest-568362243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d.info" returned: 0 in 0.795s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:06 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-696e0d62-4c49-4d54-ae1d-bd075d682693 tempest-VolumesExtendTest-568362243 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d.info is being set with open permissions: ugo+rw Jul 08 01:39:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-696e0d62-4c49-4d54-ae1d-bd075d682693 tempest-VolumesExtendTest-568362243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:06 devstack sudo[95243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d.info Jul 08 01:39:06 devstack sudo[95243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:07 devstack sudo[95243]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-696e0d62-4c49-4d54-ae1d-bd075d682693 tempest-VolumesExtendTest-568362243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d.info" returned: 0 in 0.774s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-696e0d62-4c49-4d54-ae1d-bd075d682693 tempest-VolumesExtendTest-568362243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c54a8a3a-88eb-4ab8-9b4c-49a76e878b76 tempest-AttachVolumeNegativeTest-1884741045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.029s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:07 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c54a8a3a-88eb-4ab8-9b4c-49a76e878b76 tempest-AttachVolumeNegativeTest-1884741045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-991650572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cf1dc8e-a1a6-4fd1-a222-1d0e82849437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b132a62bc75f428690d4a973fa99e0a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:39:02Z,use_quota=True,user_id='321acf045e5e4ab099b9a076a97db13e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:39:07 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-c54a8a3a-88eb-4ab8-9b4c-49a76e878b76 tempest-AttachVolumeNegativeTest-1884741045 None] Creating volume 0cf1dc8e-a1a6-4fd1-a222-1d0e82849437 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:39:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c54a8a3a-88eb-4ab8-9b4c-49a76e878b76 tempest-AttachVolumeNegativeTest-1884741045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c54a8a3a-88eb-4ab8-9b4c-49a76e878b76 tempest-AttachVolumeNegativeTest-1884741045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:07 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c54a8a3a-88eb-4ab8-9b4c-49a76e878b76 tempest-AttachVolumeNegativeTest-1884741045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:39:07 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c54a8a3a-88eb-4ab8-9b4c-49a76e878b76 tempest-AttachVolumeNegativeTest-1884741045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:39:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c54a8a3a-88eb-4ab8-9b4c-49a76e878b76 tempest-AttachVolumeNegativeTest-1884741045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:07 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c54a8a3a-88eb-4ab8-9b4c-49a76e878b76 tempest-AttachVolumeNegativeTest-1884741045 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:39:07 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-c54a8a3a-88eb-4ab8-9b4c-49a76e878b76 tempest-AttachVolumeNegativeTest-1884741045 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:39:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c54a8a3a-88eb-4ab8-9b4c-49a76e878b76 tempest-AttachVolumeNegativeTest-1884741045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0cf1dc8e-a1a6-4fd1-a222-1d0e82849437 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:07 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:UPDATE=80,cinder:SELECT=65,cinder:INSERT=22,cinder:DELETE=6 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:39:07 devstack sudo[95270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0cf1dc8e-a1a6-4fd1-a222-1d0e82849437 1073741824 Jul 08 01:39:07 devstack sudo[95270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:07 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-696e0d62-4c49-4d54-ae1d-bd075d682693 tempest-VolumesExtendTest-568362243 None] Create snapshot completed successfully Jul 08 01:39:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b55d6984-4fab-4623-917e-a2429c8e41b2 tempest-VolumesExtendTest-568362243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:08 devstack sudo[95270]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c54a8a3a-88eb-4ab8-9b4c-49a76e878b76 tempest-AttachVolumeNegativeTest-1884741045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0cf1dc8e-a1a6-4fd1-a222-1d0e82849437 1073741824" returned: 0 in 1.131s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:08 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=72,cinder:UPDATE=72,cinder:INSERT=24,cinder:DELETE=8 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:39:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c54a8a3a-88eb-4ab8-9b4c-49a76e878b76 tempest-AttachVolumeNegativeTest-1884741045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0cf1dc8e-a1a6-4fd1-a222-1d0e82849437 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:08 devstack sudo[95276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0cf1dc8e-a1a6-4fd1-a222-1d0e82849437 Jul 08 01:39:08 devstack sudo[95276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:09 devstack sudo[95276]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c54a8a3a-88eb-4ab8-9b4c-49a76e878b76 tempest-AttachVolumeNegativeTest-1884741045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0cf1dc8e-a1a6-4fd1-a222-1d0e82849437" returned: 0 in 0.861s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:09 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c54a8a3a-88eb-4ab8-9b4c-49a76e878b76 tempest-AttachVolumeNegativeTest-1884741045 None] <== create_volume: return (2059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:39:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c54a8a3a-88eb-4ab8-9b4c-49a76e878b76 tempest-AttachVolumeNegativeTest-1884741045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.064s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b55d6984-4fab-4623-917e-a2429c8e41b2 tempest-VolumesExtendTest-568362243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.061s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:09 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c54a8a3a-88eb-4ab8-9b4c-49a76e878b76 tempest-AttachVolumeNegativeTest-1884741045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b3ab474-016e-49d8-9967-5c50d97048af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cf1dc8e-a1a6-4fd1-a222-1d0e82849437', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:09 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c54a8a3a-88eb-4ab8-9b4c-49a76e878b76 tempest-AttachVolumeNegativeTest-1884741045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edb8b186-0be9-4876-8784-c6d5aab48ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:09 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7b2f00-0451-4114-9165-82034d368cd7]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:39:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b55d6984-4fab-4623-917e-a2429c8e41b2 tempest-VolumesExtendTest-568362243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:09 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-c54a8a3a-88eb-4ab8-9b4c-49a76e878b76 tempest-AttachVolumeNegativeTest-1884741045 None] Volume volume-0cf1dc8e-a1a6-4fd1-a222-1d0e82849437 (0cf1dc8e-a1a6-4fd1-a222-1d0e82849437): created successfully Jul 08 01:39:09 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c54a8a3a-88eb-4ab8-9b4c-49a76e878b76 tempest-AttachVolumeNegativeTest-1884741045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edb8b186-0be9-4876-8784-c6d5aab48ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:09 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c54a8a3a-88eb-4ab8-9b4c-49a76e878b76 tempest-AttachVolumeNegativeTest-1884741045 None] Flow 'volume_create_manager' (42f613df-395c-4858-9673-1f8517618e6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:39:09 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-c54a8a3a-88eb-4ab8-9b4c-49a76e878b76 tempest-AttachVolumeNegativeTest-1884741045 None] Created volume successfully. Jul 08 01:39:09 devstack sudo[95279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d Jul 08 01:39:09 devstack sudo[95279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:10 devstack sudo[95279]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b55d6984-4fab-4623-917e-a2429c8e41b2 tempest-VolumesExtendTest-568362243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d" returned: 0 in 1.037s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b55d6984-4fab-4623-917e-a2429c8e41b2 tempest-VolumesExtendTest-568362243 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d.1f6f1674-2610-4af8-be6b-703aaa62c180 2G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b55d6984-4fab-4623-917e-a2429c8e41b2 tempest-VolumesExtendTest-568362243 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d.1f6f1674-2610-4af8-be6b-703aaa62c180 2G" returned: 0 in 0.149s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b55d6984-4fab-4623-917e-a2429c8e41b2 tempest-VolumesExtendTest-568362243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.260s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:10 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-b55d6984-4fab-4623-917e-a2429c8e41b2 tempest-VolumesExtendTest-568362243 None] Extend volume completed successfully. Jul 08 01:39:11 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-549ae054-2a6d-4e68-8ee4-5391ae295d22 tempest-VolumesExtendTest-568362243 None] Acquiring lock "cinder-1f6f1674-2610-4af8-be6b-703aaa62c180-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:39:11 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-549ae054-2a6d-4e68-8ee4-5391ae295d22 tempest-VolumesExtendTest-568362243 None] Lock "cinder-1f6f1674-2610-4af8-be6b-703aaa62c180-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:39:11 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-549ae054-2a6d-4e68-8ee4-5391ae295d22 tempest-VolumesExtendTest-568362243 None] Acquiring lock "cinder-quobyte-f0d17dba-cc40-4a05-8277-908b9aeb3d8d" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:39:11 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-549ae054-2a6d-4e68-8ee4-5391ae295d22 tempest-VolumesExtendTest-568362243 None] Lock "cinder-quobyte-f0d17dba-cc40-4a05-8277-908b9aeb3d8d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:39:11 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-549ae054-2a6d-4e68-8ee4-5391ae295d22 tempest-VolumesExtendTest-568362243 None] Acquiring lock "cinder-quobyte-1f6f1674-2610-4af8-be6b-703aaa62c180" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:39:12 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-549ae054-2a6d-4e68-8ee4-5391ae295d22 tempest-VolumesExtendTest-568362243 None] Lock "cinder-quobyte-1f6f1674-2610-4af8-be6b-703aaa62c180" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:39:12 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-549ae054-2a6d-4e68-8ee4-5391ae295d22 tempest-VolumesExtendTest-568362243 None] Deleting offline snapshot 1f6f1674-2610-4af8-be6b-703aaa62c180 of volume f0d17dba-cc40-4a05-8277-908b9aeb3d8d {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:39:12 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-549ae054-2a6d-4e68-8ee4-5391ae295d22 tempest-VolumesExtendTest-568362243 None] snapshot_file for this snap is: volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d.1f6f1674-2610-4af8-be6b-703aaa62c180 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:39:12 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[f389d15a-8382-4ecb-939b-ed1ef70a0de1]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:39:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-549ae054-2a6d-4e68-8ee4-5391ae295d22 tempest-VolumesExtendTest-568362243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d.1f6f1674-2610-4af8-be6b-703aaa62c180 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:12 devstack sudo[95291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d.1f6f1674-2610-4af8-be6b-703aaa62c180 Jul 08 01:39:12 devstack sudo[95291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:12 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-69edfeba-71da-42ba-9bce-a890b666c009 tempest-VolumesListTestJSON-282243222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:39:12 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-69edfeba-71da-42ba-9bce-a890b666c009 tempest-VolumesListTestJSON-282243222 None] Flow 'volume_create_manager' (5ec705fb-76a3-4e5a-97c3-014e199f8946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:39:12 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-69edfeba-71da-42ba-9bce-a890b666c009 tempest-VolumesListTestJSON-282243222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3f54b52-81e2-437c-8760-20607ae1b417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:12 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-69edfeba-71da-42ba-9bce-a890b666c009 tempest-VolumesListTestJSON-282243222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3f54b52-81e2-437c-8760-20607ae1b417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-283221363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c4f42fa-a1d0-4b0e-8f2f-837b391ccbaa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='10986a6e54d54d15a8a284c87a5d64fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:39:13Z,use_quota=True,user_id='9af27a5c87e54764b77f97c9b4dccfc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:12 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-69edfeba-71da-42ba-9bce-a890b666c009 tempest-VolumesListTestJSON-282243222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db3441c2-cee9-41cb-828d-1bd5250509f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:12 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-69edfeba-71da-42ba-9bce-a890b666c009 tempest-VolumesListTestJSON-282243222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db3441c2-cee9-41cb-828d-1bd5250509f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:12 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-69edfeba-71da-42ba-9bce-a890b666c009 tempest-VolumesListTestJSON-282243222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2675c60a-c5c5-49da-941d-ab467cd58b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:12 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-69edfeba-71da-42ba-9bce-a890b666c009 tempest-VolumesListTestJSON-282243222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2675c60a-c5c5-49da-941d-ab467cd58b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c4f42fa-a1d0-4b0e-8f2f-837b391ccbaa', 'volume_name': 'volume-6c4f42fa-a1d0-4b0e-8f2f-837b391ccbaa', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:12 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-69edfeba-71da-42ba-9bce-a890b666c009 tempest-VolumesListTestJSON-282243222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81fafc2b-ffb0-42f9-ba8d-d07b247a2584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:12 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-69edfeba-71da-42ba-9bce-a890b666c009 tempest-VolumesListTestJSON-282243222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81fafc2b-ffb0-42f9-ba8d-d07b247a2584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:12 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-69edfeba-71da-42ba-9bce-a890b666c009 tempest-VolumesListTestJSON-282243222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30388d21-dee5-4b1c-b8f2-e3b2c7fc5336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:12 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-69edfeba-71da-42ba-9bce-a890b666c009 tempest-VolumesListTestJSON-282243222 None] Volume 6c4f42fa-a1d0-4b0e-8f2f-837b391ccbaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c4f42fa-a1d0-4b0e-8f2f-837b391ccbaa', 'volume_size': 1} Jul 08 01:39:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-69edfeba-71da-42ba-9bce-a890b666c009 tempest-VolumesListTestJSON-282243222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-69edfeba-71da-42ba-9bce-a890b666c009 tempest-VolumesListTestJSON-282243222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:12 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-69edfeba-71da-42ba-9bce-a890b666c009 tempest-VolumesListTestJSON-282243222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-283221363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c4f42fa-a1d0-4b0e-8f2f-837b391ccbaa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='10986a6e54d54d15a8a284c87a5d64fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:39:13Z,use_quota=True,user_id='9af27a5c87e54764b77f97c9b4dccfc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:39:12 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-69edfeba-71da-42ba-9bce-a890b666c009 tempest-VolumesListTestJSON-282243222 None] Creating volume 6c4f42fa-a1d0-4b0e-8f2f-837b391ccbaa {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:39:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-69edfeba-71da-42ba-9bce-a890b666c009 tempest-VolumesListTestJSON-282243222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-69edfeba-71da-42ba-9bce-a890b666c009 tempest-VolumesListTestJSON-282243222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:12 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-69edfeba-71da-42ba-9bce-a890b666c009 tempest-VolumesListTestJSON-282243222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:39:12 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-69edfeba-71da-42ba-9bce-a890b666c009 tempest-VolumesListTestJSON-282243222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:39:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-69edfeba-71da-42ba-9bce-a890b666c009 tempest-VolumesListTestJSON-282243222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:12 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-69edfeba-71da-42ba-9bce-a890b666c009 tempest-VolumesListTestJSON-282243222 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:39:12 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-69edfeba-71da-42ba-9bce-a890b666c009 tempest-VolumesListTestJSON-282243222 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:39:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-69edfeba-71da-42ba-9bce-a890b666c009 tempest-VolumesListTestJSON-282243222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6c4f42fa-a1d0-4b0e-8f2f-837b391ccbaa 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:12 devstack sudo[95294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6c4f42fa-a1d0-4b0e-8f2f-837b391ccbaa 1073741824 Jul 08 01:39:12 devstack sudo[95294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:12 devstack sudo[95291]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-549ae054-2a6d-4e68-8ee4-5391ae295d22 tempest-VolumesExtendTest-568362243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d.1f6f1674-2610-4af8-be6b-703aaa62c180" returned: 0 in 0.892s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:12 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-549ae054-2a6d-4e68-8ee4-5391ae295d22 tempest-VolumesExtendTest-568362243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:39:12 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48c541a-598c-417b-abe7-62d49d2c0149]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:39:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-549ae054-2a6d-4e68-8ee4-5391ae295d22 tempest-VolumesExtendTest-568362243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-efb42fb1-9666-44ce-a554-2b341eb68ec9 req-cf35cff3-de32-4209-905c-aefdbff1885a tempest-AttachVolumeNegativeTest-1884741045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:13 devstack sudo[95307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d Jul 08 01:39:13 devstack sudo[95307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:13 devstack sudo[95294]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-69edfeba-71da-42ba-9bce-a890b666c009 tempest-VolumesListTestJSON-282243222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6c4f42fa-a1d0-4b0e-8f2f-837b391ccbaa 1073741824" returned: 0 in 0.941s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-69edfeba-71da-42ba-9bce-a890b666c009 tempest-VolumesListTestJSON-282243222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6c4f42fa-a1d0-4b0e-8f2f-837b391ccbaa {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:13 devstack sudo[95316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6c4f42fa-a1d0-4b0e-8f2f-837b391ccbaa Jul 08 01:39:13 devstack sudo[95316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:13 devstack sudo[95307]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-549ae054-2a6d-4e68-8ee4-5391ae295d22 tempest-VolumesExtendTest-568362243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d" returned: 0 in 0.864s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-549ae054-2a6d-4e68-8ee4-5391ae295d22 tempest-VolumesExtendTest-568362243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d.1f6f1674-2610-4af8-be6b-703aaa62c180 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:13 devstack sudo[95319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d.1f6f1674-2610-4af8-be6b-703aaa62c180 Jul 08 01:39:13 devstack sudo[95319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:14 devstack sudo[95316]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-69edfeba-71da-42ba-9bce-a890b666c009 tempest-VolumesListTestJSON-282243222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6c4f42fa-a1d0-4b0e-8f2f-837b391ccbaa" returned: 0 in 0.687s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:14 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-69edfeba-71da-42ba-9bce-a890b666c009 tempest-VolumesListTestJSON-282243222 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:39:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-69edfeba-71da-42ba-9bce-a890b666c009 tempest-VolumesListTestJSON-282243222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-efb42fb1-9666-44ce-a554-2b341eb68ec9 req-cf35cff3-de32-4209-905c-aefdbff1885a tempest-AttachVolumeNegativeTest-1884741045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.315s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:14 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-69edfeba-71da-42ba-9bce-a890b666c009 tempest-VolumesListTestJSON-282243222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30388d21-dee5-4b1c-b8f2-e3b2c7fc5336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c4f42fa-a1d0-4b0e-8f2f-837b391ccbaa', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:14 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-69edfeba-71da-42ba-9bce-a890b666c009 tempest-VolumesListTestJSON-282243222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f5b5e4f-b660-4e77-8265-8cd1146ee6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:14 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a56f8e-84af-42c8-8d5f-e2c834a3dbda]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:39:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-efb42fb1-9666-44ce-a554-2b341eb68ec9 req-cf35cff3-de32-4209-905c-aefdbff1885a tempest-AttachVolumeNegativeTest-1884741045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0cf1dc8e-a1a6-4fd1-a222-1d0e82849437 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:14 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-69edfeba-71da-42ba-9bce-a890b666c009 tempest-VolumesListTestJSON-282243222 None] Volume volume-6c4f42fa-a1d0-4b0e-8f2f-837b391ccbaa (6c4f42fa-a1d0-4b0e-8f2f-837b391ccbaa): created successfully Jul 08 01:39:14 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-69edfeba-71da-42ba-9bce-a890b666c009 tempest-VolumesListTestJSON-282243222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f5b5e4f-b660-4e77-8265-8cd1146ee6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:14 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-69edfeba-71da-42ba-9bce-a890b666c009 tempest-VolumesListTestJSON-282243222 None] Flow 'volume_create_manager' (5ec705fb-76a3-4e5a-97c3-014e199f8946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:39:14 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-69edfeba-71da-42ba-9bce-a890b666c009 tempest-VolumesListTestJSON-282243222 None] Created volume successfully. Jul 08 01:39:14 devstack sudo[95324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0cf1dc8e-a1a6-4fd1-a222-1d0e82849437 Jul 08 01:39:14 devstack sudo[95324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:14 devstack sudo[95319]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-549ae054-2a6d-4e68-8ee4-5391ae295d22 tempest-VolumesExtendTest-568362243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d.1f6f1674-2610-4af8-be6b-703aaa62c180" returned: 0 in 0.887s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-549ae054-2a6d-4e68-8ee4-5391ae295d22 tempest-VolumesExtendTest-568362243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d.1f6f1674-2610-4af8-be6b-703aaa62c180 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:14 devstack sudo[95329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d.1f6f1674-2610-4af8-be6b-703aaa62c180 Jul 08 01:39:14 devstack sudo[95329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:15 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-23e0ae71-2818-488f-9ab8-3456b29ae31d tempest-VolumesListTestJSON-282243222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:39:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-23e0ae71-2818-488f-9ab8-3456b29ae31d tempest-VolumesListTestJSON-282243222 None] Flow 'volume_create_manager' (755613a1-ede6-4863-ae87-a6eef1fdc6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:39:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-23e0ae71-2818-488f-9ab8-3456b29ae31d tempest-VolumesListTestJSON-282243222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (223a136a-0da6-4421-a114-cfc1c5e995d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-23e0ae71-2818-488f-9ab8-3456b29ae31d tempest-VolumesListTestJSON-282243222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (223a136a-0da6-4421-a114-cfc1c5e995d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-654568072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26bd1a6f-8ef3-408e-81f5-58878977b4b5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='10986a6e54d54d15a8a284c87a5d64fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:39:15Z,use_quota=True,user_id='9af27a5c87e54764b77f97c9b4dccfc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-23e0ae71-2818-488f-9ab8-3456b29ae31d tempest-VolumesListTestJSON-282243222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdf27046-26e9-439a-a575-f9603ba6e164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-23e0ae71-2818-488f-9ab8-3456b29ae31d tempest-VolumesListTestJSON-282243222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdf27046-26e9-439a-a575-f9603ba6e164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-23e0ae71-2818-488f-9ab8-3456b29ae31d tempest-VolumesListTestJSON-282243222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff4c3d97-9ecf-4578-8de2-71349acaf5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-23e0ae71-2818-488f-9ab8-3456b29ae31d tempest-VolumesListTestJSON-282243222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff4c3d97-9ecf-4578-8de2-71349acaf5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26bd1a6f-8ef3-408e-81f5-58878977b4b5', 'volume_name': 'volume-26bd1a6f-8ef3-408e-81f5-58878977b4b5', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-23e0ae71-2818-488f-9ab8-3456b29ae31d tempest-VolumesListTestJSON-282243222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6306f59-edb2-48e7-86b6-3050b15fdb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-23e0ae71-2818-488f-9ab8-3456b29ae31d tempest-VolumesListTestJSON-282243222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6306f59-edb2-48e7-86b6-3050b15fdb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-23e0ae71-2818-488f-9ab8-3456b29ae31d tempest-VolumesListTestJSON-282243222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfd4478a-5937-45a9-8c0e-2b9b24154de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:15 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-23e0ae71-2818-488f-9ab8-3456b29ae31d tempest-VolumesListTestJSON-282243222 None] Volume 26bd1a6f-8ef3-408e-81f5-58878977b4b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26bd1a6f-8ef3-408e-81f5-58878977b4b5', 'volume_size': 1} Jul 08 01:39:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-23e0ae71-2818-488f-9ab8-3456b29ae31d tempest-VolumesListTestJSON-282243222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:15 devstack sudo[95324]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-efb42fb1-9666-44ce-a554-2b341eb68ec9 req-cf35cff3-de32-4209-905c-aefdbff1885a tempest-AttachVolumeNegativeTest-1884741045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0cf1dc8e-a1a6-4fd1-a222-1d0e82849437" returned: 0 in 1.140s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-efb42fb1-9666-44ce-a554-2b341eb68ec9 req-cf35cff3-de32-4209-905c-aefdbff1885a tempest-AttachVolumeNegativeTest-1884741045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.172s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-23e0ae71-2818-488f-9ab8-3456b29ae31d tempest-VolumesListTestJSON-282243222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:15 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-23e0ae71-2818-488f-9ab8-3456b29ae31d tempest-VolumesListTestJSON-282243222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-654568072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26bd1a6f-8ef3-408e-81f5-58878977b4b5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='10986a6e54d54d15a8a284c87a5d64fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:39:15Z,use_quota=True,user_id='9af27a5c87e54764b77f97c9b4dccfc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:39:15 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-23e0ae71-2818-488f-9ab8-3456b29ae31d tempest-VolumesListTestJSON-282243222 None] Creating volume 26bd1a6f-8ef3-408e-81f5-58878977b4b5 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:39:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-23e0ae71-2818-488f-9ab8-3456b29ae31d tempest-VolumesListTestJSON-282243222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-23e0ae71-2818-488f-9ab8-3456b29ae31d tempest-VolumesListTestJSON-282243222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:15 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-23e0ae71-2818-488f-9ab8-3456b29ae31d tempest-VolumesListTestJSON-282243222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:39:15 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-23e0ae71-2818-488f-9ab8-3456b29ae31d tempest-VolumesListTestJSON-282243222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:39:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-23e0ae71-2818-488f-9ab8-3456b29ae31d tempest-VolumesListTestJSON-282243222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:15 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-23e0ae71-2818-488f-9ab8-3456b29ae31d tempest-VolumesListTestJSON-282243222 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:39:15 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-23e0ae71-2818-488f-9ab8-3456b29ae31d tempest-VolumesListTestJSON-282243222 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:39:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-23e0ae71-2818-488f-9ab8-3456b29ae31d tempest-VolumesListTestJSON-282243222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-26bd1a6f-8ef3-408e-81f5-58878977b4b5 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:15 devstack sudo[95329]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-549ae054-2a6d-4e68-8ee4-5391ae295d22 tempest-VolumesExtendTest-568362243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d.1f6f1674-2610-4af8-be6b-703aaa62c180" returned: 0 in 0.863s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:15 devstack sudo[95335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-26bd1a6f-8ef3-408e-81f5-58878977b4b5 1073741824 Jul 08 01:39:15 devstack sudo[95335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:15 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-549ae054-2a6d-4e68-8ee4-5391ae295d22 tempest-VolumesExtendTest-568362243 None] Lock "cinder-quobyte-1f6f1674-2610-4af8-be6b-703aaa62c180" released by "_delete_snapshot" :: held 3.656s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:39:15 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-549ae054-2a6d-4e68-8ee4-5391ae295d22 tempest-VolumesExtendTest-568362243 None] Lock "cinder-quobyte-f0d17dba-cc40-4a05-8277-908b9aeb3d8d" released by "delete_snapshot" :: held 3.681s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:39:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-efb42fb1-9666-44ce-a554-2b341eb68ec9 req-cf35cff3-de32-4209-905c-aefdbff1885a tempest-AttachVolumeNegativeTest-1884741045 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96', 'name': 'volume-0cf1dc8e-a1a6-4fd1-a222-1d0e82849437', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9e246e77-ccc5-49fe-98f1-74a5e543da4b', 'enforce_multipath': True} {{(pid=87284) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:39:15 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-549ae054-2a6d-4e68-8ee4-5391ae295d22 tempest-VolumesExtendTest-568362243 None] Created reservations ['c4f253ce-1663-4cf6-a6a8-a7ffbe81c3bd', '8c546fb2-aa12-4db2-9a43-ee614bcd202c', '086bc1ef-bbb3-4ba7-99fa-c392f072a540', '18665b8e-11f5-4163-9573-fccb0422f6e4'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:39:15 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-efb42fb1-9666-44ce-a554-2b341eb68ec9 req-cf35cff3-de32-4209-905c-aefdbff1885a tempest-AttachVolumeNegativeTest-1884741045 None] attachment_update completed successfully. Jul 08 01:39:15 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-549ae054-2a6d-4e68-8ee4-5391ae295d22 tempest-VolumesExtendTest-568362243 None] Delete snapshot completed successfully. Jul 08 01:39:15 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-549ae054-2a6d-4e68-8ee4-5391ae295d22 tempest-VolumesExtendTest-568362243 None] Lock "cinder-1f6f1674-2610-4af8-be6b-703aaa62c180-delete_snapshot" released by "delete_snapshot" :: held 3.846s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:39:16 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-7c47e59d-79b6-47e0-8e38-5d7cc0c874b6 tempest-VolumesExtendTest-568362243 None] Acquiring lock "cinder-f0d17dba-cc40-4a05-8277-908b9aeb3d8d-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:39:16 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-7c47e59d-79b6-47e0-8e38-5d7cc0c874b6 tempest-VolumesExtendTest-568362243 None] Lock "cinder-f0d17dba-cc40-4a05-8277-908b9aeb3d8d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:39:16 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-7c47e59d-79b6-47e0-8e38-5d7cc0c874b6 tempest-VolumesExtendTest-568362243 None] Acquiring lock "cinder-quobyte-f0d17dba-cc40-4a05-8277-908b9aeb3d8d" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:39:16 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-7c47e59d-79b6-47e0-8e38-5d7cc0c874b6 tempest-VolumesExtendTest-568362243 None] Lock "cinder-quobyte-f0d17dba-cc40-4a05-8277-908b9aeb3d8d" acquired by "delete_volume" :: waited 0.021s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:39:16 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40e8bb8-0012-4ce5-9201-0c20a9b96644]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:39:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7c47e59d-79b6-47e0-8e38-5d7cc0c874b6 tempest-VolumesExtendTest-568362243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:16 devstack sudo[95335]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-23e0ae71-2818-488f-9ab8-3456b29ae31d tempest-VolumesListTestJSON-282243222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-26bd1a6f-8ef3-408e-81f5-58878977b4b5 1073741824" returned: 0 in 1.023s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-23e0ae71-2818-488f-9ab8-3456b29ae31d tempest-VolumesListTestJSON-282243222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-26bd1a6f-8ef3-408e-81f5-58878977b4b5 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:16 devstack sudo[95341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d Jul 08 01:39:16 devstack sudo[95341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:16 devstack sudo[95343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-26bd1a6f-8ef3-408e-81f5-58878977b4b5 Jul 08 01:39:16 devstack sudo[95343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:17 devstack sudo[95343]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-23e0ae71-2818-488f-9ab8-3456b29ae31d tempest-VolumesListTestJSON-282243222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-26bd1a6f-8ef3-408e-81f5-58878977b4b5" returned: 0 in 0.701s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:17 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-23e0ae71-2818-488f-9ab8-3456b29ae31d tempest-VolumesListTestJSON-282243222 None] <== create_volume: return (1788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:39:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-23e0ae71-2818-488f-9ab8-3456b29ae31d tempest-VolumesListTestJSON-282243222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:17 devstack sudo[95341]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:17 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-23e0ae71-2818-488f-9ab8-3456b29ae31d tempest-VolumesListTestJSON-282243222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfd4478a-5937-45a9-8c0e-2b9b24154de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26bd1a6f-8ef3-408e-81f5-58878977b4b5', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:17 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-23e0ae71-2818-488f-9ab8-3456b29ae31d tempest-VolumesListTestJSON-282243222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03e142c0-2d8f-424d-a962-bd42fa5e7662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7c47e59d-79b6-47e0-8e38-5d7cc0c874b6 tempest-VolumesExtendTest-568362243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d" returned: 0 in 0.881s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7c47e59d-79b6-47e0-8e38-5d7cc0c874b6 tempest-VolumesExtendTest-568362243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:17 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-23e0ae71-2818-488f-9ab8-3456b29ae31d tempest-VolumesListTestJSON-282243222 None] Volume volume-26bd1a6f-8ef3-408e-81f5-58878977b4b5 (26bd1a6f-8ef3-408e-81f5-58878977b4b5): created successfully Jul 08 01:39:17 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-23e0ae71-2818-488f-9ab8-3456b29ae31d tempest-VolumesListTestJSON-282243222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03e142c0-2d8f-424d-a962-bd42fa5e7662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:17 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-23e0ae71-2818-488f-9ab8-3456b29ae31d tempest-VolumesListTestJSON-282243222 None] Flow 'volume_create_manager' (755613a1-ede6-4863-ae87-a6eef1fdc6cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:39:17 devstack sudo[95355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d Jul 08 01:39:17 devstack sudo[95355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:17 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-23e0ae71-2818-488f-9ab8-3456b29ae31d tempest-VolumesListTestJSON-282243222 None] Created volume successfully. Jul 08 01:39:18 devstack sudo[95355]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7c47e59d-79b6-47e0-8e38-5d7cc0c874b6 tempest-VolumesExtendTest-568362243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0d17dba-cc40-4a05-8277-908b9aeb3d8d" returned: 0 in 0.669s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:18 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-7c47e59d-79b6-47e0-8e38-5d7cc0c874b6 tempest-VolumesExtendTest-568362243 None] Lock "cinder-quobyte-f0d17dba-cc40-4a05-8277-908b9aeb3d8d" released by "delete_volume" :: held 1.646s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:39:18 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-7c47e59d-79b6-47e0-8e38-5d7cc0c874b6 tempest-VolumesExtendTest-568362243 None] Created reservations ['adaefdda-ea55-4473-b233-bb44f5ff5392', '64e9ec7d-c650-4252-a753-3d574bc426b3', '531d8b39-4540-49d0-b66e-98b700d36dd2', '1e5b02c4-f4af-4940-9093-dfa7da32aa80'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:39:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-7c47e59d-79b6-47e0-8e38-5d7cc0c874b6 tempest-VolumesExtendTest-568362243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-7c47e59d-79b6-47e0-8e38-5d7cc0c874b6 tempest-VolumesExtendTest-568362243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:18 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-7c47e59d-79b6-47e0-8e38-5d7cc0c874b6 tempest-VolumesExtendTest-568362243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:39:18 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-7c47e59d-79b6-47e0-8e38-5d7cc0c874b6 tempest-VolumesExtendTest-568362243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:39:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-7c47e59d-79b6-47e0-8e38-5d7cc0c874b6 tempest-VolumesExtendTest-568362243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7c47e59d-79b6-47e0-8e38-5d7cc0c874b6 tempest-VolumesExtendTest-568362243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:18 devstack sudo[95374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:39:18 devstack sudo[95374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:19 devstack sudo[95374]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7c47e59d-79b6-47e0-8e38-5d7cc0c874b6 tempest-VolumesExtendTest-568362243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.790s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:19 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-7c47e59d-79b6-47e0-8e38-5d7cc0c874b6 tempest-VolumesExtendTest-568362243 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:39:19 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-7c47e59d-79b6-47e0-8e38-5d7cc0c874b6 tempest-VolumesExtendTest-568362243 None] Deleted volume successfully. Jul 08 01:39:19 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-7c47e59d-79b6-47e0-8e38-5d7cc0c874b6 tempest-VolumesExtendTest-568362243 None] Lock "cinder-f0d17dba-cc40-4a05-8277-908b9aeb3d8d-delete_volume" released by "delete_volume" :: held 2.689s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:39:19 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-591230a0-4bf2-4303-b0ee-e833fe424e4e tempest-VolumesListTestJSON-282243222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:39:19 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-591230a0-4bf2-4303-b0ee-e833fe424e4e tempest-VolumesListTestJSON-282243222 None] Flow 'volume_create_manager' (f3e41a42-9313-4ae9-9054-a596acc90cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:39:19 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-591230a0-4bf2-4303-b0ee-e833fe424e4e tempest-VolumesListTestJSON-282243222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f645c928-94ed-47c5-9943-8c6bd435c650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:19 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-591230a0-4bf2-4303-b0ee-e833fe424e4e tempest-VolumesListTestJSON-282243222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f645c928-94ed-47c5-9943-8c6bd435c650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-532722204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0bda3e8-14a3-44fd-84ed-7f7e4feca154,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='10986a6e54d54d15a8a284c87a5d64fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:39:19Z,use_quota=True,user_id='9af27a5c87e54764b77f97c9b4dccfc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:19 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-591230a0-4bf2-4303-b0ee-e833fe424e4e tempest-VolumesListTestJSON-282243222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07541b6c-701e-434b-a6c7-4048a487a7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:19 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-591230a0-4bf2-4303-b0ee-e833fe424e4e tempest-VolumesListTestJSON-282243222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07541b6c-701e-434b-a6c7-4048a487a7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:19 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-591230a0-4bf2-4303-b0ee-e833fe424e4e tempest-VolumesListTestJSON-282243222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a7d2b52-3f14-409b-9143-75107e5c8320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:19 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-591230a0-4bf2-4303-b0ee-e833fe424e4e tempest-VolumesListTestJSON-282243222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a7d2b52-3f14-409b-9143-75107e5c8320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0bda3e8-14a3-44fd-84ed-7f7e4feca154', 'volume_name': 'volume-f0bda3e8-14a3-44fd-84ed-7f7e4feca154', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:19 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-591230a0-4bf2-4303-b0ee-e833fe424e4e tempest-VolumesListTestJSON-282243222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b609f59e-c088-4607-bfe5-41bfc89c40d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:19 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-591230a0-4bf2-4303-b0ee-e833fe424e4e tempest-VolumesListTestJSON-282243222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b609f59e-c088-4607-bfe5-41bfc89c40d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:19 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-591230a0-4bf2-4303-b0ee-e833fe424e4e tempest-VolumesListTestJSON-282243222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (797c0cf6-65a7-4640-b2b2-fd7445499bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:19 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-591230a0-4bf2-4303-b0ee-e833fe424e4e tempest-VolumesListTestJSON-282243222 None] Volume f0bda3e8-14a3-44fd-84ed-7f7e4feca154: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0bda3e8-14a3-44fd-84ed-7f7e4feca154', 'volume_size': 1} Jul 08 01:39:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-591230a0-4bf2-4303-b0ee-e833fe424e4e tempest-VolumesListTestJSON-282243222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-591230a0-4bf2-4303-b0ee-e833fe424e4e tempest-VolumesListTestJSON-282243222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:19 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-591230a0-4bf2-4303-b0ee-e833fe424e4e tempest-VolumesListTestJSON-282243222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-532722204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0bda3e8-14a3-44fd-84ed-7f7e4feca154,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='10986a6e54d54d15a8a284c87a5d64fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:39:19Z,use_quota=True,user_id='9af27a5c87e54764b77f97c9b4dccfc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:39:19 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-591230a0-4bf2-4303-b0ee-e833fe424e4e tempest-VolumesListTestJSON-282243222 None] Creating volume f0bda3e8-14a3-44fd-84ed-7f7e4feca154 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:39:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-591230a0-4bf2-4303-b0ee-e833fe424e4e tempest-VolumesListTestJSON-282243222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-591230a0-4bf2-4303-b0ee-e833fe424e4e tempest-VolumesListTestJSON-282243222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:19 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-591230a0-4bf2-4303-b0ee-e833fe424e4e tempest-VolumesListTestJSON-282243222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:39:19 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-591230a0-4bf2-4303-b0ee-e833fe424e4e tempest-VolumesListTestJSON-282243222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:39:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-591230a0-4bf2-4303-b0ee-e833fe424e4e tempest-VolumesListTestJSON-282243222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:19 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-591230a0-4bf2-4303-b0ee-e833fe424e4e tempest-VolumesListTestJSON-282243222 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:39:19 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-591230a0-4bf2-4303-b0ee-e833fe424e4e tempest-VolumesListTestJSON-282243222 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:39:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-591230a0-4bf2-4303-b0ee-e833fe424e4e tempest-VolumesListTestJSON-282243222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0bda3e8-14a3-44fd-84ed-7f7e4feca154 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:19 devstack sudo[95388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0bda3e8-14a3-44fd-84ed-7f7e4feca154 1073741824 Jul 08 01:39:19 devstack sudo[95388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:21 devstack sudo[95388]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-591230a0-4bf2-4303-b0ee-e833fe424e4e tempest-VolumesListTestJSON-282243222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0bda3e8-14a3-44fd-84ed-7f7e4feca154 1073741824" returned: 0 in 1.451s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-591230a0-4bf2-4303-b0ee-e833fe424e4e tempest-VolumesListTestJSON-282243222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0bda3e8-14a3-44fd-84ed-7f7e4feca154 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:21 devstack sudo[95396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0bda3e8-14a3-44fd-84ed-7f7e4feca154 Jul 08 01:39:21 devstack sudo[95396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:22 devstack sudo[95396]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-591230a0-4bf2-4303-b0ee-e833fe424e4e tempest-VolumesListTestJSON-282243222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0bda3e8-14a3-44fd-84ed-7f7e4feca154" returned: 0 in 0.918s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:22 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-591230a0-4bf2-4303-b0ee-e833fe424e4e tempest-VolumesListTestJSON-282243222 None] <== create_volume: return (2462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:39:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-591230a0-4bf2-4303-b0ee-e833fe424e4e tempest-VolumesListTestJSON-282243222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.465s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-591230a0-4bf2-4303-b0ee-e833fe424e4e tempest-VolumesListTestJSON-282243222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (797c0cf6-65a7-4640-b2b2-fd7445499bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0bda3e8-14a3-44fd-84ed-7f7e4feca154', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-591230a0-4bf2-4303-b0ee-e833fe424e4e tempest-VolumesListTestJSON-282243222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a0654bc-5e17-404d-b697-c7fdaa70c84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:22 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-591230a0-4bf2-4303-b0ee-e833fe424e4e tempest-VolumesListTestJSON-282243222 None] Volume volume-f0bda3e8-14a3-44fd-84ed-7f7e4feca154 (f0bda3e8-14a3-44fd-84ed-7f7e4feca154): created successfully Jul 08 01:39:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-591230a0-4bf2-4303-b0ee-e833fe424e4e tempest-VolumesListTestJSON-282243222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a0654bc-5e17-404d-b697-c7fdaa70c84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-591230a0-4bf2-4303-b0ee-e833fe424e4e tempest-VolumesListTestJSON-282243222 None] Flow 'volume_create_manager' (f3e41a42-9313-4ae9-9054-a596acc90cef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:39:22 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-591230a0-4bf2-4303-b0ee-e833fe424e4e tempest-VolumesListTestJSON-282243222 None] Created volume successfully. Jul 08 01:39:26 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-8e53dfa0-7685-400b-8cbe-fd76e16e4e44 tempest-VolumesListTestJSON-282243222 None] Acquiring lock "cinder-f0bda3e8-14a3-44fd-84ed-7f7e4feca154-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:39:26 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-8e53dfa0-7685-400b-8cbe-fd76e16e4e44 tempest-VolumesListTestJSON-282243222 None] Lock "cinder-f0bda3e8-14a3-44fd-84ed-7f7e4feca154-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:39:26 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-8e53dfa0-7685-400b-8cbe-fd76e16e4e44 tempest-VolumesListTestJSON-282243222 None] Acquiring lock "cinder-quobyte-f0bda3e8-14a3-44fd-84ed-7f7e4feca154" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:39:26 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-8e53dfa0-7685-400b-8cbe-fd76e16e4e44 tempest-VolumesListTestJSON-282243222 None] Lock "cinder-quobyte-f0bda3e8-14a3-44fd-84ed-7f7e4feca154" acquired by "delete_volume" :: waited 0.038s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:39:26 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacb2d74-5ebd-405d-b408-c5d150299856]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:39:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8e53dfa0-7685-400b-8cbe-fd76e16e4e44 tempest-VolumesListTestJSON-282243222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0bda3e8-14a3-44fd-84ed-7f7e4feca154 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:26 devstack sudo[95409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0bda3e8-14a3-44fd-84ed-7f7e4feca154 Jul 08 01:39:26 devstack sudo[95409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:27 devstack sudo[95409]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8e53dfa0-7685-400b-8cbe-fd76e16e4e44 tempest-VolumesListTestJSON-282243222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0bda3e8-14a3-44fd-84ed-7f7e4feca154" returned: 0 in 0.971s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8e53dfa0-7685-400b-8cbe-fd76e16e4e44 tempest-VolumesListTestJSON-282243222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0bda3e8-14a3-44fd-84ed-7f7e4feca154 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:27 devstack sudo[95416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0bda3e8-14a3-44fd-84ed-7f7e4feca154 Jul 08 01:39:27 devstack sudo[95416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:28 devstack sudo[95416]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8e53dfa0-7685-400b-8cbe-fd76e16e4e44 tempest-VolumesListTestJSON-282243222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-f0bda3e8-14a3-44fd-84ed-7f7e4feca154" returned: 0 in 0.842s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:28 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-8e53dfa0-7685-400b-8cbe-fd76e16e4e44 tempest-VolumesListTestJSON-282243222 None] Lock "cinder-quobyte-f0bda3e8-14a3-44fd-84ed-7f7e4feca154" released by "delete_volume" :: held 1.885s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:39:28 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-8e53dfa0-7685-400b-8cbe-fd76e16e4e44 tempest-VolumesListTestJSON-282243222 None] Created reservations ['3d287713-6835-4d05-b772-faf093fffa00', '5c9b4d6a-b966-4224-9417-19aec2e9b3ff', '81286a07-01da-44d8-b972-e0f241a342f7', '710b7e17-6da1-41fa-88a3-39b73fb966b8'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:39:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8e53dfa0-7685-400b-8cbe-fd76e16e4e44 tempest-VolumesListTestJSON-282243222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8e53dfa0-7685-400b-8cbe-fd76e16e4e44 tempest-VolumesListTestJSON-282243222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:28 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-8e53dfa0-7685-400b-8cbe-fd76e16e4e44 tempest-VolumesListTestJSON-282243222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:39:28 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-8e53dfa0-7685-400b-8cbe-fd76e16e4e44 tempest-VolumesListTestJSON-282243222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:39:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8e53dfa0-7685-400b-8cbe-fd76e16e4e44 tempest-VolumesListTestJSON-282243222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8e53dfa0-7685-400b-8cbe-fd76e16e4e44 tempest-VolumesListTestJSON-282243222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:28 devstack sudo[95453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:39:28 devstack sudo[95453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:28 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-721b7b7d-dee4-42cb-b567-e4e7b7549117 tempest-VolumesListTestJSON-282243222 None] Acquiring lock "cinder-26bd1a6f-8ef3-408e-81f5-58878977b4b5-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:39:28 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-721b7b7d-dee4-42cb-b567-e4e7b7549117 tempest-VolumesListTestJSON-282243222 None] Lock "cinder-26bd1a6f-8ef3-408e-81f5-58878977b4b5-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:39:28 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-721b7b7d-dee4-42cb-b567-e4e7b7549117 tempest-VolumesListTestJSON-282243222 None] Acquiring lock "cinder-quobyte-26bd1a6f-8ef3-408e-81f5-58878977b4b5" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:39:28 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-721b7b7d-dee4-42cb-b567-e4e7b7549117 tempest-VolumesListTestJSON-282243222 None] Lock "cinder-quobyte-26bd1a6f-8ef3-408e-81f5-58878977b4b5" acquired by "delete_volume" :: waited 0.024s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:39:28 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[2758f8a7-73a1-4639-92fc-59c9a9dfeb1b]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:39:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-721b7b7d-dee4-42cb-b567-e4e7b7549117 tempest-VolumesListTestJSON-282243222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-26bd1a6f-8ef3-408e-81f5-58878977b4b5 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:29 devstack sudo[95457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-26bd1a6f-8ef3-408e-81f5-58878977b4b5 Jul 08 01:39:29 devstack sudo[95457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:29 devstack sudo[95453]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8e53dfa0-7685-400b-8cbe-fd76e16e4e44 tempest-VolumesListTestJSON-282243222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.243s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:29 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-8e53dfa0-7685-400b-8cbe-fd76e16e4e44 tempest-VolumesListTestJSON-282243222 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:39:29 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-8e53dfa0-7685-400b-8cbe-fd76e16e4e44 tempest-VolumesListTestJSON-282243222 None] Deleted volume successfully. Jul 08 01:39:29 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-8e53dfa0-7685-400b-8cbe-fd76e16e4e44 tempest-VolumesListTestJSON-282243222 None] Lock "cinder-f0bda3e8-14a3-44fd-84ed-7f7e4feca154-delete_volume" released by "delete_volume" :: held 3.595s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:39:30 devstack sudo[95457]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-721b7b7d-dee4-42cb-b567-e4e7b7549117 tempest-VolumesListTestJSON-282243222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-26bd1a6f-8ef3-408e-81f5-58878977b4b5" returned: 0 in 1.097s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-721b7b7d-dee4-42cb-b567-e4e7b7549117 tempest-VolumesListTestJSON-282243222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-26bd1a6f-8ef3-408e-81f5-58878977b4b5 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:30 devstack sudo[95464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-26bd1a6f-8ef3-408e-81f5-58878977b4b5 Jul 08 01:39:30 devstack sudo[95464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:31 devstack sudo[95464]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-721b7b7d-dee4-42cb-b567-e4e7b7549117 tempest-VolumesListTestJSON-282243222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-26bd1a6f-8ef3-408e-81f5-58878977b4b5" returned: 0 in 1.494s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:31 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-721b7b7d-dee4-42cb-b567-e4e7b7549117 tempest-VolumesListTestJSON-282243222 None] Lock "cinder-quobyte-26bd1a6f-8ef3-408e-81f5-58878977b4b5" released by "delete_volume" :: held 2.674s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:39:31 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-721b7b7d-dee4-42cb-b567-e4e7b7549117 tempest-VolumesListTestJSON-282243222 None] Created reservations ['729e4b33-945a-4848-a369-6fb11d356708', '80cdf27e-da4e-45f4-9d5b-9fb7e5d52b83', 'fe670f10-5465-4834-b5f5-a2b4ca5c1f82', '5b3bd03a-9a19-43d7-84ab-096ee5b30ca0'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:39:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-721b7b7d-dee4-42cb-b567-e4e7b7549117 tempest-VolumesListTestJSON-282243222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-721b7b7d-dee4-42cb-b567-e4e7b7549117 tempest-VolumesListTestJSON-282243222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:31 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-721b7b7d-dee4-42cb-b567-e4e7b7549117 tempest-VolumesListTestJSON-282243222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:39:31 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-721b7b7d-dee4-42cb-b567-e4e7b7549117 tempest-VolumesListTestJSON-282243222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:39:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-721b7b7d-dee4-42cb-b567-e4e7b7549117 tempest-VolumesListTestJSON-282243222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-721b7b7d-dee4-42cb-b567-e4e7b7549117 tempest-VolumesListTestJSON-282243222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:31 devstack sudo[95467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:39:31 devstack sudo[95467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:32 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-87b70d1f-2e48-4457-8781-edbc0df28726 tempest-VolumesListTestJSON-282243222 None] Acquiring lock "cinder-6c4f42fa-a1d0-4b0e-8f2f-837b391ccbaa-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:39:32 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-87b70d1f-2e48-4457-8781-edbc0df28726 tempest-VolumesListTestJSON-282243222 None] Lock "cinder-6c4f42fa-a1d0-4b0e-8f2f-837b391ccbaa-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:39:32 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-87b70d1f-2e48-4457-8781-edbc0df28726 tempest-VolumesListTestJSON-282243222 None] Acquiring lock "cinder-quobyte-6c4f42fa-a1d0-4b0e-8f2f-837b391ccbaa" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:39:32 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-87b70d1f-2e48-4457-8781-edbc0df28726 tempest-VolumesListTestJSON-282243222 None] Lock "cinder-quobyte-6c4f42fa-a1d0-4b0e-8f2f-837b391ccbaa" acquired by "delete_volume" :: waited 0.029s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:39:32 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae95edc-4ec5-45d0-a586-c96ae7231463]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:39:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-87b70d1f-2e48-4457-8781-edbc0df28726 tempest-VolumesListTestJSON-282243222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6c4f42fa-a1d0-4b0e-8f2f-837b391ccbaa {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:32 devstack sudo[95476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6c4f42fa-a1d0-4b0e-8f2f-837b391ccbaa Jul 08 01:39:32 devstack sudo[95476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:33 devstack sudo[95467]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-721b7b7d-dee4-42cb-b567-e4e7b7549117 tempest-VolumesListTestJSON-282243222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.410s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:33 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-721b7b7d-dee4-42cb-b567-e4e7b7549117 tempest-VolumesListTestJSON-282243222 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:39:33 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-721b7b7d-dee4-42cb-b567-e4e7b7549117 tempest-VolumesListTestJSON-282243222 None] Deleted volume successfully. Jul 08 01:39:33 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-721b7b7d-dee4-42cb-b567-e4e7b7549117 tempest-VolumesListTestJSON-282243222 None] Lock "cinder-26bd1a6f-8ef3-408e-81f5-58878977b4b5-delete_volume" released by "delete_volume" :: held 4.503s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:39:34 devstack sudo[95476]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-87b70d1f-2e48-4457-8781-edbc0df28726 tempest-VolumesListTestJSON-282243222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6c4f42fa-a1d0-4b0e-8f2f-837b391ccbaa" returned: 0 in 1.362s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-87b70d1f-2e48-4457-8781-edbc0df28726 tempest-VolumesListTestJSON-282243222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6c4f42fa-a1d0-4b0e-8f2f-837b391ccbaa {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:34 devstack sudo[95499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6c4f42fa-a1d0-4b0e-8f2f-837b391ccbaa Jul 08 01:39:34 devstack sudo[95499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:34 devstack sudo[95499]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-87b70d1f-2e48-4457-8781-edbc0df28726 tempest-VolumesListTestJSON-282243222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6c4f42fa-a1d0-4b0e-8f2f-837b391ccbaa" returned: 0 in 0.900s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:35 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-87b70d1f-2e48-4457-8781-edbc0df28726 tempest-VolumesListTestJSON-282243222 None] Lock "cinder-quobyte-6c4f42fa-a1d0-4b0e-8f2f-837b391ccbaa" released by "delete_volume" :: held 2.323s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:39:35 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-87b70d1f-2e48-4457-8781-edbc0df28726 tempest-VolumesListTestJSON-282243222 None] Created reservations ['c39f2ee4-1053-404a-907a-49256358fc6b', '9f98273e-5fc6-4b17-95ed-ce81a99171a8', 'b500fc30-4e95-4f55-a2ed-48060a0cdceb', '204d8285-e4ac-47ba-bd2f-2427d2312371'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:39:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-87b70d1f-2e48-4457-8781-edbc0df28726 tempest-VolumesListTestJSON-282243222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-87b70d1f-2e48-4457-8781-edbc0df28726 tempest-VolumesListTestJSON-282243222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:35 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-87b70d1f-2e48-4457-8781-edbc0df28726 tempest-VolumesListTestJSON-282243222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:39:35 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-87b70d1f-2e48-4457-8781-edbc0df28726 tempest-VolumesListTestJSON-282243222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:39:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-87b70d1f-2e48-4457-8781-edbc0df28726 tempest-VolumesListTestJSON-282243222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-87b70d1f-2e48-4457-8781-edbc0df28726 tempest-VolumesListTestJSON-282243222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:35 devstack sudo[95503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:39:35 devstack sudo[95503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:36 devstack sudo[95503]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-87b70d1f-2e48-4457-8781-edbc0df28726 tempest-VolumesListTestJSON-282243222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.881s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:36 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-87b70d1f-2e48-4457-8781-edbc0df28726 tempest-VolumesListTestJSON-282243222 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:39:36 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-87b70d1f-2e48-4457-8781-edbc0df28726 tempest-VolumesListTestJSON-282243222 None] Deleted volume successfully. Jul 08 01:39:36 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-87b70d1f-2e48-4457-8781-edbc0df28726 tempest-VolumesListTestJSON-282243222 None] Lock "cinder-6c4f42fa-a1d0-4b0e-8f2f-837b391ccbaa-delete_volume" released by "delete_volume" :: held 3.480s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:39:38 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e20c0cf-453f-47e8-8406-8f5fe45f7df4 tempest-VolumesSnapshotTestJSON-538859610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:39:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5e20c0cf-453f-47e8-8406-8f5fe45f7df4 tempest-VolumesSnapshotTestJSON-538859610 None] Flow 'volume_create_manager' (e67186ef-3dac-4f52-bf6f-72ab99976964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:39:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5e20c0cf-453f-47e8-8406-8f5fe45f7df4 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb416ac1-284e-4076-8fec-57dedef9ab57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5e20c0cf-453f-47e8-8406-8f5fe45f7df4 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb416ac1-284e-4076-8fec-57dedef9ab57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-111189255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d90040a-f015-437d-b3ea-f07a3c980759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c25e1aa98c3045b6a87d7233ca8c49b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:39:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:39:39Z,use_quota=True,user_id='1c49d16162e446838c57af096485520f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5e20c0cf-453f-47e8-8406-8f5fe45f7df4 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39225c91-ea70-4e33-8863-6f73c9a5f372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5e20c0cf-453f-47e8-8406-8f5fe45f7df4 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39225c91-ea70-4e33-8863-6f73c9a5f372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5e20c0cf-453f-47e8-8406-8f5fe45f7df4 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7595a8fd-0777-428e-aeda-996a600bf288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5e20c0cf-453f-47e8-8406-8f5fe45f7df4 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7595a8fd-0777-428e-aeda-996a600bf288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d90040a-f015-437d-b3ea-f07a3c980759', 'volume_name': 'volume-2d90040a-f015-437d-b3ea-f07a3c980759', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5e20c0cf-453f-47e8-8406-8f5fe45f7df4 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ed9e8b1-c4f5-477a-9ac0-ac039ee57a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5e20c0cf-453f-47e8-8406-8f5fe45f7df4 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ed9e8b1-c4f5-477a-9ac0-ac039ee57a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5e20c0cf-453f-47e8-8406-8f5fe45f7df4 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f716b05-16d4-4c7d-8967-bf0eee9bd430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:39 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-5e20c0cf-453f-47e8-8406-8f5fe45f7df4 tempest-VolumesSnapshotTestJSON-538859610 None] Volume 2d90040a-f015-437d-b3ea-f07a3c980759: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d90040a-f015-437d-b3ea-f07a3c980759', 'volume_size': 1} Jul 08 01:39:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5e20c0cf-453f-47e8-8406-8f5fe45f7df4 tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5e20c0cf-453f-47e8-8406-8f5fe45f7df4 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:39 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5e20c0cf-453f-47e8-8406-8f5fe45f7df4 tempest-VolumesSnapshotTestJSON-538859610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-111189255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d90040a-f015-437d-b3ea-f07a3c980759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c25e1aa98c3045b6a87d7233ca8c49b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:39:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:39:39Z,use_quota=True,user_id='1c49d16162e446838c57af096485520f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:39:39 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-5e20c0cf-453f-47e8-8406-8f5fe45f7df4 tempest-VolumesSnapshotTestJSON-538859610 None] Creating volume 2d90040a-f015-437d-b3ea-f07a3c980759 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:39:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5e20c0cf-453f-47e8-8406-8f5fe45f7df4 tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5e20c0cf-453f-47e8-8406-8f5fe45f7df4 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:39 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5e20c0cf-453f-47e8-8406-8f5fe45f7df4 tempest-VolumesSnapshotTestJSON-538859610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:39:39 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5e20c0cf-453f-47e8-8406-8f5fe45f7df4 tempest-VolumesSnapshotTestJSON-538859610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:39:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5e20c0cf-453f-47e8-8406-8f5fe45f7df4 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:39 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5e20c0cf-453f-47e8-8406-8f5fe45f7df4 tempest-VolumesSnapshotTestJSON-538859610 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:39:39 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-5e20c0cf-453f-47e8-8406-8f5fe45f7df4 tempest-VolumesSnapshotTestJSON-538859610 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:39:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5e20c0cf-453f-47e8-8406-8f5fe45f7df4 tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:39 devstack sudo[95509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759 1073741824 Jul 08 01:39:39 devstack sudo[95509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:40 devstack sudo[95509]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:40 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-56e0916e-a78e-457b-a471-6df788943de3 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:39:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-56e0916e-a78e-457b-a471-6df788943de3 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Flow 'volume_create_manager' (39434623-6c2f-4a0d-8e0e-b4adc23f85a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:39:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-56e0916e-a78e-457b-a471-6df788943de3 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8098026-2041-4111-b4e3-4e4dcb258744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5e20c0cf-453f-47e8-8406-8f5fe45f7df4 tempest-VolumesSnapshotTestJSON-538859610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759 1073741824" returned: 0 in 1.309s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-56e0916e-a78e-457b-a471-6df788943de3 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8098026-2041-4111-b4e3-4e4dcb258744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:39:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1604060612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84241e2b-b301-49e3-be1e-1ab3889026d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9dc263132594a72b1f992b66a051bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:39:40Z,use_quota=True,user_id='3c28a86e02534b4fbafdc4f696837662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-56e0916e-a78e-457b-a471-6df788943de3 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0865591e-a18f-4e93-b208-db6c9198f329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-56e0916e-a78e-457b-a471-6df788943de3 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0865591e-a18f-4e93-b208-db6c9198f329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-56e0916e-a78e-457b-a471-6df788943de3 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71cdec7d-6917-4011-8636-1ce08875d463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-56e0916e-a78e-457b-a471-6df788943de3 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71cdec7d-6917-4011-8636-1ce08875d463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84241e2b-b301-49e3-be1e-1ab3889026d6', 'volume_name': 'volume-84241e2b-b301-49e3-be1e-1ab3889026d6', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-56e0916e-a78e-457b-a471-6df788943de3 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (256540ed-80d1-4538-b892-4e23729ef815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-56e0916e-a78e-457b-a471-6df788943de3 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (256540ed-80d1-4538-b892-4e23729ef815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-56e0916e-a78e-457b-a471-6df788943de3 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d12f0181-ad21-4da4-aabe-2a964bbb0456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:40 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-56e0916e-a78e-457b-a471-6df788943de3 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Volume 84241e2b-b301-49e3-be1e-1ab3889026d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84241e2b-b301-49e3-be1e-1ab3889026d6', 'volume_size': 1} Jul 08 01:39:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-56e0916e-a78e-457b-a471-6df788943de3 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5e20c0cf-453f-47e8-8406-8f5fe45f7df4 tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:40 devstack sudo[95531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759 Jul 08 01:39:40 devstack sudo[95531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:41 devstack sudo[95531]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5e20c0cf-453f-47e8-8406-8f5fe45f7df4 tempest-VolumesSnapshotTestJSON-538859610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759" returned: 0 in 0.781s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:41 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5e20c0cf-453f-47e8-8406-8f5fe45f7df4 tempest-VolumesSnapshotTestJSON-538859610 None] <== create_volume: return (2200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:39:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5e20c0cf-453f-47e8-8406-8f5fe45f7df4 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.202s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-56e0916e-a78e-457b-a471-6df788943de3 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.823s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:41 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-56e0916e-a78e-457b-a471-6df788943de3 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:39:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1604060612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84241e2b-b301-49e3-be1e-1ab3889026d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9dc263132594a72b1f992b66a051bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:39:40Z,use_quota=True,user_id='3c28a86e02534b4fbafdc4f696837662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:39:41 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-56e0916e-a78e-457b-a471-6df788943de3 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Creating volume 84241e2b-b301-49e3-be1e-1ab3889026d6 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:39:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-56e0916e-a78e-457b-a471-6df788943de3 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-56e0916e-a78e-457b-a471-6df788943de3 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:41 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-56e0916e-a78e-457b-a471-6df788943de3 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:39:41 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-56e0916e-a78e-457b-a471-6df788943de3 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:39:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-56e0916e-a78e-457b-a471-6df788943de3 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:41 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-56e0916e-a78e-457b-a471-6df788943de3 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:39:41 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-56e0916e-a78e-457b-a471-6df788943de3 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:39:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-56e0916e-a78e-457b-a471-6df788943de3 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-84241e2b-b301-49e3-be1e-1ab3889026d6 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:41 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5e20c0cf-453f-47e8-8406-8f5fe45f7df4 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f716b05-16d4-4c7d-8967-bf0eee9bd430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d90040a-f015-437d-b3ea-f07a3c980759', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:41 devstack sudo[95557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-84241e2b-b301-49e3-be1e-1ab3889026d6 1073741824 Jul 08 01:39:41 devstack sudo[95557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:41 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5e20c0cf-453f-47e8-8406-8f5fe45f7df4 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b0938c9-d60e-4ec6-b009-af79fd92f9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:41 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-5e20c0cf-453f-47e8-8406-8f5fe45f7df4 tempest-VolumesSnapshotTestJSON-538859610 None] Volume volume-2d90040a-f015-437d-b3ea-f07a3c980759 (2d90040a-f015-437d-b3ea-f07a3c980759): created successfully Jul 08 01:39:41 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5e20c0cf-453f-47e8-8406-8f5fe45f7df4 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b0938c9-d60e-4ec6-b009-af79fd92f9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:41 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5e20c0cf-453f-47e8-8406-8f5fe45f7df4 tempest-VolumesSnapshotTestJSON-538859610 None] Flow 'volume_create_manager' (e67186ef-3dac-4f52-bf6f-72ab99976964) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:39:41 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-5e20c0cf-453f-47e8-8406-8f5fe45f7df4 tempest-VolumesSnapshotTestJSON-538859610 None] Created volume successfully. Jul 08 01:39:42 devstack sudo[95557]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-56e0916e-a78e-457b-a471-6df788943de3 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-84241e2b-b301-49e3-be1e-1ab3889026d6 1073741824" returned: 0 in 1.119s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-56e0916e-a78e-457b-a471-6df788943de3 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-84241e2b-b301-49e3-be1e-1ab3889026d6 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:42 devstack sudo[95572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-84241e2b-b301-49e3-be1e-1ab3889026d6 Jul 08 01:39:42 devstack sudo[95572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-140650d3-81f5-4c13-8267-fe6525852acd tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:43 devstack sudo[95572]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-56e0916e-a78e-457b-a471-6df788943de3 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-84241e2b-b301-49e3-be1e-1ab3889026d6" returned: 0 in 0.834s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:43 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-56e0916e-a78e-457b-a471-6df788943de3 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] <== create_volume: return (2066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:39:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-56e0916e-a78e-457b-a471-6df788943de3 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.069s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-140650d3-81f5-4c13-8267-fe6525852acd tempest-VolumesSnapshotTestJSON-538859610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.793s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:43 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-140650d3-81f5-4c13-8267-fe6525852acd tempest-VolumesSnapshotTestJSON-538859610 None] Creating offline snapshot ce0f5671-8094-4e7a-aee9-0978b96b9ed3 of volume 2d90040a-f015-437d-b3ea-f07a3c980759 {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:39:43 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-56e0916e-a78e-457b-a471-6df788943de3 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d12f0181-ad21-4da4-aabe-2a964bbb0456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84241e2b-b301-49e3-be1e-1ab3889026d6', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:43 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-56e0916e-a78e-457b-a471-6df788943de3 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (493d7826-ffe9-4cc3-83cf-1496ceeb857c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:43 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[69748eb6-e7de-498d-86c2-c1baa3e2e43d]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:39:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-140650d3-81f5-4c13-8267-fe6525852acd tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:43 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-56e0916e-a78e-457b-a471-6df788943de3 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Volume volume-84241e2b-b301-49e3-be1e-1ab3889026d6 (84241e2b-b301-49e3-be1e-1ab3889026d6): created successfully Jul 08 01:39:43 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-56e0916e-a78e-457b-a471-6df788943de3 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (493d7826-ffe9-4cc3-83cf-1496ceeb857c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:43 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-56e0916e-a78e-457b-a471-6df788943de3 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Flow 'volume_create_manager' (39434623-6c2f-4a0d-8e0e-b4adc23f85a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:39:43 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-56e0916e-a78e-457b-a471-6df788943de3 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Created volume successfully. Jul 08 01:39:43 devstack sudo[95586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759 Jul 08 01:39:43 devstack sudo[95586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:44 devstack sudo[95586]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-140650d3-81f5-4c13-8267-fe6525852acd tempest-VolumesSnapshotTestJSON-538859610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759" returned: 0 in 1.087s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-140650d3-81f5-4c13-8267-fe6525852acd tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759.ce0f5671-8094-4e7a-aee9-0978b96b9ed3 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:44 devstack sudo[95594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759.ce0f5671-8094-4e7a-aee9-0978b96b9ed3 1G Jul 08 01:39:44 devstack sudo[95594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:45 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c2a7efa-8301-4480-b0ad-fd1d02c088de tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:39:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5c2a7efa-8301-4480-b0ad-fd1d02c088de tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Flow 'volume_create_manager' (0271edb0-5b0b-4e9a-b40c-d45f8926f0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:39:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5c2a7efa-8301-4480-b0ad-fd1d02c088de tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67082b2d-f5ae-4eb5-9dda-64b66e07b74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5c2a7efa-8301-4480-b0ad-fd1d02c088de tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67082b2d-f5ae-4eb5-9dda-64b66e07b74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:39:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1951332891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4e33f6b-e2ce-4512-8bf0-c163153e6ea4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9dc263132594a72b1f992b66a051bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:39:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:39:46Z,use_quota=True,user_id='3c28a86e02534b4fbafdc4f696837662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5c2a7efa-8301-4480-b0ad-fd1d02c088de tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (680fbe11-2fda-4c8e-9f10-6a9d7c9e686a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5c2a7efa-8301-4480-b0ad-fd1d02c088de tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (680fbe11-2fda-4c8e-9f10-6a9d7c9e686a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5c2a7efa-8301-4480-b0ad-fd1d02c088de tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af010242-c392-4385-948a-5532193fdb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5c2a7efa-8301-4480-b0ad-fd1d02c088de tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af010242-c392-4385-948a-5532193fdb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4e33f6b-e2ce-4512-8bf0-c163153e6ea4', 'volume_name': 'volume-a4e33f6b-e2ce-4512-8bf0-c163153e6ea4', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5c2a7efa-8301-4480-b0ad-fd1d02c088de tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73f59756-7a9d-468f-bd5c-171bc9bfd446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5c2a7efa-8301-4480-b0ad-fd1d02c088de tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73f59756-7a9d-468f-bd5c-171bc9bfd446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5c2a7efa-8301-4480-b0ad-fd1d02c088de tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e963e9a7-b69d-4d20-a863-0342f10b78c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:45 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-5c2a7efa-8301-4480-b0ad-fd1d02c088de tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Volume a4e33f6b-e2ce-4512-8bf0-c163153e6ea4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4e33f6b-e2ce-4512-8bf0-c163153e6ea4', 'volume_size': 1} Jul 08 01:39:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5c2a7efa-8301-4480-b0ad-fd1d02c088de tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:45 devstack sudo[95594]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-140650d3-81f5-4c13-8267-fe6525852acd tempest-VolumesSnapshotTestJSON-538859610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759.ce0f5671-8094-4e7a-aee9-0978b96b9ed3 1G" returned: 0 in 1.474s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-140650d3-81f5-4c13-8267-fe6525852acd tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d90040a-f015-437d-b3ea-f07a3c980759 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759.ce0f5671-8094-4e7a-aee9-0978b96b9ed3 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:46 devstack sudo[95604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d90040a-f015-437d-b3ea-f07a3c980759 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759.ce0f5671-8094-4e7a-aee9-0978b96b9ed3 Jul 08 01:39:46 devstack sudo[95604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:46 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d95c408-2572-43c4-9cf1-966c980819b2 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:39:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5d95c408-2572-43c4-9cf1-966c980819b2 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Flow 'volume_create_manager' (09de1442-6b29-4e38-9518-745fedfd5421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:39:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5d95c408-2572-43c4-9cf1-966c980819b2 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbbd3187-1f11-4dfe-ace2-5638ddd3eaf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5d95c408-2572-43c4-9cf1-966c980819b2 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbbd3187-1f11-4dfe-ace2-5638ddd3eaf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1696093800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbc844dd-7e98-4aac-94e9-5cf39019ab5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9dc263132594a72b1f992b66a051bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:39:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:39:46Z,use_quota=True,user_id='3c28a86e02534b4fbafdc4f696837662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5d95c408-2572-43c4-9cf1-966c980819b2 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cfb0934-9aa2-4787-a5d6-d823e2898b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5d95c408-2572-43c4-9cf1-966c980819b2 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cfb0934-9aa2-4787-a5d6-d823e2898b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5d95c408-2572-43c4-9cf1-966c980819b2 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c27a7ff3-c0e4-4824-bddc-6a6abcef88d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5d95c408-2572-43c4-9cf1-966c980819b2 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c27a7ff3-c0e4-4824-bddc-6a6abcef88d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbc844dd-7e98-4aac-94e9-5cf39019ab5c', 'volume_name': 'volume-fbc844dd-7e98-4aac-94e9-5cf39019ab5c', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5d95c408-2572-43c4-9cf1-966c980819b2 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (664dcc69-0cb9-4995-97c8-71f8d103a684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5d95c408-2572-43c4-9cf1-966c980819b2 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (664dcc69-0cb9-4995-97c8-71f8d103a684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5d95c408-2572-43c4-9cf1-966c980819b2 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afcc646e-fc69-484c-826a-06f1e0452d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:46 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-5d95c408-2572-43c4-9cf1-966c980819b2 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Volume fbc844dd-7e98-4aac-94e9-5cf39019ab5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbc844dd-7e98-4aac-94e9-5cf39019ab5c', 'volume_size': 1} Jul 08 01:39:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5d95c408-2572-43c4-9cf1-966c980819b2 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:47 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e714486-c0bd-4321-be32-ffe778363116 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:39:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2e714486-c0bd-4321-be32-ffe778363116 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Flow 'volume_create_manager' (c1d3b252-9bd4-4409-b824-b0587730bcac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:39:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2e714486-c0bd-4321-be32-ffe778363116 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47a0cb9b-258a-44db-8a51-ee3c216d4dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:47 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-5864c1fc-0807-4bfc-a8b8-e7624610471e req-3f6ac169-6e1e-4f47-90ef-d2f91e435815 tempest-TestMinimumBasicScenario-176295214 None] Terminate volume connection completed successfully. Jul 08 01:39:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-5864c1fc-0807-4bfc-a8b8-e7624610471e req-3f6ac169-6e1e-4f47-90ef-d2f91e435815 tempest-TestMinimumBasicScenario-176295214 None] Deleting attachment 402fc5cd-daee-4470-97f7-111183649464. {{(pid=87284) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:39:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2e714486-c0bd-4321-be32-ffe778363116 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47a0cb9b-258a-44db-8a51-ee3c216d4dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-640696223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2dd3877-8e61-499b-b8d1-c47f352af324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9dc263132594a72b1f992b66a051bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:39:47Z,use_quota=True,user_id='3c28a86e02534b4fbafdc4f696837662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2e714486-c0bd-4321-be32-ffe778363116 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bcb8a45-4713-4586-8759-937184b65586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2e714486-c0bd-4321-be32-ffe778363116 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bcb8a45-4713-4586-8759-937184b65586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2e714486-c0bd-4321-be32-ffe778363116 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c39b7e3-9349-4a7f-b080-2993fdfa25c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2e714486-c0bd-4321-be32-ffe778363116 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c39b7e3-9349-4a7f-b080-2993fdfa25c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2dd3877-8e61-499b-b8d1-c47f352af324', 'volume_name': 'volume-a2dd3877-8e61-499b-b8d1-c47f352af324', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2e714486-c0bd-4321-be32-ffe778363116 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c703524-cc9c-486f-9243-3cac7448534f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2e714486-c0bd-4321-be32-ffe778363116 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c703524-cc9c-486f-9243-3cac7448534f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2e714486-c0bd-4321-be32-ffe778363116 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e79c270-02b8-4d41-8e1f-bab9bfe81625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:47 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-2e714486-c0bd-4321-be32-ffe778363116 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Volume a2dd3877-8e61-499b-b8d1-c47f352af324: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2dd3877-8e61-499b-b8d1-c47f352af324', 'volume_size': 1} Jul 08 01:39:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2e714486-c0bd-4321-be32-ffe778363116 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:47 devstack sudo[95604]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-140650d3-81f5-4c13-8267-fe6525852acd tempest-VolumesSnapshotTestJSON-538859610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d90040a-f015-437d-b3ea-f07a3c980759 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759.ce0f5671-8094-4e7a-aee9-0978b96b9ed3" returned: 0 in 1.805s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:47 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-140650d3-81f5-4c13-8267-fe6525852acd tempest-VolumesSnapshotTestJSON-538859610 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759.ce0f5671-8094-4e7a-aee9-0978b96b9ed3 is being set with open permissions: ugo+rw Jul 08 01:39:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-140650d3-81f5-4c13-8267-fe6525852acd tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759.ce0f5671-8094-4e7a-aee9-0978b96b9ed3 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:47 devstack sudo[95614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759.ce0f5671-8094-4e7a-aee9-0978b96b9ed3 Jul 08 01:39:47 devstack sudo[95614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:48 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c44ee70-7625-4075-b1ac-2a7ac084f662 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:39:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6c44ee70-7625-4075-b1ac-2a7ac084f662 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Flow 'volume_create_manager' (4ec1ad71-6213-4525-b802-b8b41a809ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:39:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6c44ee70-7625-4075-b1ac-2a7ac084f662 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a8b864b-8a59-4b11-9f46-2675571fe62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6c44ee70-7625-4075-b1ac-2a7ac084f662 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a8b864b-8a59-4b11-9f46-2675571fe62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-561753118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a1cfb5b-7a6f-4388-a989-632149336143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9dc263132594a72b1f992b66a051bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:39:48Z,use_quota=True,user_id='3c28a86e02534b4fbafdc4f696837662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6c44ee70-7625-4075-b1ac-2a7ac084f662 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac9ffb8e-5b20-4058-a745-5bb2f6731d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6c44ee70-7625-4075-b1ac-2a7ac084f662 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac9ffb8e-5b20-4058-a745-5bb2f6731d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6c44ee70-7625-4075-b1ac-2a7ac084f662 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e0650af-8b28-47c9-8626-12832d3f887a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6c44ee70-7625-4075-b1ac-2a7ac084f662 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e0650af-8b28-47c9-8626-12832d3f887a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a1cfb5b-7a6f-4388-a989-632149336143', 'volume_name': 'volume-9a1cfb5b-7a6f-4388-a989-632149336143', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6c44ee70-7625-4075-b1ac-2a7ac084f662 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (168fc46c-a2b9-4eca-98dc-ef23d048a57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6c44ee70-7625-4075-b1ac-2a7ac084f662 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (168fc46c-a2b9-4eca-98dc-ef23d048a57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6c44ee70-7625-4075-b1ac-2a7ac084f662 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cca885e3-7b51-4043-afbc-f3169687eee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:48 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-6c44ee70-7625-4075-b1ac-2a7ac084f662 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Volume 9a1cfb5b-7a6f-4388-a989-632149336143: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a1cfb5b-7a6f-4388-a989-632149336143', 'volume_size': 1} Jul 08 01:39:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6c44ee70-7625-4075-b1ac-2a7ac084f662 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:48 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dfe597f-e891-4821-804c-95380f4106d9 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:39:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0dfe597f-e891-4821-804c-95380f4106d9 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Flow 'volume_create_manager' (a2a42c2c-2daf-4f82-88ed-265c19043e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:39:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0dfe597f-e891-4821-804c-95380f4106d9 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5648c2aa-e919-41b6-bf5f-3583dd21465d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0dfe597f-e891-4821-804c-95380f4106d9 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5648c2aa-e919-41b6-bf5f-3583dd21465d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:39:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-329303344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab736969-78d7-455a-81e2-c9d3a021e12e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9dc263132594a72b1f992b66a051bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:39:49Z,use_quota=True,user_id='3c28a86e02534b4fbafdc4f696837662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0dfe597f-e891-4821-804c-95380f4106d9 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fb3e346-75ec-43ac-ac2e-b85af9b9abc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0dfe597f-e891-4821-804c-95380f4106d9 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fb3e346-75ec-43ac-ac2e-b85af9b9abc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0dfe597f-e891-4821-804c-95380f4106d9 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47ead59e-4692-4ce7-9be9-186acea54b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0dfe597f-e891-4821-804c-95380f4106d9 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47ead59e-4692-4ce7-9be9-186acea54b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab736969-78d7-455a-81e2-c9d3a021e12e', 'volume_name': 'volume-ab736969-78d7-455a-81e2-c9d3a021e12e', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0dfe597f-e891-4821-804c-95380f4106d9 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3593f4-8b4f-4c9b-97b7-f50286aeaa9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0dfe597f-e891-4821-804c-95380f4106d9 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3593f4-8b4f-4c9b-97b7-f50286aeaa9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0dfe597f-e891-4821-804c-95380f4106d9 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16bc985f-d1c9-48c3-8929-bf7d9915cad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:49 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-0dfe597f-e891-4821-804c-95380f4106d9 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Volume ab736969-78d7-455a-81e2-c9d3a021e12e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab736969-78d7-455a-81e2-c9d3a021e12e', 'volume_size': 1} Jul 08 01:39:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0dfe597f-e891-4821-804c-95380f4106d9 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:49 devstack sudo[95614]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-140650d3-81f5-4c13-8267-fe6525852acd tempest-VolumesSnapshotTestJSON-538859610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759.ce0f5671-8094-4e7a-aee9-0978b96b9ed3" returned: 0 in 1.430s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-140650d3-81f5-4c13-8267-fe6525852acd tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:49 devstack sudo[95619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759.info Jul 08 01:39:49 devstack sudo[95619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:49 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-22eafb5d-d711-45d7-906d-1a40f2ca4b40 tempest-TestMinimumBasicScenario-176295214 None] Acquiring lock "cinder-d33871f4-8d20-4910-b977-cb6b63faa17b-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:39:49 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-22eafb5d-d711-45d7-906d-1a40f2ca4b40 tempest-TestMinimumBasicScenario-176295214 None] Lock "cinder-d33871f4-8d20-4910-b977-cb6b63faa17b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:39:49 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-22eafb5d-d711-45d7-906d-1a40f2ca4b40 tempest-TestMinimumBasicScenario-176295214 None] Acquiring lock "cinder-quobyte-d33871f4-8d20-4910-b977-cb6b63faa17b" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:39:49 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-22eafb5d-d711-45d7-906d-1a40f2ca4b40 tempest-TestMinimumBasicScenario-176295214 None] Lock "cinder-quobyte-d33871f4-8d20-4910-b977-cb6b63faa17b" acquired by "delete_volume" :: waited 0.018s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:39:49 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[788ae1ad-c516-441b-aa47-c40a177dd688]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:39:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-22eafb5d-d711-45d7-906d-1a40f2ca4b40 tempest-TestMinimumBasicScenario-176295214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d33871f4-8d20-4910-b977-cb6b63faa17b {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:49 devstack sudo[95621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d33871f4-8d20-4910-b977-cb6b63faa17b Jul 08 01:39:49 devstack sudo[95621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:50 devstack sudo[95619]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-140650d3-81f5-4c13-8267-fe6525852acd tempest-VolumesSnapshotTestJSON-538859610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759.info" returned: 0 in 0.859s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:50 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-140650d3-81f5-4c13-8267-fe6525852acd tempest-VolumesSnapshotTestJSON-538859610 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759.info is being set with open permissions: ugo+rw Jul 08 01:39:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-140650d3-81f5-4c13-8267-fe6525852acd tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:50 devstack sudo[95626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759.info Jul 08 01:39:50 devstack sudo[95626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:50 devstack sudo[95621]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-22eafb5d-d711-45d7-906d-1a40f2ca4b40 tempest-TestMinimumBasicScenario-176295214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d33871f4-8d20-4910-b977-cb6b63faa17b" returned: 0 in 0.891s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-22eafb5d-d711-45d7-906d-1a40f2ca4b40 tempest-TestMinimumBasicScenario-176295214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d33871f4-8d20-4910-b977-cb6b63faa17b {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:50 devstack sudo[95629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d33871f4-8d20-4910-b977-cb6b63faa17b Jul 08 01:39:50 devstack sudo[95629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:51 devstack sudo[95626]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-140650d3-81f5-4c13-8267-fe6525852acd tempest-VolumesSnapshotTestJSON-538859610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759.info" returned: 0 in 0.847s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-140650d3-81f5-4c13-8267-fe6525852acd tempest-VolumesSnapshotTestJSON-538859610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.676s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5c2a7efa-8301-4480-b0ad-fd1d02c088de tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.173s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:51 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5c2a7efa-8301-4480-b0ad-fd1d02c088de tempest-CreateVolumesFromSourceVolumeTest-640514927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:39:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1951332891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4e33f6b-e2ce-4512-8bf0-c163153e6ea4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9dc263132594a72b1f992b66a051bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:39:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:39:46Z,use_quota=True,user_id='3c28a86e02534b4fbafdc4f696837662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:39:51 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-5c2a7efa-8301-4480-b0ad-fd1d02c088de tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Creating volume a4e33f6b-e2ce-4512-8bf0-c163153e6ea4 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:39:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5c2a7efa-8301-4480-b0ad-fd1d02c088de tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5c2a7efa-8301-4480-b0ad-fd1d02c088de tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:51 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5c2a7efa-8301-4480-b0ad-fd1d02c088de tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:39:51 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5c2a7efa-8301-4480-b0ad-fd1d02c088de tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:39:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5c2a7efa-8301-4480-b0ad-fd1d02c088de tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:51 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5c2a7efa-8301-4480-b0ad-fd1d02c088de tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:39:51 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-5c2a7efa-8301-4480-b0ad-fd1d02c088de tempest-CreateVolumesFromSourceVolumeTest-640514927 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:39:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5c2a7efa-8301-4480-b0ad-fd1d02c088de tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a4e33f6b-e2ce-4512-8bf0-c163153e6ea4 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:51 devstack sudo[95633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a4e33f6b-e2ce-4512-8bf0-c163153e6ea4 1073741824 Jul 08 01:39:51 devstack sudo[95633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:51 devstack sudo[95629]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-22eafb5d-d711-45d7-906d-1a40f2ca4b40 tempest-TestMinimumBasicScenario-176295214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d33871f4-8d20-4910-b977-cb6b63faa17b" returned: 0 in 0.786s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:51 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-140650d3-81f5-4c13-8267-fe6525852acd tempest-VolumesSnapshotTestJSON-538859610 None] Create snapshot completed successfully Jul 08 01:39:51 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-22eafb5d-d711-45d7-906d-1a40f2ca4b40 tempest-TestMinimumBasicScenario-176295214 None] Lock "cinder-quobyte-d33871f4-8d20-4910-b977-cb6b63faa17b" released by "delete_volume" :: held 1.724s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:39:51 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-22eafb5d-d711-45d7-906d-1a40f2ca4b40 tempest-TestMinimumBasicScenario-176295214 None] Created reservations ['f13fad26-2656-4675-8892-a6654b40dbcd', 'bd7e4966-ed9a-4837-b7be-59998f4f7037', '9aa9b59e-2c5a-4dca-bdc2-df9ee127e8ae', 'e13e14e3-c2c1-4b46-b00d-f48cba721ff8'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:39:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-22eafb5d-d711-45d7-906d-1a40f2ca4b40 tempest-TestMinimumBasicScenario-176295214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-22eafb5d-d711-45d7-906d-1a40f2ca4b40 tempest-TestMinimumBasicScenario-176295214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:51 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-22eafb5d-d711-45d7-906d-1a40f2ca4b40 tempest-TestMinimumBasicScenario-176295214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:39:51 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-22eafb5d-d711-45d7-906d-1a40f2ca4b40 tempest-TestMinimumBasicScenario-176295214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:39:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-22eafb5d-d711-45d7-906d-1a40f2ca4b40 tempest-TestMinimumBasicScenario-176295214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-22eafb5d-d711-45d7-906d-1a40f2ca4b40 tempest-TestMinimumBasicScenario-176295214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:51 devstack sudo[95635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:39:51 devstack sudo[95635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:51 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5714bd56-fdca-4883-b29b-4889a33ac541 tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "cinder-ce0f5671-8094-4e7a-aee9-0978b96b9ed3-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:39:51 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5714bd56-fdca-4883-b29b-4889a33ac541 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-ce0f5671-8094-4e7a-aee9-0978b96b9ed3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:39:51 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5714bd56-fdca-4883-b29b-4889a33ac541 tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "cinder-quobyte-2d90040a-f015-437d-b3ea-f07a3c980759" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:39:51 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5714bd56-fdca-4883-b29b-4889a33ac541 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-quobyte-2d90040a-f015-437d-b3ea-f07a3c980759" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:39:51 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5714bd56-fdca-4883-b29b-4889a33ac541 tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "cinder-quobyte-ce0f5671-8094-4e7a-aee9-0978b96b9ed3" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:39:51 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5714bd56-fdca-4883-b29b-4889a33ac541 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-quobyte-ce0f5671-8094-4e7a-aee9-0978b96b9ed3" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:39:51 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-5714bd56-fdca-4883-b29b-4889a33ac541 tempest-VolumesSnapshotTestJSON-538859610 None] Deleting offline snapshot ce0f5671-8094-4e7a-aee9-0978b96b9ed3 of volume 2d90040a-f015-437d-b3ea-f07a3c980759 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:39:51 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-5714bd56-fdca-4883-b29b-4889a33ac541 tempest-VolumesSnapshotTestJSON-538859610 None] snapshot_file for this snap is: volume-2d90040a-f015-437d-b3ea-f07a3c980759.ce0f5671-8094-4e7a-aee9-0978b96b9ed3 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:39:51 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33878e9-ae2c-4d84-820c-33f3f7970e1b]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:39:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5714bd56-fdca-4883-b29b-4889a33ac541 tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759.ce0f5671-8094-4e7a-aee9-0978b96b9ed3 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:52 devstack sudo[95637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759.ce0f5671-8094-4e7a-aee9-0978b96b9ed3 Jul 08 01:39:52 devstack sudo[95637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:52 devstack sudo[95633]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5c2a7efa-8301-4480-b0ad-fd1d02c088de tempest-CreateVolumesFromSourceVolumeTest-640514927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a4e33f6b-e2ce-4512-8bf0-c163153e6ea4 1073741824" returned: 0 in 1.497s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5c2a7efa-8301-4480-b0ad-fd1d02c088de tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a4e33f6b-e2ce-4512-8bf0-c163153e6ea4 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:52 devstack sudo[95635]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-22eafb5d-d711-45d7-906d-1a40f2ca4b40 tempest-TestMinimumBasicScenario-176295214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.258s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:52 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-22eafb5d-d711-45d7-906d-1a40f2ca4b40 tempest-TestMinimumBasicScenario-176295214 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:39:52 devstack sudo[95645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a4e33f6b-e2ce-4512-8bf0-c163153e6ea4 Jul 08 01:39:52 devstack sudo[95645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:52 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-22eafb5d-d711-45d7-906d-1a40f2ca4b40 tempest-TestMinimumBasicScenario-176295214 None] Deleted volume successfully. Jul 08 01:39:52 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-22eafb5d-d711-45d7-906d-1a40f2ca4b40 tempest-TestMinimumBasicScenario-176295214 None] Lock "cinder-d33871f4-8d20-4910-b977-cb6b63faa17b-delete_volume" released by "delete_volume" :: held 3.313s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:39:52 devstack sudo[95637]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5714bd56-fdca-4883-b29b-4889a33ac541 tempest-VolumesSnapshotTestJSON-538859610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759.ce0f5671-8094-4e7a-aee9-0978b96b9ed3" returned: 0 in 1.117s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-5714bd56-fdca-4883-b29b-4889a33ac541 tempest-VolumesSnapshotTestJSON-538859610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d90040a-f015-437d-b3ea-f07a3c980759(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:39:52 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ed7c1d-a11d-4283-acba-68f8ba0fb200]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:39:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5714bd56-fdca-4883-b29b-4889a33ac541 tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:53 devstack sudo[95651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759 Jul 08 01:39:53 devstack sudo[95651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:53 devstack sudo[95645]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5c2a7efa-8301-4480-b0ad-fd1d02c088de tempest-CreateVolumesFromSourceVolumeTest-640514927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a4e33f6b-e2ce-4512-8bf0-c163153e6ea4" returned: 0 in 0.779s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:53 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5c2a7efa-8301-4480-b0ad-fd1d02c088de tempest-CreateVolumesFromSourceVolumeTest-640514927 None] <== create_volume: return (2337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:39:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5c2a7efa-8301-4480-b0ad-fd1d02c088de tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.340s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5d95c408-2572-43c4-9cf1-966c980819b2 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.916s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:53 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5d95c408-2572-43c4-9cf1-966c980819b2 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1696093800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbc844dd-7e98-4aac-94e9-5cf39019ab5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9dc263132594a72b1f992b66a051bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:39:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:39:46Z,use_quota=True,user_id='3c28a86e02534b4fbafdc4f696837662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:39:53 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-5d95c408-2572-43c4-9cf1-966c980819b2 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Creating volume fbc844dd-7e98-4aac-94e9-5cf39019ab5c {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:39:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5d95c408-2572-43c4-9cf1-966c980819b2 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5d95c408-2572-43c4-9cf1-966c980819b2 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:53 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5d95c408-2572-43c4-9cf1-966c980819b2 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:39:53 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5d95c408-2572-43c4-9cf1-966c980819b2 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:39:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5d95c408-2572-43c4-9cf1-966c980819b2 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:53 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5d95c408-2572-43c4-9cf1-966c980819b2 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:39:53 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-5d95c408-2572-43c4-9cf1-966c980819b2 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:39:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5d95c408-2572-43c4-9cf1-966c980819b2 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fbc844dd-7e98-4aac-94e9-5cf39019ab5c 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:53 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5c2a7efa-8301-4480-b0ad-fd1d02c088de tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e963e9a7-b69d-4d20-a863-0342f10b78c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4e33f6b-e2ce-4512-8bf0-c163153e6ea4', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:53 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5c2a7efa-8301-4480-b0ad-fd1d02c088de tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8527b8c1-52df-416f-a539-761cf16fc507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:53 devstack sudo[95659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fbc844dd-7e98-4aac-94e9-5cf39019ab5c 1073741824 Jul 08 01:39:53 devstack sudo[95659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:53 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-5c2a7efa-8301-4480-b0ad-fd1d02c088de tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Volume volume-a4e33f6b-e2ce-4512-8bf0-c163153e6ea4 (a4e33f6b-e2ce-4512-8bf0-c163153e6ea4): created successfully Jul 08 01:39:53 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5c2a7efa-8301-4480-b0ad-fd1d02c088de tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8527b8c1-52df-416f-a539-761cf16fc507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:53 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5c2a7efa-8301-4480-b0ad-fd1d02c088de tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Flow 'volume_create_manager' (0271edb0-5b0b-4e9a-b40c-d45f8926f0af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:39:53 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-5c2a7efa-8301-4480-b0ad-fd1d02c088de tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Created volume successfully. Jul 08 01:39:54 devstack sudo[95651]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5714bd56-fdca-4883-b29b-4889a33ac541 tempest-VolumesSnapshotTestJSON-538859610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759" returned: 0 in 1.377s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5714bd56-fdca-4883-b29b-4889a33ac541 tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759.ce0f5671-8094-4e7a-aee9-0978b96b9ed3 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:54 devstack sudo[95680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759.ce0f5671-8094-4e7a-aee9-0978b96b9ed3 Jul 08 01:39:54 devstack sudo[95680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:54 devstack sudo[95659]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5d95c408-2572-43c4-9cf1-966c980819b2 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fbc844dd-7e98-4aac-94e9-5cf39019ab5c 1073741824" returned: 0 in 1.593s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5d95c408-2572-43c4-9cf1-966c980819b2 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fbc844dd-7e98-4aac-94e9-5cf39019ab5c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:55 devstack sudo[95689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fbc844dd-7e98-4aac-94e9-5cf39019ab5c Jul 08 01:39:55 devstack sudo[95689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:55 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:39:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:39:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:39:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:55 devstack sudo[95695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:39:55 devstack sudo[95695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:55 devstack sudo[95680]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5714bd56-fdca-4883-b29b-4889a33ac541 tempest-VolumesSnapshotTestJSON-538859610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759.ce0f5671-8094-4e7a-aee9-0978b96b9ed3" returned: 0 in 1.318s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5714bd56-fdca-4883-b29b-4889a33ac541 tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759.ce0f5671-8094-4e7a-aee9-0978b96b9ed3 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:55 devstack sudo[95699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759.ce0f5671-8094-4e7a-aee9-0978b96b9ed3 Jul 08 01:39:55 devstack sudo[95699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:56 devstack sudo[95689]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5d95c408-2572-43c4-9cf1-966c980819b2 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fbc844dd-7e98-4aac-94e9-5cf39019ab5c" returned: 0 in 1.129s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:56 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5d95c408-2572-43c4-9cf1-966c980819b2 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] <== create_volume: return (2820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:39:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5d95c408-2572-43c4-9cf1-966c980819b2 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.824s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:56 devstack sudo[95695]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2e714486-c0bd-4321-be32-ffe778363116 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.746s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:56 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2e714486-c0bd-4321-be32-ffe778363116 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-640696223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2dd3877-8e61-499b-b8d1-c47f352af324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9dc263132594a72b1f992b66a051bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:39:47Z,use_quota=True,user_id='3c28a86e02534b4fbafdc4f696837662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:39:56 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-2e714486-c0bd-4321-be32-ffe778363116 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Creating volume a2dd3877-8e61-499b-b8d1-c47f352af324 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:39:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2e714486-c0bd-4321-be32-ffe778363116 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2e714486-c0bd-4321-be32-ffe778363116 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:56 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2e714486-c0bd-4321-be32-ffe778363116 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:39:56 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2e714486-c0bd-4321-be32-ffe778363116 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:39:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2e714486-c0bd-4321-be32-ffe778363116 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:56 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2e714486-c0bd-4321-be32-ffe778363116 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:39:56 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-2e714486-c0bd-4321-be32-ffe778363116 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:39:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2e714486-c0bd-4321-be32-ffe778363116 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a2dd3877-8e61-499b-b8d1-c47f352af324 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.051s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:56 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:39:56 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager._thread_info {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:39:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread count: 29 {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:39:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread info: [<_MainThread(MainThread, started 127058402500736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:39:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5d95c408-2572-43c4-9cf1-966c980819b2 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afcc646e-fc69-484c-826a-06f1e0452d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbc844dd-7e98-4aac-94e9-5cf39019ab5c', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:56 devstack sudo[95703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a2dd3877-8e61-499b-b8d1-c47f352af324 1073741824 Jul 08 01:39:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5d95c408-2572-43c4-9cf1-966c980819b2 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4654fa33-244c-4522-b74a-51ebf7d0cb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:56 devstack sudo[95703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:56 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-5d95c408-2572-43c4-9cf1-966c980819b2 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Volume volume-fbc844dd-7e98-4aac-94e9-5cf39019ab5c (fbc844dd-7e98-4aac-94e9-5cf39019ab5c): created successfully Jul 08 01:39:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5d95c408-2572-43c4-9cf1-966c980819b2 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4654fa33-244c-4522-b74a-51ebf7d0cb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5d95c408-2572-43c4-9cf1-966c980819b2 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Flow 'volume_create_manager' (09de1442-6b29-4e38-9518-745fedfd5421) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:39:56 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-5d95c408-2572-43c4-9cf1-966c980819b2 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Created volume successfully. Jul 08 01:39:56 devstack sudo[95699]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5714bd56-fdca-4883-b29b-4889a33ac541 tempest-VolumesSnapshotTestJSON-538859610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759.ce0f5671-8094-4e7a-aee9-0978b96b9ed3" returned: 0 in 1.235s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:56 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5714bd56-fdca-4883-b29b-4889a33ac541 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-quobyte-ce0f5671-8094-4e7a-aee9-0978b96b9ed3" released by "_delete_snapshot" :: held 5.176s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:39:56 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5714bd56-fdca-4883-b29b-4889a33ac541 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-quobyte-2d90040a-f015-437d-b3ea-f07a3c980759" released by "delete_snapshot" :: held 5.213s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:39:56 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-5714bd56-fdca-4883-b29b-4889a33ac541 tempest-VolumesSnapshotTestJSON-538859610 None] Created reservations ['727b78f6-9c15-4efd-9653-4e0027472adb', '597a5006-ea03-4623-8808-282cc2a53773', 'f13330a6-c43a-4c59-93fe-9600a78b2992', '3f609044-8b71-48e1-823b-85c733095ca4'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:39:57 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-5714bd56-fdca-4883-b29b-4889a33ac541 tempest-VolumesSnapshotTestJSON-538859610 None] Delete snapshot completed successfully. Jul 08 01:39:57 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5714bd56-fdca-4883-b29b-4889a33ac541 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-ce0f5671-8094-4e7a-aee9-0978b96b9ed3-delete_snapshot" released by "delete_snapshot" :: held 5.463s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:39:57 devstack sudo[95703]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2e714486-c0bd-4321-be32-ffe778363116 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a2dd3877-8e61-499b-b8d1-c47f352af324 1073741824" returned: 0 in 1.147s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2e714486-c0bd-4321-be32-ffe778363116 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a2dd3877-8e61-499b-b8d1-c47f352af324 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:57 devstack sudo[95723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a2dd3877-8e61-499b-b8d1-c47f352af324 Jul 08 01:39:57 devstack sudo[95723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:58 devstack sudo[95723]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2e714486-c0bd-4321-be32-ffe778363116 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a2dd3877-8e61-499b-b8d1-c47f352af324" returned: 0 in 0.742s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:58 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2e714486-c0bd-4321-be32-ffe778363116 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] <== create_volume: return (1945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:39:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2e714486-c0bd-4321-be32-ffe778363116 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.949s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6c44ee70-7625-4075-b1ac-2a7ac084f662 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.781s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:58 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-6c44ee70-7625-4075-b1ac-2a7ac084f662 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-561753118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a1cfb5b-7a6f-4388-a989-632149336143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9dc263132594a72b1f992b66a051bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:39:48Z,use_quota=True,user_id='3c28a86e02534b4fbafdc4f696837662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:39:58 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-6c44ee70-7625-4075-b1ac-2a7ac084f662 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Creating volume 9a1cfb5b-7a6f-4388-a989-632149336143 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:39:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6c44ee70-7625-4075-b1ac-2a7ac084f662 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6c44ee70-7625-4075-b1ac-2a7ac084f662 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:58 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-6c44ee70-7625-4075-b1ac-2a7ac084f662 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:39:58 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-6c44ee70-7625-4075-b1ac-2a7ac084f662 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:39:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6c44ee70-7625-4075-b1ac-2a7ac084f662 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:58 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-6c44ee70-7625-4075-b1ac-2a7ac084f662 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:39:58 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-6c44ee70-7625-4075-b1ac-2a7ac084f662 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:39:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6c44ee70-7625-4075-b1ac-2a7ac084f662 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9a1cfb5b-7a6f-4388-a989-632149336143 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2e714486-c0bd-4321-be32-ffe778363116 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e79c270-02b8-4d41-8e1f-bab9bfe81625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2dd3877-8e61-499b-b8d1-c47f352af324', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:58 devstack sudo[95736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9a1cfb5b-7a6f-4388-a989-632149336143 1073741824 Jul 08 01:39:58 devstack sudo[95736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2e714486-c0bd-4321-be32-ffe778363116 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f4e6d33-1ef7-46b5-87bb-1ebbdfcecbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:58 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-2e714486-c0bd-4321-be32-ffe778363116 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Volume volume-a2dd3877-8e61-499b-b8d1-c47f352af324 (a2dd3877-8e61-499b-b8d1-c47f352af324): created successfully Jul 08 01:39:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2e714486-c0bd-4321-be32-ffe778363116 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f4e6d33-1ef7-46b5-87bb-1ebbdfcecbfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2e714486-c0bd-4321-be32-ffe778363116 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Flow 'volume_create_manager' (c1d3b252-9bd4-4409-b824-b0587730bcac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:39:58 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-2e714486-c0bd-4321-be32-ffe778363116 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Created volume successfully. Jul 08 01:39:58 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b8b4b47-3511-42d0-9e13-bd80893825ac tempest-VolumesSnapshotTestJSON-538859610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:39:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3b8b4b47-3511-42d0-9e13-bd80893825ac tempest-VolumesSnapshotTestJSON-538859610 None] Flow 'volume_create_manager' (a82908fe-9ae1-4c49-a714-db4fa1c6af44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:39:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3b8b4b47-3511-42d0-9e13-bd80893825ac tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73b52fe7-4141-4038-8303-b07ba3c9270a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3b8b4b47-3511-42d0-9e13-bd80893825ac tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73b52fe7-4141-4038-8303-b07ba3c9270a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1209654699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=818d1475-4254-4ea2-87a8-2a470991a01e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c25e1aa98c3045b6a87d7233ca8c49b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:39:59Z,use_quota=True,user_id='1c49d16162e446838c57af096485520f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3b8b4b47-3511-42d0-9e13-bd80893825ac tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7721a4e-8333-4582-918a-986626bdd902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3b8b4b47-3511-42d0-9e13-bd80893825ac tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7721a4e-8333-4582-918a-986626bdd902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3b8b4b47-3511-42d0-9e13-bd80893825ac tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece53e1a-f358-4f75-93c2-c1dc4fce4f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3b8b4b47-3511-42d0-9e13-bd80893825ac tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece53e1a-f358-4f75-93c2-c1dc4fce4f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '818d1475-4254-4ea2-87a8-2a470991a01e', 'volume_name': 'volume-818d1475-4254-4ea2-87a8-2a470991a01e', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3b8b4b47-3511-42d0-9e13-bd80893825ac tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e24faa9-b49f-4102-b2f0-ff4cdca05654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3b8b4b47-3511-42d0-9e13-bd80893825ac tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e24faa9-b49f-4102-b2f0-ff4cdca05654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:39:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3b8b4b47-3511-42d0-9e13-bd80893825ac tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf73f5c-c884-4e5c-9dde-0f89792a2e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:39:58 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-3b8b4b47-3511-42d0-9e13-bd80893825ac tempest-VolumesSnapshotTestJSON-538859610 None] Volume 818d1475-4254-4ea2-87a8-2a470991a01e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-818d1475-4254-4ea2-87a8-2a470991a01e', 'volume_size': 1} Jul 08 01:39:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3b8b4b47-3511-42d0-9e13-bd80893825ac tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:59 devstack sudo[95736]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6c44ee70-7625-4075-b1ac-2a7ac084f662 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9a1cfb5b-7a6f-4388-a989-632149336143 1073741824" returned: 0 in 1.001s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6c44ee70-7625-4075-b1ac-2a7ac084f662 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9a1cfb5b-7a6f-4388-a989-632149336143 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:59 devstack sudo[95756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9a1cfb5b-7a6f-4388-a989-632149336143 Jul 08 01:39:59 devstack sudo[95756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:59 devstack sudo[95756]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6c44ee70-7625-4075-b1ac-2a7ac084f662 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9a1cfb5b-7a6f-4388-a989-632149336143" returned: 0 in 0.743s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:59 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-6c44ee70-7625-4075-b1ac-2a7ac084f662 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] <== create_volume: return (1789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:39:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6c44ee70-7625-4075-b1ac-2a7ac084f662 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.795s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0dfe597f-e891-4821-804c-95380f4106d9 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.809s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:59 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0dfe597f-e891-4821-804c-95380f4106d9 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:39:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-329303344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab736969-78d7-455a-81e2-c9d3a021e12e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9dc263132594a72b1f992b66a051bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:39:49Z,use_quota=True,user_id='3c28a86e02534b4fbafdc4f696837662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:39:59 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-0dfe597f-e891-4821-804c-95380f4106d9 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Creating volume ab736969-78d7-455a-81e2-c9d3a021e12e {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:39:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0dfe597f-e891-4821-804c-95380f4106d9 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0dfe597f-e891-4821-804c-95380f4106d9 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:59 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0dfe597f-e891-4821-804c-95380f4106d9 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:39:59 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0dfe597f-e891-4821-804c-95380f4106d9 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:39:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0dfe597f-e891-4821-804c-95380f4106d9 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:59 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0dfe597f-e891-4821-804c-95380f4106d9 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:39:59 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-0dfe597f-e891-4821-804c-95380f4106d9 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:39:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0dfe597f-e891-4821-804c-95380f4106d9 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ab736969-78d7-455a-81e2-c9d3a021e12e 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6c44ee70-7625-4075-b1ac-2a7ac084f662 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cca885e3-7b51-4043-afbc-f3169687eee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a1cfb5b-7a6f-4388-a989-632149336143', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:40:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6c44ee70-7625-4075-b1ac-2a7ac084f662 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f655cc79-33b3-4d7e-a112-4e7f36cf0eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:40:00 devstack sudo[95759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ab736969-78d7-455a-81e2-c9d3a021e12e 1073741824 Jul 08 01:40:00 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:00 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-6c44ee70-7625-4075-b1ac-2a7ac084f662 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Volume volume-9a1cfb5b-7a6f-4388-a989-632149336143 (9a1cfb5b-7a6f-4388-a989-632149336143): created successfully Jul 08 01:40:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6c44ee70-7625-4075-b1ac-2a7ac084f662 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f655cc79-33b3-4d7e-a112-4e7f36cf0eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:40:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6c44ee70-7625-4075-b1ac-2a7ac084f662 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Flow 'volume_create_manager' (4ec1ad71-6213-4525-b802-b8b41a809ee4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:40:00 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-6c44ee70-7625-4075-b1ac-2a7ac084f662 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Created volume successfully. Jul 08 01:40:01 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0dfe597f-e891-4821-804c-95380f4106d9 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ab736969-78d7-455a-81e2-c9d3a021e12e 1073741824" returned: 0 in 1.040s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0dfe597f-e891-4821-804c-95380f4106d9 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ab736969-78d7-455a-81e2-c9d3a021e12e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:01 devstack sudo[95766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ab736969-78d7-455a-81e2-c9d3a021e12e Jul 08 01:40:01 devstack sudo[95766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:01 devstack sudo[95766]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0dfe597f-e891-4821-804c-95380f4106d9 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ab736969-78d7-455a-81e2-c9d3a021e12e" returned: 0 in 0.712s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:01 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0dfe597f-e891-4821-804c-95380f4106d9 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] <== create_volume: return (1807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:40:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0dfe597f-e891-4821-804c-95380f4106d9 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.811s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:40:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3b8b4b47-3511-42d0-9e13-bd80893825ac tempest-VolumesSnapshotTestJSON-538859610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.003s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:40:01 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3b8b4b47-3511-42d0-9e13-bd80893825ac tempest-VolumesSnapshotTestJSON-538859610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1209654699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=818d1475-4254-4ea2-87a8-2a470991a01e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c25e1aa98c3045b6a87d7233ca8c49b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:39:59Z,use_quota=True,user_id='1c49d16162e446838c57af096485520f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:40:01 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-3b8b4b47-3511-42d0-9e13-bd80893825ac tempest-VolumesSnapshotTestJSON-538859610 None] Creating volume 818d1475-4254-4ea2-87a8-2a470991a01e {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:40:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3b8b4b47-3511-42d0-9e13-bd80893825ac tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:40:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3b8b4b47-3511-42d0-9e13-bd80893825ac tempest-VolumesSnapshotTestJSON-538859610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:40:01 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3b8b4b47-3511-42d0-9e13-bd80893825ac tempest-VolumesSnapshotTestJSON-538859610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:40:01 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3b8b4b47-3511-42d0-9e13-bd80893825ac tempest-VolumesSnapshotTestJSON-538859610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:40:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3b8b4b47-3511-42d0-9e13-bd80893825ac tempest-VolumesSnapshotTestJSON-538859610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:40:01 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3b8b4b47-3511-42d0-9e13-bd80893825ac tempest-VolumesSnapshotTestJSON-538859610 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:40:01 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-3b8b4b47-3511-42d0-9e13-bd80893825ac tempest-VolumesSnapshotTestJSON-538859610 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:40:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3b8b4b47-3511-42d0-9e13-bd80893825ac tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:01 devstack sudo[95769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e 1073741824 Jul 08 01:40:01 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0dfe597f-e891-4821-804c-95380f4106d9 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16bc985f-d1c9-48c3-8929-bf7d9915cad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab736969-78d7-455a-81e2-c9d3a021e12e', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:40:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0dfe597f-e891-4821-804c-95380f4106d9 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (017fa1c4-db13-4f40-8348-7a654846455a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:40:01 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-0dfe597f-e891-4821-804c-95380f4106d9 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Volume volume-ab736969-78d7-455a-81e2-c9d3a021e12e (ab736969-78d7-455a-81e2-c9d3a021e12e): created successfully Jul 08 01:40:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0dfe597f-e891-4821-804c-95380f4106d9 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (017fa1c4-db13-4f40-8348-7a654846455a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:40:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0dfe597f-e891-4821-804c-95380f4106d9 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Flow 'volume_create_manager' (a2a42c2c-2daf-4f82-88ed-265c19043e25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:40:01 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-0dfe597f-e891-4821-804c-95380f4106d9 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Created volume successfully. Jul 08 01:40:02 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-766d33ba-1170-405c-a122-1840f54cde6c tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Acquiring lock "cinder-ab736969-78d7-455a-81e2-c9d3a021e12e-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:40:02 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-766d33ba-1170-405c-a122-1840f54cde6c tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "cinder-ab736969-78d7-455a-81e2-c9d3a021e12e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:40:02 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-766d33ba-1170-405c-a122-1840f54cde6c tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Acquiring lock "cinder-quobyte-ab736969-78d7-455a-81e2-c9d3a021e12e" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:40:02 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-766d33ba-1170-405c-a122-1840f54cde6c tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "cinder-quobyte-ab736969-78d7-455a-81e2-c9d3a021e12e" acquired by "delete_volume" :: waited 0.021s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:40:02 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ba25f2-ae94-4490-8cc2-485229791fd0]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:40:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-766d33ba-1170-405c-a122-1840f54cde6c tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ab736969-78d7-455a-81e2-c9d3a021e12e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:02 devstack sudo[95774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ab736969-78d7-455a-81e2-c9d3a021e12e Jul 08 01:40:02 devstack sudo[95774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:02 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3b8b4b47-3511-42d0-9e13-bd80893825ac tempest-VolumesSnapshotTestJSON-538859610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e 1073741824" returned: 0 in 1.150s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3b8b4b47-3511-42d0-9e13-bd80893825ac tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:03 devstack sudo[95777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e Jul 08 01:40:03 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:03 devstack sudo[95774]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-766d33ba-1170-405c-a122-1840f54cde6c tempest-CreateVolumesFromSourceVolumeTest-640514927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ab736969-78d7-455a-81e2-c9d3a021e12e" returned: 0 in 0.971s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-766d33ba-1170-405c-a122-1840f54cde6c tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ab736969-78d7-455a-81e2-c9d3a021e12e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:03 devstack sudo[95783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ab736969-78d7-455a-81e2-c9d3a021e12e Jul 08 01:40:03 devstack sudo[95783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:03 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3b8b4b47-3511-42d0-9e13-bd80893825ac tempest-VolumesSnapshotTestJSON-538859610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e" returned: 0 in 0.835s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:03 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3b8b4b47-3511-42d0-9e13-bd80893825ac tempest-VolumesSnapshotTestJSON-538859610 None] <== create_volume: return (2051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:40:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3b8b4b47-3511-42d0-9e13-bd80893825ac tempest-VolumesSnapshotTestJSON-538859610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.061s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:40:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3b8b4b47-3511-42d0-9e13-bd80893825ac tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf73f5c-c884-4e5c-9dde-0f89792a2e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-818d1475-4254-4ea2-87a8-2a470991a01e', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:40:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3b8b4b47-3511-42d0-9e13-bd80893825ac tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded654ae-b0fa-4962-a521-fb26b1846502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:40:03 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-3b8b4b47-3511-42d0-9e13-bd80893825ac tempest-VolumesSnapshotTestJSON-538859610 None] Volume volume-818d1475-4254-4ea2-87a8-2a470991a01e (818d1475-4254-4ea2-87a8-2a470991a01e): created successfully Jul 08 01:40:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3b8b4b47-3511-42d0-9e13-bd80893825ac tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded654ae-b0fa-4962-a521-fb26b1846502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:40:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3b8b4b47-3511-42d0-9e13-bd80893825ac tempest-VolumesSnapshotTestJSON-538859610 None] Flow 'volume_create_manager' (a82908fe-9ae1-4c49-a714-db4fa1c6af44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:40:03 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-3b8b4b47-3511-42d0-9e13-bd80893825ac tempest-VolumesSnapshotTestJSON-538859610 None] Created volume successfully. Jul 08 01:40:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-7edea99c-0c50-4241-a8b6-114243e4498a tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:40:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-7edea99c-0c50-4241-a8b6-114243e4498a tempest-VolumesSnapshotTestJSON-538859610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:40:04 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-7edea99c-0c50-4241-a8b6-114243e4498a tempest-VolumesSnapshotTestJSON-538859610 None] Creating offline snapshot ddac1553-2344-48b4-b824-d3ae957f7128 of volume 818d1475-4254-4ea2-87a8-2a470991a01e {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:40:04 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f61633c-8339-4a56-834b-aeb2818e9db9]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:40:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7edea99c-0c50-4241-a8b6-114243e4498a tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:04 devstack sudo[95787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e Jul 08 01:40:04 devstack sudo[95787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:04 devstack sudo[95783]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-766d33ba-1170-405c-a122-1840f54cde6c tempest-CreateVolumesFromSourceVolumeTest-640514927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ab736969-78d7-455a-81e2-c9d3a021e12e" returned: 0 in 0.926s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:04 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-766d33ba-1170-405c-a122-1840f54cde6c tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "cinder-quobyte-ab736969-78d7-455a-81e2-c9d3a021e12e" released by "delete_volume" :: held 1.957s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:40:04 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-766d33ba-1170-405c-a122-1840f54cde6c tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Created reservations ['338007f1-5941-4bbe-bd3d-b2c45a746c96', '14754235-484a-4333-bc57-5ae7821aa02f', '8d1ee2de-5196-4d8f-9e61-821b6bdc3b8c', '56d3d616-0586-452a-bba4-988adddaee58'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:40:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-766d33ba-1170-405c-a122-1840f54cde6c tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:40:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-766d33ba-1170-405c-a122-1840f54cde6c tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:40:04 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-766d33ba-1170-405c-a122-1840f54cde6c tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:40:04 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-766d33ba-1170-405c-a122-1840f54cde6c tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:40:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-766d33ba-1170-405c-a122-1840f54cde6c tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:40:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-766d33ba-1170-405c-a122-1840f54cde6c tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:04 devstack sudo[95790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:40:04 devstack sudo[95790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:05 devstack sudo[95787]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7edea99c-0c50-4241-a8b6-114243e4498a tempest-VolumesSnapshotTestJSON-538859610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e" returned: 0 in 1.112s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7edea99c-0c50-4241-a8b6-114243e4498a tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e.ddac1553-2344-48b4-b824-d3ae957f7128 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:05 devstack sudo[95796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e.ddac1553-2344-48b4-b824-d3ae957f7128 1G Jul 08 01:40:05 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:05 devstack sudo[95790]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-766d33ba-1170-405c-a122-1840f54cde6c tempest-CreateVolumesFromSourceVolumeTest-640514927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.854s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:05 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-766d33ba-1170-405c-a122-1840f54cde6c tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:40:05 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-766d33ba-1170-405c-a122-1840f54cde6c tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Deleted volume successfully. Jul 08 01:40:05 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-766d33ba-1170-405c-a122-1840f54cde6c tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "cinder-ab736969-78d7-455a-81e2-c9d3a021e12e-delete_volume" released by "delete_volume" :: held 3.239s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:40:05 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c3355d54-d99f-4b96-9040-073c71793215 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Acquiring lock "cinder-9a1cfb5b-7a6f-4388-a989-632149336143-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:40:06 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c3355d54-d99f-4b96-9040-073c71793215 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "cinder-9a1cfb5b-7a6f-4388-a989-632149336143-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:40:06 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c3355d54-d99f-4b96-9040-073c71793215 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Acquiring lock "cinder-quobyte-9a1cfb5b-7a6f-4388-a989-632149336143" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:40:06 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c3355d54-d99f-4b96-9040-073c71793215 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "cinder-quobyte-9a1cfb5b-7a6f-4388-a989-632149336143" acquired by "delete_volume" :: waited 0.027s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:40:06 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[100e2e04-7e43-4834-814d-2912119e1372]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:40:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c3355d54-d99f-4b96-9040-073c71793215 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9a1cfb5b-7a6f-4388-a989-632149336143 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:06 devstack sudo[95799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9a1cfb5b-7a6f-4388-a989-632149336143 Jul 08 01:40:06 devstack sudo[95799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:06 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7edea99c-0c50-4241-a8b6-114243e4498a tempest-VolumesSnapshotTestJSON-538859610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e.ddac1553-2344-48b4-b824-d3ae957f7128 1G" returned: 0 in 1.015s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7edea99c-0c50-4241-a8b6-114243e4498a tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-818d1475-4254-4ea2-87a8-2a470991a01e -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e.ddac1553-2344-48b4-b824-d3ae957f7128 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:06 devstack sudo[95805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-818d1475-4254-4ea2-87a8-2a470991a01e -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e.ddac1553-2344-48b4-b824-d3ae957f7128 Jul 08 01:40:06 devstack sudo[95805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:06 devstack sudo[95799]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c3355d54-d99f-4b96-9040-073c71793215 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9a1cfb5b-7a6f-4388-a989-632149336143" returned: 0 in 0.857s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c3355d54-d99f-4b96-9040-073c71793215 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9a1cfb5b-7a6f-4388-a989-632149336143 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:07 devstack sudo[95810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9a1cfb5b-7a6f-4388-a989-632149336143 Jul 08 01:40:07 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:07 devstack sudo[95805]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7edea99c-0c50-4241-a8b6-114243e4498a tempest-VolumesSnapshotTestJSON-538859610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-818d1475-4254-4ea2-87a8-2a470991a01e -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e.ddac1553-2344-48b4-b824-d3ae957f7128" returned: 0 in 0.811s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:07 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-7edea99c-0c50-4241-a8b6-114243e4498a tempest-VolumesSnapshotTestJSON-538859610 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e.ddac1553-2344-48b4-b824-d3ae957f7128 is being set with open permissions: ugo+rw Jul 08 01:40:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7edea99c-0c50-4241-a8b6-114243e4498a tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e.ddac1553-2344-48b4-b824-d3ae957f7128 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:07 devstack sudo[95815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e.ddac1553-2344-48b4-b824-d3ae957f7128 Jul 08 01:40:07 devstack sudo[95815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:07 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c3355d54-d99f-4b96-9040-073c71793215 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9a1cfb5b-7a6f-4388-a989-632149336143" returned: 0 in 0.907s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:07 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c3355d54-d99f-4b96-9040-073c71793215 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "cinder-quobyte-9a1cfb5b-7a6f-4388-a989-632149336143" released by "delete_volume" :: held 1.818s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:40:07 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=79,cinder:UPDATE=117,cinder:INSERT=18,cinder:DELETE=8 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:40:08 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-c3355d54-d99f-4b96-9040-073c71793215 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Created reservations ['9f7a43d4-b2da-46dd-9635-260aa2541103', '169f6abc-044b-452e-a3ec-64aba2a98d58', '3d6513c9-6913-4512-b422-d03530d70de5', '14070223-d465-4af1-ba93-c2a0abc60111'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:40:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c3355d54-d99f-4b96-9040-073c71793215 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:40:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c3355d54-d99f-4b96-9040-073c71793215 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:40:08 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c3355d54-d99f-4b96-9040-073c71793215 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:40:08 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c3355d54-d99f-4b96-9040-073c71793215 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:40:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c3355d54-d99f-4b96-9040-073c71793215 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:40:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c3355d54-d99f-4b96-9040-073c71793215 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:08 devstack sudo[95815]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7edea99c-0c50-4241-a8b6-114243e4498a tempest-VolumesSnapshotTestJSON-538859610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e.ddac1553-2344-48b4-b824-d3ae957f7128" returned: 0 in 0.859s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:08 devstack sudo[95821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:40:08 devstack sudo[95821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7edea99c-0c50-4241-a8b6-114243e4498a tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:08 devstack sudo[95823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e.info Jul 08 01:40:08 devstack sudo[95823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:08 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-efb7c0a3-21d5-4456-b2d1-1e402e27e314 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Acquiring lock "cinder-a2dd3877-8e61-499b-b8d1-c47f352af324-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:40:08 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-efb7c0a3-21d5-4456-b2d1-1e402e27e314 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "cinder-a2dd3877-8e61-499b-b8d1-c47f352af324-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:40:08 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-efb7c0a3-21d5-4456-b2d1-1e402e27e314 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Acquiring lock "cinder-quobyte-a2dd3877-8e61-499b-b8d1-c47f352af324" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:40:08 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-efb7c0a3-21d5-4456-b2d1-1e402e27e314 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "cinder-quobyte-a2dd3877-8e61-499b-b8d1-c47f352af324" acquired by "delete_volume" :: waited 0.026s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:40:08 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a30cff-b62f-4d55-8587-98601239a09a]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:40:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-efb7c0a3-21d5-4456-b2d1-1e402e27e314 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a2dd3877-8e61-499b-b8d1-c47f352af324 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:08 devstack sudo[95826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a2dd3877-8e61-499b-b8d1-c47f352af324 Jul 08 01:40:08 devstack sudo[95826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:09 devstack sudo[95821]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c3355d54-d99f-4b96-9040-073c71793215 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.075s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:09 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-c3355d54-d99f-4b96-9040-073c71793215 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:40:09 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-c3355d54-d99f-4b96-9040-073c71793215 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Deleted volume successfully. Jul 08 01:40:09 devstack sudo[95823]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7edea99c-0c50-4241-a8b6-114243e4498a tempest-VolumesSnapshotTestJSON-538859610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e.info" returned: 0 in 1.014s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:09 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-7edea99c-0c50-4241-a8b6-114243e4498a tempest-VolumesSnapshotTestJSON-538859610 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e.info is being set with open permissions: ugo+rw Jul 08 01:40:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7edea99c-0c50-4241-a8b6-114243e4498a tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:09 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c3355d54-d99f-4b96-9040-073c71793215 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "cinder-9a1cfb5b-7a6f-4388-a989-632149336143-delete_volume" released by "delete_volume" :: held 3.265s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:40:09 devstack sudo[95832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e.info Jul 08 01:40:09 devstack sudo[95832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:09 devstack sudo[95826]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-efb7c0a3-21d5-4456-b2d1-1e402e27e314 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a2dd3877-8e61-499b-b8d1-c47f352af324" returned: 0 in 1.261s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-efb7c0a3-21d5-4456-b2d1-1e402e27e314 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a2dd3877-8e61-499b-b8d1-c47f352af324 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:09 devstack sudo[95838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a2dd3877-8e61-499b-b8d1-c47f352af324 Jul 08 01:40:09 devstack sudo[95838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:10 devstack sudo[95832]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7edea99c-0c50-4241-a8b6-114243e4498a tempest-VolumesSnapshotTestJSON-538859610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e.info" returned: 0 in 0.879s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-7edea99c-0c50-4241-a8b6-114243e4498a tempest-VolumesSnapshotTestJSON-538859610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.848s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:40:10 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:UPDATE=96,cinder:SELECT=98,cinder:DELETE=11,cinder:INSERT=32 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:40:10 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-7edea99c-0c50-4241-a8b6-114243e4498a tempest-VolumesSnapshotTestJSON-538859610 None] Create snapshot completed successfully Jul 08 01:40:10 devstack sudo[95838]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-efb7c0a3-21d5-4456-b2d1-1e402e27e314 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a2dd3877-8e61-499b-b8d1-c47f352af324" returned: 0 in 0.800s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:10 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-efb7c0a3-21d5-4456-b2d1-1e402e27e314 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "cinder-quobyte-a2dd3877-8e61-499b-b8d1-c47f352af324" released by "delete_volume" :: held 2.129s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:40:10 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-efb7c0a3-21d5-4456-b2d1-1e402e27e314 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Created reservations ['a824ac94-bb1e-48be-b342-5fbe040809e3', '23ff9663-227e-475c-ad57-39820f34bed7', '21f00e89-25a9-43e1-88b7-d64ca9ada55a', 'bd425a4b-a1de-49f8-867c-220ae6d203a9'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:40:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-efb7c0a3-21d5-4456-b2d1-1e402e27e314 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:40:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-efb7c0a3-21d5-4456-b2d1-1e402e27e314 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:40:10 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-efb7c0a3-21d5-4456-b2d1-1e402e27e314 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:40:10 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-efb7c0a3-21d5-4456-b2d1-1e402e27e314 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:40:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-efb7c0a3-21d5-4456-b2d1-1e402e27e314 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:40:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-efb7c0a3-21d5-4456-b2d1-1e402e27e314 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:10 devstack sudo[95847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:40:10 devstack sudo[95847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:11 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:40:11 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Flow 'volume_create_manager' (ddc9450c-b4d8-4175-9289-1675f7f0667f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:40:11 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af874c4-79c2-4f24-91ea-5dedfb542510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:40:11 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-fa4cf415-5fae-4c10-bbb7-1bc17afcdb15 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Acquiring lock "cinder-fbc844dd-7e98-4aac-94e9-5cf39019ab5c-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:40:11 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af874c4-79c2-4f24-91ea-5dedfb542510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1889999540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f0030af-16f6-4544-ae56-edeac3eb64bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c25e1aa98c3045b6a87d7233ca8c49b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:40:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=ddac1553-2344-48b4-b824-d3ae957f7128,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:40:12Z,use_quota=True,user_id='1c49d16162e446838c57af096485520f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:40:11 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cb63660-de93-460b-9142-897b2b749d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:40:11 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cb63660-de93-460b-9142-897b2b749d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:40:11 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43e0bdc6-3269-4497-ac31-13820743eb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:40:11 devstack sudo[95847]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:11 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43e0bdc6-3269-4497-ac31-13820743eb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0f0030af-16f6-4544-ae56-edeac3eb64bd', 'volume_name': 'volume-0f0030af-16f6-4544-ae56-edeac3eb64bd', 'volume_size': 2, 'snapshot_id': 'ddac1553-2344-48b4-b824-d3ae957f7128'}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:40:11 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbe55b02-440d-409a-bfdd-e99fd3cd5e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:40:11 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbe55b02-440d-409a-bfdd-e99fd3cd5e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:40:11 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1031eb59-fd52-4451-99d7-df7c48285ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:40:11 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Volume 0f0030af-16f6-4544-ae56-edeac3eb64bd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0f0030af-16f6-4544-ae56-edeac3eb64bd', 'volume_size': 2, 'snapshot_id': 'ddac1553-2344-48b4-b824-d3ae957f7128'} Jul 08 01:40:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-efb7c0a3-21d5-4456-b2d1-1e402e27e314 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.271s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:12 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-efb7c0a3-21d5-4456-b2d1-1e402e27e314 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:40:12 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-efb7c0a3-21d5-4456-b2d1-1e402e27e314 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Deleted volume successfully. Jul 08 01:40:12 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-fa4cf415-5fae-4c10-bbb7-1bc17afcdb15 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "cinder-fbc844dd-7e98-4aac-94e9-5cf39019ab5c-delete_volume" acquired by "delete_volume" :: waited 0.158s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:40:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:40:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:40:12 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "cinder-quobyte-ddac1553-2344-48b4-b824-d3ae957f7128-0f0030af-16f6-4544-ae56-edeac3eb64bd" by "_create_volume_from_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:40:12 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-efb7c0a3-21d5-4456-b2d1-1e402e27e314 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "cinder-a2dd3877-8e61-499b-b8d1-c47f352af324-delete_volume" released by "delete_volume" :: held 3.741s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:40:12 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-quobyte-ddac1553-2344-48b4-b824-d3ae957f7128-0f0030af-16f6-4544-ae56-edeac3eb64bd" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:40:12 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Creating volume 0f0030af-16f6-4544-ae56-edeac3eb64bd from snapshot ddac1553-2344-48b4-b824-d3ae957f7128 {{(pid=87284) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 01:40:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:40:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:40:12 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:40:12 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:40:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:40:12 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:40:12 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "cinder-quobyte-0f0030af-16f6-4544-ae56-edeac3eb64bd" by "_copy_volume_from_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:40:12 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-fa4cf415-5fae-4c10-bbb7-1bc17afcdb15 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Acquiring lock "cinder-quobyte-fbc844dd-7e98-4aac-94e9-5cf39019ab5c" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:40:12 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-quobyte-0f0030af-16f6-4544-ae56-edeac3eb64bd" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:40:12 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] snapshot: ddac1553-2344-48b4-b824-d3ae957f7128, volume: 0f0030af-16f6-4544-ae56-edeac3eb64bd, {{(pid=87284) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:40:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:40:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:40:12 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:40:12 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:40:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:40:12 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-fa4cf415-5fae-4c10-bbb7-1bc17afcdb15 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "cinder-quobyte-fbc844dd-7e98-4aac-94e9-5cf39019ab5c" acquired by "delete_volume" :: waited 0.085s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:40:12 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8ece5c-a629-43f0-92a1-518230ec09b0]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:40:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e.ddac1553-2344-48b4-b824-d3ae957f7128 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:12 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa6d3a2-bd3e-471b-b3ee-4bba92c3034a]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:40:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-fa4cf415-5fae-4c10-bbb7-1bc17afcdb15 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fbc844dd-7e98-4aac-94e9-5cf39019ab5c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:12 devstack sudo[95870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fbc844dd-7e98-4aac-94e9-5cf39019ab5c Jul 08 01:40:12 devstack sudo[95870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:12 devstack sudo[95869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e.ddac1553-2344-48b4-b824-d3ae957f7128 Jul 08 01:40:12 devstack sudo[95869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:13 devstack sudo[95870]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-fa4cf415-5fae-4c10-bbb7-1bc17afcdb15 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fbc844dd-7e98-4aac-94e9-5cf39019ab5c" returned: 0 in 1.275s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-fa4cf415-5fae-4c10-bbb7-1bc17afcdb15 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fbc844dd-7e98-4aac-94e9-5cf39019ab5c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:13 devstack sudo[95881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fbc844dd-7e98-4aac-94e9-5cf39019ab5c Jul 08 01:40:13 devstack sudo[95881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:13 devstack sudo[95869]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e.ddac1553-2344-48b4-b824-d3ae957f7128" returned: 0 in 1.446s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:13 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-818d1475-4254-4ea2-87a8-2a470991a01e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:40:13 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e {{(pid=87284) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:40:13 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Creating direct copy from snapshot {{(pid=87284) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:40:13 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8ad8fb-e377-4c39-857e-dd7992cda608]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:40:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:13 devstack sudo[95883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e Jul 08 01:40:13 devstack sudo[95883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:14 devstack sudo[95881]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-fa4cf415-5fae-4c10-bbb7-1bc17afcdb15 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fbc844dd-7e98-4aac-94e9-5cf39019ab5c" returned: 0 in 1.069s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:14 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-fa4cf415-5fae-4c10-bbb7-1bc17afcdb15 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "cinder-quobyte-fbc844dd-7e98-4aac-94e9-5cf39019ab5c" released by "delete_volume" :: held 2.432s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:40:14 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-fa4cf415-5fae-4c10-bbb7-1bc17afcdb15 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Created reservations ['9d2ae73e-5c43-46a6-a932-fcd6fbbb9076', 'd435429f-aac0-4f84-beb1-8b4796d75205', 'f7286113-b8f8-4569-88fd-229b19e02fc9', 'd265c016-4ba6-4e18-ab54-8b19e802cb5d'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:40:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-fa4cf415-5fae-4c10-bbb7-1bc17afcdb15 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:40:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-fa4cf415-5fae-4c10-bbb7-1bc17afcdb15 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:40:14 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-fa4cf415-5fae-4c10-bbb7-1bc17afcdb15 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:40:14 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-fa4cf415-5fae-4c10-bbb7-1bc17afcdb15 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:40:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-fa4cf415-5fae-4c10-bbb7-1bc17afcdb15 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:40:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-fa4cf415-5fae-4c10-bbb7-1bc17afcdb15 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:14 devstack sudo[95891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:40:14 devstack sudo[95891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:14 devstack sudo[95883]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e" returned: 0 in 1.223s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:14 devstack cinder-volume[87284]: DEBUG cinder.utils [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Path /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0f0030af-16f6-4544-ae56-edeac3eb64bd not found in is_blk_device check {{(pid=87284) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:40:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0f0030af-16f6-4544-ae56-edeac3eb64bd {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:14 devstack sudo[95893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0f0030af-16f6-4544-ae56-edeac3eb64bd Jul 08 01:40:14 devstack sudo[95893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:15 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-65a021bd-0ab3-405b-a4cf-086f6abe2fbb tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Acquiring lock "cinder-a4e33f6b-e2ce-4512-8bf0-c163153e6ea4-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:40:15 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-65a021bd-0ab3-405b-a4cf-086f6abe2fbb tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "cinder-a4e33f6b-e2ce-4512-8bf0-c163153e6ea4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:40:15 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-65a021bd-0ab3-405b-a4cf-086f6abe2fbb tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Acquiring lock "cinder-quobyte-a4e33f6b-e2ce-4512-8bf0-c163153e6ea4" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:40:15 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-65a021bd-0ab3-405b-a4cf-086f6abe2fbb tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "cinder-quobyte-a4e33f6b-e2ce-4512-8bf0-c163153e6ea4" acquired by "delete_volume" :: waited 0.036s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:40:15 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f25d4c-496a-4d28-9d34-711761e1a901]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:40:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-65a021bd-0ab3-405b-a4cf-086f6abe2fbb tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a4e33f6b-e2ce-4512-8bf0-c163153e6ea4 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:15 devstack sudo[95895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a4e33f6b-e2ce-4512-8bf0-c163153e6ea4 Jul 08 01:40:15 devstack sudo[95895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:15 devstack sudo[95891]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-fa4cf415-5fae-4c10-bbb7-1bc17afcdb15 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.155s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:15 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-fa4cf415-5fae-4c10-bbb7-1bc17afcdb15 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:40:16 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-fa4cf415-5fae-4c10-bbb7-1bc17afcdb15 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Deleted volume successfully. Jul 08 01:40:16 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-fa4cf415-5fae-4c10-bbb7-1bc17afcdb15 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "cinder-fbc844dd-7e98-4aac-94e9-5cf39019ab5c-delete_volume" released by "delete_volume" :: held 4.025s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:40:17 devstack sudo[95895]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-65a021bd-0ab3-405b-a4cf-086f6abe2fbb tempest-CreateVolumesFromSourceVolumeTest-640514927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a4e33f6b-e2ce-4512-8bf0-c163153e6ea4" returned: 0 in 1.803s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-65a021bd-0ab3-405b-a4cf-086f6abe2fbb tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a4e33f6b-e2ce-4512-8bf0-c163153e6ea4 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:17 devstack sudo[95912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a4e33f6b-e2ce-4512-8bf0-c163153e6ea4 Jul 08 01:40:17 devstack sudo[95912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:19 devstack sudo[95912]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-65a021bd-0ab3-405b-a4cf-086f6abe2fbb tempest-CreateVolumesFromSourceVolumeTest-640514927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a4e33f6b-e2ce-4512-8bf0-c163153e6ea4" returned: 0 in 1.732s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:19 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-65a021bd-0ab3-405b-a4cf-086f6abe2fbb tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "cinder-quobyte-a4e33f6b-e2ce-4512-8bf0-c163153e6ea4" released by "delete_volume" :: held 3.658s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:40:19 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-65a021bd-0ab3-405b-a4cf-086f6abe2fbb tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Created reservations ['472e123c-a4ef-4af5-887a-38465017bf63', 'f26feca6-6563-4568-9af4-cc4835ee2bba', 'd6ce9a92-a3dc-4c39-86fb-1d0d5a6e0b26', '3729c6dd-e43a-4f61-ac9e-5a1609c88941'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:40:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-65a021bd-0ab3-405b-a4cf-086f6abe2fbb tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:40:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-65a021bd-0ab3-405b-a4cf-086f6abe2fbb tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:40:19 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-65a021bd-0ab3-405b-a4cf-086f6abe2fbb tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:40:19 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-65a021bd-0ab3-405b-a4cf-086f6abe2fbb tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:40:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-65a021bd-0ab3-405b-a4cf-086f6abe2fbb tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:40:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-65a021bd-0ab3-405b-a4cf-086f6abe2fbb tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:20 devstack sudo[95915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:40:20 devstack sudo[95915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:20 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b83ce258-773b-41af-a575-6872b2438fd6 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Acquiring lock "cinder-84241e2b-b301-49e3-be1e-1ab3889026d6-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:40:20 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b83ce258-773b-41af-a575-6872b2438fd6 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "cinder-84241e2b-b301-49e3-be1e-1ab3889026d6-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:40:20 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b83ce258-773b-41af-a575-6872b2438fd6 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Acquiring lock "cinder-quobyte-84241e2b-b301-49e3-be1e-1ab3889026d6" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:40:20 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b83ce258-773b-41af-a575-6872b2438fd6 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "cinder-quobyte-84241e2b-b301-49e3-be1e-1ab3889026d6" acquired by "delete_volume" :: waited 0.023s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:40:20 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d22694a-024f-4028-81de-8edb14eb5c63]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:40:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b83ce258-773b-41af-a575-6872b2438fd6 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-84241e2b-b301-49e3-be1e-1ab3889026d6 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:21 devstack sudo[95917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-84241e2b-b301-49e3-be1e-1ab3889026d6 Jul 08 01:40:21 devstack sudo[95917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:21 devstack sudo[95915]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-65a021bd-0ab3-405b-a4cf-086f6abe2fbb tempest-CreateVolumesFromSourceVolumeTest-640514927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.836s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:21 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-65a021bd-0ab3-405b-a4cf-086f6abe2fbb tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:40:21 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-65a021bd-0ab3-405b-a4cf-086f6abe2fbb tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Deleted volume successfully. Jul 08 01:40:21 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-65a021bd-0ab3-405b-a4cf-086f6abe2fbb tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "cinder-a4e33f6b-e2ce-4512-8bf0-c163153e6ea4-delete_volume" released by "delete_volume" :: held 6.453s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:40:22 devstack sudo[95893]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0f0030af-16f6-4544-ae56-edeac3eb64bd" returned: 0 in 7.930s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:22 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[885e6469-967e-419f-a298-6249ff3b8258]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:40:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:22 devstack sudo[95917]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b83ce258-773b-41af-a575-6872b2438fd6 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-84241e2b-b301-49e3-be1e-1ab3889026d6" returned: 0 in 2.138s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b83ce258-773b-41af-a575-6872b2438fd6 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-84241e2b-b301-49e3-be1e-1ab3889026d6 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:22 devstack sudo[95925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-84241e2b-b301-49e3-be1e-1ab3889026d6 Jul 08 01:40:22 devstack sudo[95925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:23 devstack sudo[95924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e Jul 08 01:40:23 devstack sudo[95924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:23 devstack sudo[95925]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b83ce258-773b-41af-a575-6872b2438fd6 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-84241e2b-b301-49e3-be1e-1ab3889026d6" returned: 0 in 0.775s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:23 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b83ce258-773b-41af-a575-6872b2438fd6 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "cinder-quobyte-84241e2b-b301-49e3-be1e-1ab3889026d6" released by "delete_volume" :: held 3.007s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:40:23 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-b83ce258-773b-41af-a575-6872b2438fd6 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Created reservations ['1167328c-d9b0-4033-bf21-e1d5ecb92e0a', 'c53e2b32-51f6-461d-9956-f077a8bfe620', '9f58af37-1716-4377-848a-cccb85356d2a', 'a35dfa4e-1746-4fa0-8bb3-fd2d98ac8659'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:40:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b83ce258-773b-41af-a575-6872b2438fd6 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:40:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b83ce258-773b-41af-a575-6872b2438fd6 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:40:23 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b83ce258-773b-41af-a575-6872b2438fd6 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:40:23 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b83ce258-773b-41af-a575-6872b2438fd6 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:40:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b83ce258-773b-41af-a575-6872b2438fd6 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:40:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b83ce258-773b-41af-a575-6872b2438fd6 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:23 devstack sudo[95931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:40:23 devstack sudo[95931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:24 devstack sudo[95924]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e" returned: 0 in 1.288s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:24 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Image conversion details: src /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e, size 1024.00 MB, duration 7.93 sec, destination /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0f0030af-16f6-4544-ae56-edeac3eb64bd {{(pid=87284) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:40:24 devstack cinder-volume[87284]: INFO cinder.image.image_utils [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Converted 1024.00 MB image at 129.11 MB/s Jul 08 01:40:24 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0f0030af-16f6-4544-ae56-edeac3eb64bd is being set with open permissions: ugo+rw Jul 08 01:40:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0f0030af-16f6-4544-ae56-edeac3eb64bd {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:24 devstack sudo[95934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0f0030af-16f6-4544-ae56-edeac3eb64bd Jul 08 01:40:24 devstack sudo[95934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:24 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-8461a56e-2297-456d-8647-2d517ac3bf58 req-b56ddd8e-f2ac-4c81-ab22-b1acefb4aca1 tempest-AttachVolumeNegativeTest-1884741045 None] Terminate volume connection completed successfully. Jul 08 01:40:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-8461a56e-2297-456d-8647-2d517ac3bf58 req-b56ddd8e-f2ac-4c81-ab22-b1acefb4aca1 tempest-AttachVolumeNegativeTest-1884741045 None] Deleting attachment 9e246e77-ccc5-49fe-98f1-74a5e543da4b. {{(pid=87284) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:40:24 devstack sudo[95931]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b83ce258-773b-41af-a575-6872b2438fd6 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.013s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:24 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-b83ce258-773b-41af-a575-6872b2438fd6 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:40:24 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-b83ce258-773b-41af-a575-6872b2438fd6 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Deleted volume successfully. Jul 08 01:40:24 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b83ce258-773b-41af-a575-6872b2438fd6 tempest-CreateVolumesFromSourceVolumeTest-640514927 None] Lock "cinder-84241e2b-b301-49e3-be1e-1ab3889026d6-delete_volume" released by "delete_volume" :: held 4.369s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:40:25 devstack sudo[95934]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0f0030af-16f6-4544-ae56-edeac3eb64bd" returned: 0 in 1.107s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:25 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-quobyte-0f0030af-16f6-4544-ae56-edeac3eb64bd" released by "_copy_volume_from_snapshot" :: held 13.158s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:40:25 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-quobyte-ddac1553-2344-48b4-b824-d3ae957f7128-0f0030af-16f6-4544-ae56-edeac3eb64bd" released by "_create_volume_from_snapshot" :: held 13.213s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:40:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.253s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:40:25 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1031eb59-fd52-4451-99d7-df7c48285ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f0030af-16f6-4544-ae56-edeac3eb64bd', 'volume_size': 2, 'snapshot_id': 'ddac1553-2344-48b4-b824-d3ae957f7128'}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:40:25 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9ebf5cc-8f42-4e51-acb5-2c76fb70fa53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:40:25 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Volume volume-0f0030af-16f6-4544-ae56-edeac3eb64bd (0f0030af-16f6-4544-ae56-edeac3eb64bd): created successfully Jul 08 01:40:25 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9ebf5cc-8f42-4e51-acb5-2c76fb70fa53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:40:25 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Flow 'volume_create_manager' (ddc9450c-b4d8-4175-9289-1675f7f0667f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:40:25 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-23507d62-7aff-4a3d-bf66-5d465ff16c23 tempest-VolumesSnapshotTestJSON-538859610 None] Created volume successfully. Jul 08 01:40:25 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c9798aab-50c1-4d21-b8c1-514703bffeaf tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "cinder-0f0030af-16f6-4544-ae56-edeac3eb64bd-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:40:25 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c9798aab-50c1-4d21-b8c1-514703bffeaf tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-0f0030af-16f6-4544-ae56-edeac3eb64bd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:40:25 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c9798aab-50c1-4d21-b8c1-514703bffeaf tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "cinder-quobyte-0f0030af-16f6-4544-ae56-edeac3eb64bd" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:40:25 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c9798aab-50c1-4d21-b8c1-514703bffeaf tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-quobyte-0f0030af-16f6-4544-ae56-edeac3eb64bd" acquired by "delete_volume" :: waited 0.026s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:40:25 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[b583275e-0e5a-4629-8a2c-6de9e62542c4]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:40:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c9798aab-50c1-4d21-b8c1-514703bffeaf tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0f0030af-16f6-4544-ae56-edeac3eb64bd {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:25 devstack sudo[95948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0f0030af-16f6-4544-ae56-edeac3eb64bd Jul 08 01:40:25 devstack sudo[95948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:27 devstack sudo[95948]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c9798aab-50c1-4d21-b8c1-514703bffeaf tempest-VolumesSnapshotTestJSON-538859610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0f0030af-16f6-4544-ae56-edeac3eb64bd" returned: 0 in 1.245s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c9798aab-50c1-4d21-b8c1-514703bffeaf tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0f0030af-16f6-4544-ae56-edeac3eb64bd {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:27 devstack sudo[95953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0f0030af-16f6-4544-ae56-edeac3eb64bd Jul 08 01:40:27 devstack sudo[95953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:27 devstack sudo[95953]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c9798aab-50c1-4d21-b8c1-514703bffeaf tempest-VolumesSnapshotTestJSON-538859610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0f0030af-16f6-4544-ae56-edeac3eb64bd" returned: 0 in 0.906s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:28 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c9798aab-50c1-4d21-b8c1-514703bffeaf tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-quobyte-0f0030af-16f6-4544-ae56-edeac3eb64bd" released by "delete_volume" :: held 2.223s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:40:28 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-c9798aab-50c1-4d21-b8c1-514703bffeaf tempest-VolumesSnapshotTestJSON-538859610 None] Created reservations ['7be3b98a-1c4a-4949-a038-f6157ac648a9', 'b8ad449a-f33a-47e2-8e5f-b22c5afd0c4a', '39b0c621-f22e-4dc4-a64c-7d50ff3c68ed', 'df4dc3fd-2c23-46b5-88cd-7680d53d6942'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:40:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c9798aab-50c1-4d21-b8c1-514703bffeaf tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:40:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c9798aab-50c1-4d21-b8c1-514703bffeaf tempest-VolumesSnapshotTestJSON-538859610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:40:28 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c9798aab-50c1-4d21-b8c1-514703bffeaf tempest-VolumesSnapshotTestJSON-538859610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:40:28 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c9798aab-50c1-4d21-b8c1-514703bffeaf tempest-VolumesSnapshotTestJSON-538859610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:40:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c9798aab-50c1-4d21-b8c1-514703bffeaf tempest-VolumesSnapshotTestJSON-538859610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:40:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c9798aab-50c1-4d21-b8c1-514703bffeaf tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:28 devstack sudo[95961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:40:28 devstack sudo[95961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:29 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-4cb4eb10-7b7c-4591-8917-425e7a2ed0aa tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "cinder-ddac1553-2344-48b4-b824-d3ae957f7128-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:40:29 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-4cb4eb10-7b7c-4591-8917-425e7a2ed0aa tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-ddac1553-2344-48b4-b824-d3ae957f7128-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:40:29 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-4cb4eb10-7b7c-4591-8917-425e7a2ed0aa tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "cinder-quobyte-818d1475-4254-4ea2-87a8-2a470991a01e" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:40:29 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-4cb4eb10-7b7c-4591-8917-425e7a2ed0aa tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-quobyte-818d1475-4254-4ea2-87a8-2a470991a01e" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:40:29 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-4cb4eb10-7b7c-4591-8917-425e7a2ed0aa tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "cinder-quobyte-ddac1553-2344-48b4-b824-d3ae957f7128" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:40:29 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-4cb4eb10-7b7c-4591-8917-425e7a2ed0aa tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-quobyte-ddac1553-2344-48b4-b824-d3ae957f7128" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:40:29 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-4cb4eb10-7b7c-4591-8917-425e7a2ed0aa tempest-VolumesSnapshotTestJSON-538859610 None] Deleting offline snapshot ddac1553-2344-48b4-b824-d3ae957f7128 of volume 818d1475-4254-4ea2-87a8-2a470991a01e {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:40:29 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-4cb4eb10-7b7c-4591-8917-425e7a2ed0aa tempest-VolumesSnapshotTestJSON-538859610 None] snapshot_file for this snap is: volume-818d1475-4254-4ea2-87a8-2a470991a01e.ddac1553-2344-48b4-b824-d3ae957f7128 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:40:29 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb99fd82-537f-4a68-878e-eff8059772f5]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:40:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4cb4eb10-7b7c-4591-8917-425e7a2ed0aa tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e.ddac1553-2344-48b4-b824-d3ae957f7128 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:29 devstack sudo[95961]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c9798aab-50c1-4d21-b8c1-514703bffeaf tempest-VolumesSnapshotTestJSON-538859610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.310s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:29 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-c9798aab-50c1-4d21-b8c1-514703bffeaf tempest-VolumesSnapshotTestJSON-538859610 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:40:29 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-c9798aab-50c1-4d21-b8c1-514703bffeaf tempest-VolumesSnapshotTestJSON-538859610 None] Deleted volume successfully. Jul 08 01:40:29 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c9798aab-50c1-4d21-b8c1-514703bffeaf tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-0f0030af-16f6-4544-ae56-edeac3eb64bd-delete_volume" released by "delete_volume" :: held 3.926s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:40:29 devstack sudo[96017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e.ddac1553-2344-48b4-b824-d3ae957f7128 Jul 08 01:40:29 devstack sudo[96017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:30 devstack sudo[96017]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4cb4eb10-7b7c-4591-8917-425e7a2ed0aa tempest-VolumesSnapshotTestJSON-538859610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e.ddac1553-2344-48b4-b824-d3ae957f7128" returned: 0 in 1.316s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:30 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-4cb4eb10-7b7c-4591-8917-425e7a2ed0aa tempest-VolumesSnapshotTestJSON-538859610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-818d1475-4254-4ea2-87a8-2a470991a01e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:40:30 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[d479c96a-6a2b-497a-8282-c392941a19d1]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:40:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4cb4eb10-7b7c-4591-8917-425e7a2ed0aa tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:30 devstack sudo[96026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e Jul 08 01:40:30 devstack sudo[96026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:31 devstack sudo[96026]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4cb4eb10-7b7c-4591-8917-425e7a2ed0aa tempest-VolumesSnapshotTestJSON-538859610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e" returned: 0 in 1.028s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4cb4eb10-7b7c-4591-8917-425e7a2ed0aa tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e.ddac1553-2344-48b4-b824-d3ae957f7128 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:31 devstack sudo[96033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e.ddac1553-2344-48b4-b824-d3ae957f7128 Jul 08 01:40:31 devstack sudo[96033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:32 devstack sudo[96033]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4cb4eb10-7b7c-4591-8917-425e7a2ed0aa tempest-VolumesSnapshotTestJSON-538859610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e.ddac1553-2344-48b4-b824-d3ae957f7128" returned: 0 in 1.167s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4cb4eb10-7b7c-4591-8917-425e7a2ed0aa tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e.ddac1553-2344-48b4-b824-d3ae957f7128 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:33 devstack sudo[96038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e.ddac1553-2344-48b4-b824-d3ae957f7128 Jul 08 01:40:33 devstack sudo[96038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:33 devstack sudo[96038]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4cb4eb10-7b7c-4591-8917-425e7a2ed0aa tempest-VolumesSnapshotTestJSON-538859610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e.ddac1553-2344-48b4-b824-d3ae957f7128" returned: 0 in 0.826s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:33 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-4cb4eb10-7b7c-4591-8917-425e7a2ed0aa tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-quobyte-ddac1553-2344-48b4-b824-d3ae957f7128" released by "_delete_snapshot" :: held 4.562s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:40:33 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-4cb4eb10-7b7c-4591-8917-425e7a2ed0aa tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-quobyte-818d1475-4254-4ea2-87a8-2a470991a01e" released by "delete_snapshot" :: held 4.613s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:40:34 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-4cb4eb10-7b7c-4591-8917-425e7a2ed0aa tempest-VolumesSnapshotTestJSON-538859610 None] Created reservations ['118659cf-aca5-4696-b8b3-07a3a952164d', '3cefbd4b-ea7a-4796-8403-2287cae0f3a1', '9c75ef8e-99a9-40d4-af4b-10fa56eeba7b', '5c7c16df-3dd1-4b66-a5a7-d26d199ecd68'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:40:34 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-4cb4eb10-7b7c-4591-8917-425e7a2ed0aa tempest-VolumesSnapshotTestJSON-538859610 None] Delete snapshot completed successfully. Jul 08 01:40:34 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-4cb4eb10-7b7c-4591-8917-425e7a2ed0aa tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-ddac1553-2344-48b4-b824-d3ae957f7128-delete_snapshot" released by "delete_snapshot" :: held 4.845s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:40:34 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-0070218b-5d13-46cc-ab45-d905f1d8b4c4 tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "cinder-818d1475-4254-4ea2-87a8-2a470991a01e-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:40:34 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-0070218b-5d13-46cc-ab45-d905f1d8b4c4 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-818d1475-4254-4ea2-87a8-2a470991a01e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:40:34 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-0070218b-5d13-46cc-ab45-d905f1d8b4c4 tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "cinder-quobyte-818d1475-4254-4ea2-87a8-2a470991a01e" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:40:34 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-0070218b-5d13-46cc-ab45-d905f1d8b4c4 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-quobyte-818d1475-4254-4ea2-87a8-2a470991a01e" acquired by "delete_volume" :: waited 0.023s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:40:35 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[90071965-f863-4153-a5b0-28b4d1235572]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:40:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0070218b-5d13-46cc-ab45-d905f1d8b4c4 tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:35 devstack sudo[96042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e Jul 08 01:40:35 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:36 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0070218b-5d13-46cc-ab45-d905f1d8b4c4 tempest-VolumesSnapshotTestJSON-538859610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e" returned: 0 in 1.018s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0070218b-5d13-46cc-ab45-d905f1d8b4c4 tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:36 devstack sudo[96047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e Jul 08 01:40:36 devstack sudo[96047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:36 devstack sudo[96047]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0070218b-5d13-46cc-ab45-d905f1d8b4c4 tempest-VolumesSnapshotTestJSON-538859610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-818d1475-4254-4ea2-87a8-2a470991a01e" returned: 0 in 0.776s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:36 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-0070218b-5d13-46cc-ab45-d905f1d8b4c4 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-quobyte-818d1475-4254-4ea2-87a8-2a470991a01e" released by "delete_volume" :: held 1.965s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:40:36 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-0070218b-5d13-46cc-ab45-d905f1d8b4c4 tempest-VolumesSnapshotTestJSON-538859610 None] Created reservations ['1025bc78-d0b4-4018-b409-e6cd89cf5d70', '5d1fbcf1-4e4f-4fb5-97f6-2bd50951e66b', '1e2735cf-72fb-46ca-994a-e8cbeeade070', '75a1e09c-97b0-42ed-bc2e-a0b2063afe53'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:40:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0070218b-5d13-46cc-ab45-d905f1d8b4c4 tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:40:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0070218b-5d13-46cc-ab45-d905f1d8b4c4 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:40:37 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0070218b-5d13-46cc-ab45-d905f1d8b4c4 tempest-VolumesSnapshotTestJSON-538859610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:40:37 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0070218b-5d13-46cc-ab45-d905f1d8b4c4 tempest-VolumesSnapshotTestJSON-538859610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:40:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0070218b-5d13-46cc-ab45-d905f1d8b4c4 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:40:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0070218b-5d13-46cc-ab45-d905f1d8b4c4 tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:37 devstack sudo[96050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:40:37 devstack sudo[96050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:38 devstack sudo[96050]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0070218b-5d13-46cc-ab45-d905f1d8b4c4 tempest-VolumesSnapshotTestJSON-538859610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.965s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:38 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-0070218b-5d13-46cc-ab45-d905f1d8b4c4 tempest-VolumesSnapshotTestJSON-538859610 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:40:38 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-0070218b-5d13-46cc-ab45-d905f1d8b4c4 tempest-VolumesSnapshotTestJSON-538859610 None] Deleted volume successfully. Jul 08 01:40:38 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-0070218b-5d13-46cc-ab45-d905f1d8b4c4 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-818d1475-4254-4ea2-87a8-2a470991a01e-delete_volume" released by "delete_volume" :: held 3.293s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:40:38 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-c63a6306-8000-4fd1-bb84-20c9533e7649 tempest-VolumesSnapshotTestJSON-538859610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:40:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c63a6306-8000-4fd1-bb84-20c9533e7649 tempest-VolumesSnapshotTestJSON-538859610 None] Flow 'volume_create_manager' (fbd6c051-d13d-48cb-a63f-be991a0fa9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:40:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c63a6306-8000-4fd1-bb84-20c9533e7649 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (315dd81c-896d-414c-a62a-fbbb840598dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:40:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c63a6306-8000-4fd1-bb84-20c9533e7649 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (315dd81c-896d-414c-a62a-fbbb840598dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1405314406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9515fe7a-2e93-4945-be2f-7229fe031f85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c25e1aa98c3045b6a87d7233ca8c49b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:40:38Z,use_quota=True,user_id='1c49d16162e446838c57af096485520f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:40:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c63a6306-8000-4fd1-bb84-20c9533e7649 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd86f11a-3b16-4107-8ea5-fda322441ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:40:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c63a6306-8000-4fd1-bb84-20c9533e7649 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd86f11a-3b16-4107-8ea5-fda322441ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:40:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c63a6306-8000-4fd1-bb84-20c9533e7649 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44ddcefb-d07f-411c-a895-890c3d99a2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:40:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c63a6306-8000-4fd1-bb84-20c9533e7649 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44ddcefb-d07f-411c-a895-890c3d99a2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9515fe7a-2e93-4945-be2f-7229fe031f85', 'volume_name': 'volume-9515fe7a-2e93-4945-be2f-7229fe031f85', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:40:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c63a6306-8000-4fd1-bb84-20c9533e7649 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (410f979e-fd16-4384-a5af-0018a3c00231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:40:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c63a6306-8000-4fd1-bb84-20c9533e7649 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (410f979e-fd16-4384-a5af-0018a3c00231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:40:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c63a6306-8000-4fd1-bb84-20c9533e7649 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a327fc21-a0c0-458c-b785-980ab7725a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:40:38 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-c63a6306-8000-4fd1-bb84-20c9533e7649 tempest-VolumesSnapshotTestJSON-538859610 None] Volume 9515fe7a-2e93-4945-be2f-7229fe031f85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9515fe7a-2e93-4945-be2f-7229fe031f85', 'volume_size': 1} Jul 08 01:40:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c63a6306-8000-4fd1-bb84-20c9533e7649 tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:40:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c63a6306-8000-4fd1-bb84-20c9533e7649 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:40:38 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c63a6306-8000-4fd1-bb84-20c9533e7649 tempest-VolumesSnapshotTestJSON-538859610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1405314406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9515fe7a-2e93-4945-be2f-7229fe031f85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c25e1aa98c3045b6a87d7233ca8c49b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:40:38Z,use_quota=True,user_id='1c49d16162e446838c57af096485520f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:40:38 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-c63a6306-8000-4fd1-bb84-20c9533e7649 tempest-VolumesSnapshotTestJSON-538859610 None] Creating volume 9515fe7a-2e93-4945-be2f-7229fe031f85 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:40:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c63a6306-8000-4fd1-bb84-20c9533e7649 tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:40:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c63a6306-8000-4fd1-bb84-20c9533e7649 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:40:38 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c63a6306-8000-4fd1-bb84-20c9533e7649 tempest-VolumesSnapshotTestJSON-538859610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:40:38 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c63a6306-8000-4fd1-bb84-20c9533e7649 tempest-VolumesSnapshotTestJSON-538859610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:40:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c63a6306-8000-4fd1-bb84-20c9533e7649 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:40:38 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c63a6306-8000-4fd1-bb84-20c9533e7649 tempest-VolumesSnapshotTestJSON-538859610 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:40:38 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-c63a6306-8000-4fd1-bb84-20c9533e7649 tempest-VolumesSnapshotTestJSON-538859610 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:40:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c63a6306-8000-4fd1-bb84-20c9533e7649 tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:38 devstack sudo[96055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85 1073741824 Jul 08 01:40:38 devstack sudo[96055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:39 devstack sudo[96055]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c63a6306-8000-4fd1-bb84-20c9533e7649 tempest-VolumesSnapshotTestJSON-538859610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85 1073741824" returned: 0 in 1.181s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c63a6306-8000-4fd1-bb84-20c9533e7649 tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:39 devstack sudo[96061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85 Jul 08 01:40:39 devstack sudo[96061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:40 devstack sudo[96061]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c63a6306-8000-4fd1-bb84-20c9533e7649 tempest-VolumesSnapshotTestJSON-538859610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85" returned: 0 in 0.860s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:40 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c63a6306-8000-4fd1-bb84-20c9533e7649 tempest-VolumesSnapshotTestJSON-538859610 None] <== create_volume: return (2106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:40:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c63a6306-8000-4fd1-bb84-20c9533e7649 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.108s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:40:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c63a6306-8000-4fd1-bb84-20c9533e7649 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a327fc21-a0c0-458c-b785-980ab7725a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9515fe7a-2e93-4945-be2f-7229fe031f85', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:40:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c63a6306-8000-4fd1-bb84-20c9533e7649 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ff37c20-7eab-4c78-8fa1-37a586045bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:40:40 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-c63a6306-8000-4fd1-bb84-20c9533e7649 tempest-VolumesSnapshotTestJSON-538859610 None] Volume volume-9515fe7a-2e93-4945-be2f-7229fe031f85 (9515fe7a-2e93-4945-be2f-7229fe031f85): created successfully Jul 08 01:40:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c63a6306-8000-4fd1-bb84-20c9533e7649 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ff37c20-7eab-4c78-8fa1-37a586045bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:40:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c63a6306-8000-4fd1-bb84-20c9533e7649 tempest-VolumesSnapshotTestJSON-538859610 None] Flow 'volume_create_manager' (fbd6c051-d13d-48cb-a63f-be991a0fa9ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:40:40 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-c63a6306-8000-4fd1-bb84-20c9533e7649 tempest-VolumesSnapshotTestJSON-538859610 None] Created volume successfully. Jul 08 01:40:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-d7ed9fd0-f4cc-431d-ac1d-676eede5d0f5 tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:40:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-d7ed9fd0-f4cc-431d-ac1d-676eede5d0f5 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:40:41 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-d7ed9fd0-f4cc-431d-ac1d-676eede5d0f5 tempest-VolumesSnapshotTestJSON-538859610 None] Creating offline snapshot 0f4ae5d3-9a1d-47da-8c01-3c85e79c7665 of volume 9515fe7a-2e93-4945-be2f-7229fe031f85 {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:40:41 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[f812b2e5-ff77-47d9-9b18-eec2f34b0ec0]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:40:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d7ed9fd0-f4cc-431d-ac1d-676eede5d0f5 tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:41 devstack sudo[96064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85 Jul 08 01:40:41 devstack sudo[96064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:42 devstack sudo[96064]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d7ed9fd0-f4cc-431d-ac1d-676eede5d0f5 tempest-VolumesSnapshotTestJSON-538859610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85" returned: 0 in 1.064s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d7ed9fd0-f4cc-431d-ac1d-676eede5d0f5 tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85.0f4ae5d3-9a1d-47da-8c01-3c85e79c7665 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:42 devstack sudo[96069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85.0f4ae5d3-9a1d-47da-8c01-3c85e79c7665 1G Jul 08 01:40:42 devstack sudo[96069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:43 devstack sudo[96069]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d7ed9fd0-f4cc-431d-ac1d-676eede5d0f5 tempest-VolumesSnapshotTestJSON-538859610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85.0f4ae5d3-9a1d-47da-8c01-3c85e79c7665 1G" returned: 0 in 1.103s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d7ed9fd0-f4cc-431d-ac1d-676eede5d0f5 tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9515fe7a-2e93-4945-be2f-7229fe031f85 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85.0f4ae5d3-9a1d-47da-8c01-3c85e79c7665 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:43 devstack sudo[96076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9515fe7a-2e93-4945-be2f-7229fe031f85 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85.0f4ae5d3-9a1d-47da-8c01-3c85e79c7665 Jul 08 01:40:43 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:44 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d7ed9fd0-f4cc-431d-ac1d-676eede5d0f5 tempest-VolumesSnapshotTestJSON-538859610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9515fe7a-2e93-4945-be2f-7229fe031f85 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85.0f4ae5d3-9a1d-47da-8c01-3c85e79c7665" returned: 0 in 0.873s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:44 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-d7ed9fd0-f4cc-431d-ac1d-676eede5d0f5 tempest-VolumesSnapshotTestJSON-538859610 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85.0f4ae5d3-9a1d-47da-8c01-3c85e79c7665 is being set with open permissions: ugo+rw Jul 08 01:40:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d7ed9fd0-f4cc-431d-ac1d-676eede5d0f5 tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85.0f4ae5d3-9a1d-47da-8c01-3c85e79c7665 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:44 devstack sudo[96082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85.0f4ae5d3-9a1d-47da-8c01-3c85e79c7665 Jul 08 01:40:44 devstack sudo[96082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:45 devstack sudo[96082]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d7ed9fd0-f4cc-431d-ac1d-676eede5d0f5 tempest-VolumesSnapshotTestJSON-538859610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85.0f4ae5d3-9a1d-47da-8c01-3c85e79c7665" returned: 0 in 0.699s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d7ed9fd0-f4cc-431d-ac1d-676eede5d0f5 tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:45 devstack sudo[96086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85.info Jul 08 01:40:45 devstack sudo[96086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:46 devstack sudo[96086]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d7ed9fd0-f4cc-431d-ac1d-676eede5d0f5 tempest-VolumesSnapshotTestJSON-538859610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85.info" returned: 0 in 0.894s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:46 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-d7ed9fd0-f4cc-431d-ac1d-676eede5d0f5 tempest-VolumesSnapshotTestJSON-538859610 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85.info is being set with open permissions: ugo+rw Jul 08 01:40:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d7ed9fd0-f4cc-431d-ac1d-676eede5d0f5 tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:46 devstack sudo[96089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85.info Jul 08 01:40:46 devstack sudo[96089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:47 devstack sudo[96089]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d7ed9fd0-f4cc-431d-ac1d-676eede5d0f5 tempest-VolumesSnapshotTestJSON-538859610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85.info" returned: 0 in 1.208s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-d7ed9fd0-f4cc-431d-ac1d-676eede5d0f5 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.977s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:40:47 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-d7ed9fd0-f4cc-431d-ac1d-676eede5d0f5 tempest-VolumesSnapshotTestJSON-538859610 None] Create snapshot completed successfully Jul 08 01:40:48 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:40:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Flow 'volume_create_manager' (209200b5-aac1-46fa-9f3c-4ae2f9d49adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:40:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f62b022-609e-455f-8c54-8c7061767f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:40:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f62b022-609e-455f-8c54-8c7061767f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-77622097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b357d30e-bd6d-4a21-866b-ff1ca9055dbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c25e1aa98c3045b6a87d7233ca8c49b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0f4ae5d3-9a1d-47da-8c01-3c85e79c7665,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:40:49Z,use_quota=True,user_id='1c49d16162e446838c57af096485520f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:40:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69520fc3-4b49-42f5-acf7-f226d90550e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:40:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69520fc3-4b49-42f5-acf7-f226d90550e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:40:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3bb15f3-5912-4a54-b60f-cced68fa0594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:40:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3bb15f3-5912-4a54-b60f-cced68fa0594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b357d30e-bd6d-4a21-866b-ff1ca9055dbc', 'volume_name': 'volume-b357d30e-bd6d-4a21-866b-ff1ca9055dbc', 'volume_size': 1, 'snapshot_id': '0f4ae5d3-9a1d-47da-8c01-3c85e79c7665'}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:40:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7e6503-64a7-430f-8f8a-095a9e0d9f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:40:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7e6503-64a7-430f-8f8a-095a9e0d9f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:40:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2bfab20-6523-4dd5-b6d2-1f2b6383847d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:40:48 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Volume b357d30e-bd6d-4a21-866b-ff1ca9055dbc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b357d30e-bd6d-4a21-866b-ff1ca9055dbc', 'volume_size': 1, 'snapshot_id': '0f4ae5d3-9a1d-47da-8c01-3c85e79c7665'} Jul 08 01:40:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:40:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:40:48 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "cinder-quobyte-0f4ae5d3-9a1d-47da-8c01-3c85e79c7665-b357d30e-bd6d-4a21-866b-ff1ca9055dbc" by "_create_volume_from_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:40:48 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-quobyte-0f4ae5d3-9a1d-47da-8c01-3c85e79c7665-b357d30e-bd6d-4a21-866b-ff1ca9055dbc" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:40:48 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Creating volume b357d30e-bd6d-4a21-866b-ff1ca9055dbc from snapshot 0f4ae5d3-9a1d-47da-8c01-3c85e79c7665 {{(pid=87284) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 01:40:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:40:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:40:48 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:40:48 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:40:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:40:48 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:40:48 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "cinder-quobyte-b357d30e-bd6d-4a21-866b-ff1ca9055dbc" by "_copy_volume_from_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:40:48 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-quobyte-b357d30e-bd6d-4a21-866b-ff1ca9055dbc" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:40:48 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] snapshot: 0f4ae5d3-9a1d-47da-8c01-3c85e79c7665, volume: b357d30e-bd6d-4a21-866b-ff1ca9055dbc, {{(pid=87284) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:40:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:40:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:40:48 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:40:48 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:40:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:40:49 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80152af-d5ae-4afd-9be7-77d16fb8e018]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:40:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85.0f4ae5d3-9a1d-47da-8c01-3c85e79c7665 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:49 devstack sudo[96092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85.0f4ae5d3-9a1d-47da-8c01-3c85e79c7665 Jul 08 01:40:49 devstack sudo[96092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:50 devstack sudo[96092]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85.0f4ae5d3-9a1d-47da-8c01-3c85e79c7665" returned: 0 in 1.078s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9515fe7a-2e93-4945-be2f-7229fe031f85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:40:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85 {{(pid=87284) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:40:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Creating direct copy from snapshot {{(pid=87284) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:40:50 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d6243b-f8f4-4439-8265-1df1ecb7a8b7]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:40:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:50 devstack sudo[96097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85 Jul 08 01:40:50 devstack sudo[96097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:51 devstack sudo[96097]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85" returned: 0 in 1.032s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:51 devstack cinder-volume[87284]: DEBUG cinder.utils [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Path /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b357d30e-bd6d-4a21-866b-ff1ca9055dbc not found in is_blk_device check {{(pid=87284) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:40:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b357d30e-bd6d-4a21-866b-ff1ca9055dbc {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:51 devstack sudo[96102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b357d30e-bd6d-4a21-866b-ff1ca9055dbc Jul 08 01:40:51 devstack sudo[96102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:55 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:40:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:40:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:40:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:40:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:40:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:40:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:55 devstack sudo[96119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:40:55 devstack sudo[96119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:57 devstack sudo[96119]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.841s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:57 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:40:57 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager._thread_info {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:40:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread count: 29 {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:40:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread info: [<_MainThread(MainThread, started 127058402500736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:40:58 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:UPDATE=66,cinder:SELECT=50,cinder:DELETE=8,cinder:INSERT=14 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:40:58 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=46,cinder:INSERT=16,cinder:UPDATE=63,cinder:DELETE=3 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:40:59 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:40:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Flow 'volume_create_manager' (971d815d-fec7-4588-91c2-9aebd540ba6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:40:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3350ab92-6375-4d7a-b139-7564c389842c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:40:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3350ab92-6375-4d7a-b139-7564c389842c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1940630199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1680554d-f816-42a4-819c-b52eadf31873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a63557a4be54cf89f798cfac3a0e02f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:40:59Z,use_quota=True,user_id='a12e6bfab84342869ba3aa9cdddb1165',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:40:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89ee6c23-fdc9-4f36-a71d-77685486445b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:40:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89ee6c23-fdc9-4f36-a71d-77685486445b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:40:59 devstack sudo[96102]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cc80a52-07fd-4350-9c7a-c49862e5c030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:40:59 devstack cinder-volume[87284]: DEBUG cinder.image.glance [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Creating Keystone auth plugin from conf {{(pid=87284) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:40:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b357d30e-bd6d-4a21-866b-ff1ca9055dbc" returned: 0 in 7.944s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:59 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ac78ee-3ea7-46c9-adde-84aa4b411622]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:40:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:59 devstack sudo[96125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85 Jul 08 01:40:59 devstack sudo[96125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cc80a52-07fd-4350-9c7a-c49862e5c030) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1680554d-f816-42a4-819c-b52eadf31873', 'volume_name': 'volume-1680554d-f816-42a4-819c-b52eadf31873', 'volume_size': 1, 'image_id': '24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '083157d49fd649eb95508535e9c547e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'created_at': datetime.datetime(2026, 7, 7, 23, 23, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 23, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24b75d01-af4a-40ff-909b-cfbb4c8e9193/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:40:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c28c5ab2-b8be-456c-b070-0ed6524c263a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:40:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c28c5ab2-b8be-456c-b070-0ed6524c263a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:40:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (224bfa65-322f-4ac8-9f94-538828b8cbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:40:59 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Volume 1680554d-f816-42a4-819c-b52eadf31873: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1680554d-f816-42a4-819c-b52eadf31873', 'volume_size': 1, 'image_id': '24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '083157d49fd649eb95508535e9c547e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'created_at': datetime.datetime(2026, 7, 7, 23, 23, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 23, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24b75d01-af4a-40ff-909b-cfbb4c8e9193/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 01:40:59 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Trying to clone 1680554d-f816-42a4-819c-b52eadf31873 from image 24b75d01-af4a-40ff-909b-cfbb4c8e9193 at location (None, [{'url': 'file:///opt/stack/data/glance/images/24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'metadata': {}}]). {{(pid=87284) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:40:59 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_fnxb8mwhdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87284) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:40:59 devstack cinder-volume[87284]: INFO cinder.image.image_utils [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Image download 20.69 MB at 20.69 MB/s Jul 08 01:40:59 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d72d6c8-dcc9-482b-933e-0adfc4f8a98f]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:40:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_fnxb8mwhdevstack@QuobyteHD {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:00 devstack sudo[96128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_fnxb8mwhdevstack@QuobyteHD Jul 08 01:41:00 devstack sudo[96128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:00 devstack sudo[96125]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85" returned: 0 in 1.141s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:00 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Image conversion details: src /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85, size 1024.00 MB, duration 7.95 sec, destination /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b357d30e-bd6d-4a21-866b-ff1ca9055dbc {{(pid=87284) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:41:00 devstack cinder-volume[87284]: INFO cinder.image.image_utils [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Converted 1024.00 MB image at 128.88 MB/s Jul 08 01:41:00 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b357d30e-bd6d-4a21-866b-ff1ca9055dbc is being set with open permissions: ugo+rw Jul 08 01:41:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b357d30e-bd6d-4a21-866b-ff1ca9055dbc {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:00 devstack sudo[96134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b357d30e-bd6d-4a21-866b-ff1ca9055dbc Jul 08 01:41:00 devstack sudo[96134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:00 devstack sudo[96128]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_fnxb8mwhdevstack@QuobyteHD" returned: 0 in 1.002s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:00 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Temporary image 24b75d01-af4a-40ff-909b-cfbb4c8e9193 is fetched for user a12e6bfab84342869ba3aa9cdddb1165. {{(pid=87284) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:41:01 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3957913-9fdd-41ab-b55e-09cf4db016ad]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:41:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_fnxb8mwhdevstack@QuobyteHD {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:01 devstack sudo[96134]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b357d30e-bd6d-4a21-866b-ff1ca9055dbc" returned: 0 in 1.005s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:01 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-quobyte-b357d30e-bd6d-4a21-866b-ff1ca9055dbc" released by "_copy_volume_from_snapshot" :: held 12.346s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:41:01 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-quobyte-0f4ae5d3-9a1d-47da-8c01-3c85e79c7665-b357d30e-bd6d-4a21-866b-ff1ca9055dbc" released by "_create_volume_from_snapshot" :: held 12.397s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:41:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.428s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:01 devstack sudo[96141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_fnxb8mwhdevstack@QuobyteHD Jul 08 01:41:01 devstack sudo[96141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2bfab20-6523-4dd5-b6d2-1f2b6383847d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b357d30e-bd6d-4a21-866b-ff1ca9055dbc', 'volume_size': 1, 'snapshot_id': '0f4ae5d3-9a1d-47da-8c01-3c85e79c7665'}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daa157c0-5747-459b-84a9-48047ee8e234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:01 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Volume volume-b357d30e-bd6d-4a21-866b-ff1ca9055dbc (b357d30e-bd6d-4a21-866b-ff1ca9055dbc): created successfully Jul 08 01:41:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daa157c0-5747-459b-84a9-48047ee8e234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Flow 'volume_create_manager' (209200b5-aac1-46fa-9f3c-4ae2f9d49adb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:41:01 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-0d3b78e5-9eb9-4376-bb43-33ab1c520021 tempest-VolumesSnapshotTestJSON-538859610 None] Created volume successfully. Jul 08 01:41:01 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f452495e-e868-446e-8b87-3f9c985b1121 tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "cinder-b357d30e-bd6d-4a21-866b-ff1ca9055dbc-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:41:01 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f452495e-e868-446e-8b87-3f9c985b1121 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-b357d30e-bd6d-4a21-866b-ff1ca9055dbc-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:41:01 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f452495e-e868-446e-8b87-3f9c985b1121 tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "cinder-quobyte-b357d30e-bd6d-4a21-866b-ff1ca9055dbc" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:41:01 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f452495e-e868-446e-8b87-3f9c985b1121 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-quobyte-b357d30e-bd6d-4a21-866b-ff1ca9055dbc" acquired by "delete_volume" :: waited 0.020s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:41:01 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d31ba7-078e-4f6e-8395-72f8fbf6bfa5]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:41:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f452495e-e868-446e-8b87-3f9c985b1121 tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b357d30e-bd6d-4a21-866b-ff1ca9055dbc {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:02 devstack sudo[96143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b357d30e-bd6d-4a21-866b-ff1ca9055dbc Jul 08 01:41:02 devstack sudo[96143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:02 devstack sudo[96141]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_fnxb8mwhdevstack@QuobyteHD" returned: 0 in 1.438s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:02 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1940630199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1680554d-f816-42a4-819c-b52eadf31873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a63557a4be54cf89f798cfac3a0e02f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:40:59Z,use_quota=True,user_id='a12e6bfab84342869ba3aa9cdddb1165',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:41:02 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Creating volume 1680554d-f816-42a4-819c-b52eadf31873 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:41:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:02 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:41:02 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:41:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:02 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:41:02 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:41:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:02 devstack sudo[96148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873 1073741824 Jul 08 01:41:02 devstack sudo[96148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:03 devstack sudo[96143]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f452495e-e868-446e-8b87-3f9c985b1121 tempest-VolumesSnapshotTestJSON-538859610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b357d30e-bd6d-4a21-866b-ff1ca9055dbc" returned: 0 in 1.387s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f452495e-e868-446e-8b87-3f9c985b1121 tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b357d30e-bd6d-4a21-866b-ff1ca9055dbc {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:03 devstack sudo[96163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b357d30e-bd6d-4a21-866b-ff1ca9055dbc Jul 08 01:41:03 devstack sudo[96163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:03 devstack sudo[96148]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873 1073741824" returned: 0 in 1.423s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:04 devstack sudo[96178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873 Jul 08 01:41:04 devstack sudo[96178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:04 devstack sudo[96163]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f452495e-e868-446e-8b87-3f9c985b1121 tempest-VolumesSnapshotTestJSON-538859610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b357d30e-bd6d-4a21-866b-ff1ca9055dbc" returned: 0 in 0.970s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:04 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f452495e-e868-446e-8b87-3f9c985b1121 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-quobyte-b357d30e-bd6d-4a21-866b-ff1ca9055dbc" released by "delete_volume" :: held 2.447s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:41:04 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-f452495e-e868-446e-8b87-3f9c985b1121 tempest-VolumesSnapshotTestJSON-538859610 None] Created reservations ['85053be9-4b51-4338-bb73-65fbcde27410', '8e7f9201-1aa7-454c-97a0-6b365a45e867', '25372b52-bb4a-4f18-b63e-93eebdb467b9', 'ad3a9dcc-ee1d-4a79-bbaf-a530911653f4'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:41:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f452495e-e868-446e-8b87-3f9c985b1121 tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f452495e-e868-446e-8b87-3f9c985b1121 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:04 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f452495e-e868-446e-8b87-3f9c985b1121 tempest-VolumesSnapshotTestJSON-538859610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:41:04 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f452495e-e868-446e-8b87-3f9c985b1121 tempest-VolumesSnapshotTestJSON-538859610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:41:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f452495e-e868-446e-8b87-3f9c985b1121 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f452495e-e868-446e-8b87-3f9c985b1121 tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:04 devstack sudo[96182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:41:04 devstack sudo[96182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:04 devstack sudo[96178]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873" returned: 0 in 0.977s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:04 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] <== create_volume: return (2460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:41:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.463s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:04 devstack cinder-volume[87284]: DEBUG cinder.volume.volume_utils [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Attempting download of 24b75d01-af4a-40ff-909b-cfbb4c8e9193 ((None, [{'url': 'file:///opt/stack/data/glance/images/24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'metadata': {}}])) to volume 1680554d-f816-42a4-819c-b52eadf31873. {{(pid=87284) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:41:05 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e773f5f-9bf4-4c54-a0b9-b00f33eb84ee]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:41:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24b75d01-af4a-40ff-909b-cfbb4c8e9193__6hnrc4s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:05 devstack sudo[96186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24b75d01-af4a-40ff-909b-cfbb4c8e9193__6hnrc4s Jul 08 01:41:05 devstack sudo[96186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:05 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d3564fb8-a781-4227-924b-a057b9e3b3fe tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "cinder-0f4ae5d3-9a1d-47da-8c01-3c85e79c7665-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:41:05 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d3564fb8-a781-4227-924b-a057b9e3b3fe tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-0f4ae5d3-9a1d-47da-8c01-3c85e79c7665-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:41:05 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d3564fb8-a781-4227-924b-a057b9e3b3fe tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "cinder-quobyte-9515fe7a-2e93-4945-be2f-7229fe031f85" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:41:05 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d3564fb8-a781-4227-924b-a057b9e3b3fe tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-quobyte-9515fe7a-2e93-4945-be2f-7229fe031f85" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:41:05 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d3564fb8-a781-4227-924b-a057b9e3b3fe tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "cinder-quobyte-0f4ae5d3-9a1d-47da-8c01-3c85e79c7665" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:41:05 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d3564fb8-a781-4227-924b-a057b9e3b3fe tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-quobyte-0f4ae5d3-9a1d-47da-8c01-3c85e79c7665" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:41:05 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-d3564fb8-a781-4227-924b-a057b9e3b3fe tempest-VolumesSnapshotTestJSON-538859610 None] Deleting offline snapshot 0f4ae5d3-9a1d-47da-8c01-3c85e79c7665 of volume 9515fe7a-2e93-4945-be2f-7229fe031f85 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:41:05 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-d3564fb8-a781-4227-924b-a057b9e3b3fe tempest-VolumesSnapshotTestJSON-538859610 None] snapshot_file for this snap is: volume-9515fe7a-2e93-4945-be2f-7229fe031f85.0f4ae5d3-9a1d-47da-8c01-3c85e79c7665 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:41:05 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6560173-f41c-4097-9300-cf0f610881e4]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:41:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d3564fb8-a781-4227-924b-a057b9e3b3fe tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85.0f4ae5d3-9a1d-47da-8c01-3c85e79c7665 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:05 devstack sudo[96189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85.0f4ae5d3-9a1d-47da-8c01-3c85e79c7665 Jul 08 01:41:05 devstack sudo[96189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:05 devstack sudo[96182]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f452495e-e868-446e-8b87-3f9c985b1121 tempest-VolumesSnapshotTestJSON-538859610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.035s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:05 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-f452495e-e868-446e-8b87-3f9c985b1121 tempest-VolumesSnapshotTestJSON-538859610 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:41:05 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-f452495e-e868-446e-8b87-3f9c985b1121 tempest-VolumesSnapshotTestJSON-538859610 None] Deleted volume successfully. Jul 08 01:41:05 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f452495e-e868-446e-8b87-3f9c985b1121 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-b357d30e-bd6d-4a21-866b-ff1ca9055dbc-delete_volume" released by "delete_volume" :: held 3.961s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:41:06 devstack sudo[96186]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24b75d01-af4a-40ff-909b-cfbb4c8e9193__6hnrc4s" returned: 0 in 1.160s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24b75d01-af4a-40ff-909b-cfbb4c8e9193__6hnrc4s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:06 devstack sudo[96193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24b75d01-af4a-40ff-909b-cfbb4c8e9193__6hnrc4s Jul 08 01:41:06 devstack sudo[96193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:06 devstack sudo[96189]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d3564fb8-a781-4227-924b-a057b9e3b3fe tempest-VolumesSnapshotTestJSON-538859610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85.0f4ae5d3-9a1d-47da-8c01-3c85e79c7665" returned: 0 in 1.081s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:06 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-d3564fb8-a781-4227-924b-a057b9e3b3fe tempest-VolumesSnapshotTestJSON-538859610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9515fe7a-2e93-4945-be2f-7229fe031f85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:41:06 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[2783fbbd-f4e5-40b1-afc5-db932ee98b33]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:41:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d3564fb8-a781-4227-924b-a057b9e3b3fe tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:06 devstack sudo[96199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85 Jul 08 01:41:06 devstack sudo[96199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:07 devstack sudo[96193]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24b75d01-af4a-40ff-909b-cfbb4c8e9193__6hnrc4s" returned: 1 in 0.948s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24b75d01-af4a-40ff-909b-cfbb4c8e9193__6hnrc4s' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:41:07 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9436c5c-7d2f-445b-a146-40b992878b8a]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:41:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_fnxb8mwhdevstack@QuobyteHD {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:07 devstack sudo[96203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_fnxb8mwhdevstack@QuobyteHD Jul 08 01:41:07 devstack sudo[96203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:07 devstack sudo[96199]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d3564fb8-a781-4227-924b-a057b9e3b3fe tempest-VolumesSnapshotTestJSON-538859610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85" returned: 0 in 1.108s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d3564fb8-a781-4227-924b-a057b9e3b3fe tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85.0f4ae5d3-9a1d-47da-8c01-3c85e79c7665 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:07 devstack sudo[96208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85.0f4ae5d3-9a1d-47da-8c01-3c85e79c7665 Jul 08 01:41:07 devstack sudo[96208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:08 devstack sudo[96203]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_fnxb8mwhdevstack@QuobyteHD" returned: 0 in 1.025s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:08 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] 24b75d01-af4a-40ff-909b-cfbb4c8e9193 was qcow2, converting to raw {{(pid=87284) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:41:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_fnxb8mwhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:08 devstack sudo[96213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_fnxb8mwhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873 Jul 08 01:41:08 devstack sudo[96213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:08 devstack sudo[96208]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d3564fb8-a781-4227-924b-a057b9e3b3fe tempest-VolumesSnapshotTestJSON-538859610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85.0f4ae5d3-9a1d-47da-8c01-3c85e79c7665" returned: 0 in 1.167s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d3564fb8-a781-4227-924b-a057b9e3b3fe tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85.0f4ae5d3-9a1d-47da-8c01-3c85e79c7665 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:08 devstack sudo[96230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85.0f4ae5d3-9a1d-47da-8c01-3c85e79c7665 Jul 08 01:41:08 devstack sudo[96230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:10 devstack sudo[96230]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d3564fb8-a781-4227-924b-a057b9e3b3fe tempest-VolumesSnapshotTestJSON-538859610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85.0f4ae5d3-9a1d-47da-8c01-3c85e79c7665" returned: 0 in 1.314s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:10 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d3564fb8-a781-4227-924b-a057b9e3b3fe tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-quobyte-0f4ae5d3-9a1d-47da-8c01-3c85e79c7665" released by "_delete_snapshot" :: held 4.801s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:41:10 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d3564fb8-a781-4227-924b-a057b9e3b3fe tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-quobyte-9515fe7a-2e93-4945-be2f-7229fe031f85" released by "delete_snapshot" :: held 4.833s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:41:10 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-d3564fb8-a781-4227-924b-a057b9e3b3fe tempest-VolumesSnapshotTestJSON-538859610 None] Created reservations ['e01fefb9-449e-4b89-9c70-d16ab75c4544', '0da694ff-2f7a-4e67-b0a9-2c36a102a633', 'f00aa2c4-fe6e-4ec4-9e08-a70e0af550af', '5ae7a16c-fa95-4442-9cfd-f730b3f2f5f3'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:41:10 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-d3564fb8-a781-4227-924b-a057b9e3b3fe tempest-VolumesSnapshotTestJSON-538859610 None] Delete snapshot completed successfully. Jul 08 01:41:10 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d3564fb8-a781-4227-924b-a057b9e3b3fe tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-0f4ae5d3-9a1d-47da-8c01-3c85e79c7665-delete_snapshot" released by "delete_snapshot" :: held 5.072s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:41:10 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e8cf1110-e79b-445e-aeb3-44f9c4b36ff7 tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "cinder-9515fe7a-2e93-4945-be2f-7229fe031f85-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:41:10 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e8cf1110-e79b-445e-aeb3-44f9c4b36ff7 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-9515fe7a-2e93-4945-be2f-7229fe031f85-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:41:11 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e8cf1110-e79b-445e-aeb3-44f9c4b36ff7 tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "cinder-quobyte-9515fe7a-2e93-4945-be2f-7229fe031f85" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:41:11 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e8cf1110-e79b-445e-aeb3-44f9c4b36ff7 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-quobyte-9515fe7a-2e93-4945-be2f-7229fe031f85" acquired by "delete_volume" :: waited 0.034s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:41:11 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96f193c-025d-4fdc-a942-80518a8ca70b]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:41:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e8cf1110-e79b-445e-aeb3-44f9c4b36ff7 tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:11 devstack sudo[96293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85 Jul 08 01:41:11 devstack sudo[96293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:11 devstack sudo[96213]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_fnxb8mwhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873" returned: 0 in 3.424s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:11 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_fnxb8mwhdevstack@QuobyteHD, size 112.00 MB, duration 3.43 sec, destination /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873 {{(pid=87284) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:41:11 devstack cinder-volume[87284]: INFO cinder.image.image_utils [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Converted 112.00 MB image at 32.70 MB/s Jul 08 01:41:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:11 devstack sudo[96295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873 1G Jul 08 01:41:11 devstack sudo[96295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:12 devstack sudo[96293]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e8cf1110-e79b-445e-aeb3-44f9c4b36ff7 tempest-VolumesSnapshotTestJSON-538859610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85" returned: 0 in 1.379s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e8cf1110-e79b-445e-aeb3-44f9c4b36ff7 tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:12 devstack sudo[96302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85 Jul 08 01:41:12 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:12 devstack sudo[96295]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873 1G" returned: 0 in 1.303s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:13 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a40d5a8-94a4-4fa6-9d1d-85769b64847f]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:41:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:13 devstack sudo[96307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873 Jul 08 01:41:13 devstack sudo[96307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:14 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e8cf1110-e79b-445e-aeb3-44f9c4b36ff7 tempest-VolumesSnapshotTestJSON-538859610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9515fe7a-2e93-4945-be2f-7229fe031f85" returned: 0 in 2.058s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:14 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e8cf1110-e79b-445e-aeb3-44f9c4b36ff7 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-quobyte-9515fe7a-2e93-4945-be2f-7229fe031f85" released by "delete_volume" :: held 3.570s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:41:14 devstack sudo[96307]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873" returned: 0 in 1.725s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:14 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-e8cf1110-e79b-445e-aeb3-44f9c4b36ff7 tempest-VolumesSnapshotTestJSON-538859610 None] Created reservations ['d10add2d-e672-4c83-843c-0d4e5aa09e84', 'b96df02d-2e68-4787-8567-138e366496a3', 'afdeebbc-09ba-498f-9c2b-1698bb4eab33', 'a66fe5eb-c601-45e3-af5a-1b3072c3417d'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:41:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e8cf1110-e79b-445e-aeb3-44f9c4b36ff7 tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e8cf1110-e79b-445e-aeb3-44f9c4b36ff7 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:14 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e8cf1110-e79b-445e-aeb3-44f9c4b36ff7 tempest-VolumesSnapshotTestJSON-538859610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:41:14 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e8cf1110-e79b-445e-aeb3-44f9c4b36ff7 tempest-VolumesSnapshotTestJSON-538859610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:41:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e8cf1110-e79b-445e-aeb3-44f9c4b36ff7 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e8cf1110-e79b-445e-aeb3-44f9c4b36ff7 tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:14 devstack sudo[96312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873 Jul 08 01:41:14 devstack sudo[96312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:15 devstack sudo[96314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:41:15 devstack sudo[96314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:15 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c9227695-e6ed-43ee-bf26-1697d6067467 tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "cinder-2d90040a-f015-437d-b3ea-f07a3c980759-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:41:15 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c9227695-e6ed-43ee-bf26-1697d6067467 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-2d90040a-f015-437d-b3ea-f07a3c980759-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:41:16 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c9227695-e6ed-43ee-bf26-1697d6067467 tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "cinder-quobyte-2d90040a-f015-437d-b3ea-f07a3c980759" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:41:16 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c9227695-e6ed-43ee-bf26-1697d6067467 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-quobyte-2d90040a-f015-437d-b3ea-f07a3c980759" acquired by "delete_volume" :: waited 0.043s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:41:16 devstack sudo[96314]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e8cf1110-e79b-445e-aeb3-44f9c4b36ff7 tempest-VolumesSnapshotTestJSON-538859610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.205s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:16 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-e8cf1110-e79b-445e-aeb3-44f9c4b36ff7 tempest-VolumesSnapshotTestJSON-538859610 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:41:16 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-e8cf1110-e79b-445e-aeb3-44f9c4b36ff7 tempest-VolumesSnapshotTestJSON-538859610 None] Deleted volume successfully. Jul 08 01:41:16 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac74f876-3701-435e-81da-c8d1c0c2ae46]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:41:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c9227695-e6ed-43ee-bf26-1697d6067467 tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:16 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e8cf1110-e79b-445e-aeb3-44f9c4b36ff7 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-9515fe7a-2e93-4945-be2f-7229fe031f85-delete_volume" released by "delete_volume" :: held 5.268s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:41:16 devstack sudo[96318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759 Jul 08 01:41:16 devstack sudo[96318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:16 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c503f6a-663c-4b1c-b88c-e7ed137f88f2 tempest-SnapshotDependencyTests-770254984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:41:16 devstack sudo[96312]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6c503f6a-663c-4b1c-b88c-e7ed137f88f2 tempest-SnapshotDependencyTests-770254984 None] Flow 'volume_create_manager' (bfb4f976-c80d-442b-b8cd-aa9329c9d3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:41:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6c503f6a-663c-4b1c-b88c-e7ed137f88f2 tempest-SnapshotDependencyTests-770254984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9c4ef45-cc97-4a24-b948-6bf69c5726b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873" returned: 1 in 1.793s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:41:16 devstack cinder-volume[87284]: DEBUG cinder.volume.volume_utils [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Downloaded image 24b75d01-af4a-40ff-909b-cfbb4c8e9193 ((None, [{'url': 'file:///opt/stack/data/glance/images/24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'metadata': {}}])) to volume 1680554d-f816-42a4-819c-b52eadf31873 successfully. {{(pid=87284) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:41:16 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Temporary image 24b75d01-af4a-40ff-909b-cfbb4c8e9193 for user a12e6bfab84342869ba3aa9cdddb1165 is deleted. {{(pid=87284) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:41:16 devstack cinder-volume[87284]: DEBUG cinder.volume.volume_utils [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Marking volume 1680554d-f816-42a4-819c-b52eadf31873 as bootable. {{(pid=87284) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:41:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6c503f6a-663c-4b1c-b88c-e7ed137f88f2 tempest-SnapshotDependencyTests-770254984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9c4ef45-cc97-4a24-b948-6bf69c5726b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-402503871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df115741-408b-4893-80b4-54baa79858fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3252d1a77e9740d58180f20e6ef76f1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:41:16Z,use_quota=True,user_id='06526e07d65e41679cfc7591d78c153c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6c503f6a-663c-4b1c-b88c-e7ed137f88f2 tempest-SnapshotDependencyTests-770254984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6b54be1-9a44-4f76-9e22-73eaff59f6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6c503f6a-663c-4b1c-b88c-e7ed137f88f2 tempest-SnapshotDependencyTests-770254984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6b54be1-9a44-4f76-9e22-73eaff59f6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6c503f6a-663c-4b1c-b88c-e7ed137f88f2 tempest-SnapshotDependencyTests-770254984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (427d76da-25aa-48c3-8f7f-39f2b3da11be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6c503f6a-663c-4b1c-b88c-e7ed137f88f2 tempest-SnapshotDependencyTests-770254984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (427d76da-25aa-48c3-8f7f-39f2b3da11be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df115741-408b-4893-80b4-54baa79858fe', 'volume_name': 'volume-df115741-408b-4893-80b4-54baa79858fe', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6c503f6a-663c-4b1c-b88c-e7ed137f88f2 tempest-SnapshotDependencyTests-770254984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6022a0d7-8247-4654-a81b-382eaa11e1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6c503f6a-663c-4b1c-b88c-e7ed137f88f2 tempest-SnapshotDependencyTests-770254984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6022a0d7-8247-4654-a81b-382eaa11e1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6c503f6a-663c-4b1c-b88c-e7ed137f88f2 tempest-SnapshotDependencyTests-770254984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1665a1a5-6f97-4084-b112-92d9ca3cd210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:16 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-6c503f6a-663c-4b1c-b88c-e7ed137f88f2 tempest-SnapshotDependencyTests-770254984 None] Volume df115741-408b-4893-80b4-54baa79858fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df115741-408b-4893-80b4-54baa79858fe', 'volume_size': 1} Jul 08 01:41:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6c503f6a-663c-4b1c-b88c-e7ed137f88f2 tempest-SnapshotDependencyTests-770254984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6c503f6a-663c-4b1c-b88c-e7ed137f88f2 tempest-SnapshotDependencyTests-770254984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:16 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-6c503f6a-663c-4b1c-b88c-e7ed137f88f2 tempest-SnapshotDependencyTests-770254984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-402503871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df115741-408b-4893-80b4-54baa79858fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3252d1a77e9740d58180f20e6ef76f1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:41:16Z,use_quota=True,user_id='06526e07d65e41679cfc7591d78c153c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:41:16 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-6c503f6a-663c-4b1c-b88c-e7ed137f88f2 tempest-SnapshotDependencyTests-770254984 None] Creating volume df115741-408b-4893-80b4-54baa79858fe {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:41:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6c503f6a-663c-4b1c-b88c-e7ed137f88f2 tempest-SnapshotDependencyTests-770254984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6c503f6a-663c-4b1c-b88c-e7ed137f88f2 tempest-SnapshotDependencyTests-770254984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:16 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-6c503f6a-663c-4b1c-b88c-e7ed137f88f2 tempest-SnapshotDependencyTests-770254984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:41:16 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-6c503f6a-663c-4b1c-b88c-e7ed137f88f2 tempest-SnapshotDependencyTests-770254984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:41:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6c503f6a-663c-4b1c-b88c-e7ed137f88f2 tempest-SnapshotDependencyTests-770254984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:16 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-6c503f6a-663c-4b1c-b88c-e7ed137f88f2 tempest-SnapshotDependencyTests-770254984 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:41:16 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-6c503f6a-663c-4b1c-b88c-e7ed137f88f2 tempest-SnapshotDependencyTests-770254984 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:41:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6c503f6a-663c-4b1c-b88c-e7ed137f88f2 tempest-SnapshotDependencyTests-770254984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:16 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Copying metadata from image 24b75d01-af4a-40ff-909b-cfbb4c8e9193 to 1680554d-f816-42a4-819c-b52eadf31873. {{(pid=87284) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:41:16 devstack sudo[96323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe 1073741824 Jul 08 01:41:16 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Creating volume glance metadata for volume 1680554d-f816-42a4-819c-b52eadf31873 backed by image 24b75d01-af4a-40ff-909b-cfbb4c8e9193 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87284) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:41:16 devstack sudo[96323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:17 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (224bfa65-322f-4ac8-9f94-538828b8cbb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1680554d-f816-42a4-819c-b52eadf31873', 'volume_size': 1, 'image_id': '24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '083157d49fd649eb95508535e9c547e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'created_at': datetime.datetime(2026, 7, 7, 23, 23, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 23, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24b75d01-af4a-40ff-909b-cfbb4c8e9193/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:17 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ade6a4f-8bb9-4d55-b75b-49ea223f6660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:17 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Volume volume-1680554d-f816-42a4-819c-b52eadf31873 (1680554d-f816-42a4-819c-b52eadf31873): created successfully Jul 08 01:41:17 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ade6a4f-8bb9-4d55-b75b-49ea223f6660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:17 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Flow 'volume_create_manager' (971d815d-fec7-4588-91c2-9aebd540ba6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:41:17 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-a984c151-ca98-4cf0-ac42-e3b2d88eb1b7 tempest-TestShelveInstance-1724066282 None] Created volume successfully. Jul 08 01:41:17 devstack sudo[96318]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c9227695-e6ed-43ee-bf26-1697d6067467 tempest-VolumesSnapshotTestJSON-538859610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759" returned: 0 in 1.086s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c9227695-e6ed-43ee-bf26-1697d6067467 tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:17 devstack sudo[96328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759 Jul 08 01:41:17 devstack sudo[96328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:17 devstack sudo[96323]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6c503f6a-663c-4b1c-b88c-e7ed137f88f2 tempest-SnapshotDependencyTests-770254984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe 1073741824" returned: 0 in 1.211s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6c503f6a-663c-4b1c-b88c-e7ed137f88f2 tempest-SnapshotDependencyTests-770254984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:17 devstack sudo[96335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe Jul 08 01:41:17 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:18 devstack sudo[96328]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c9227695-e6ed-43ee-bf26-1697d6067467 tempest-VolumesSnapshotTestJSON-538859610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2d90040a-f015-437d-b3ea-f07a3c980759" returned: 0 in 0.932s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:18 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c9227695-e6ed-43ee-bf26-1697d6067467 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-quobyte-2d90040a-f015-437d-b3ea-f07a3c980759" released by "delete_volume" :: held 2.224s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:41:18 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-c9227695-e6ed-43ee-bf26-1697d6067467 tempest-VolumesSnapshotTestJSON-538859610 None] Created reservations ['d75d0219-98de-43ec-8757-ea9d643ceda5', '6a298e1b-e5cb-4753-a69f-aca1c7451d57', '33461706-3d5f-4576-b815-b0b3d75847e6', 'fecd231b-c312-4eec-a62e-33c3a0f6d58e'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:41:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c9227695-e6ed-43ee-bf26-1697d6067467 tempest-VolumesSnapshotTestJSON-538859610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c9227695-e6ed-43ee-bf26-1697d6067467 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:18 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c9227695-e6ed-43ee-bf26-1697d6067467 tempest-VolumesSnapshotTestJSON-538859610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:41:18 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c9227695-e6ed-43ee-bf26-1697d6067467 tempest-VolumesSnapshotTestJSON-538859610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:41:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c9227695-e6ed-43ee-bf26-1697d6067467 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c9227695-e6ed-43ee-bf26-1697d6067467 tempest-VolumesSnapshotTestJSON-538859610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:18 devstack sudo[96338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:41:18 devstack sudo[96338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:19 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6c503f6a-663c-4b1c-b88c-e7ed137f88f2 tempest-SnapshotDependencyTests-770254984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe" returned: 0 in 1.243s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:19 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-6c503f6a-663c-4b1c-b88c-e7ed137f88f2 tempest-SnapshotDependencyTests-770254984 None] <== create_volume: return (2511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:41:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6c503f6a-663c-4b1c-b88c-e7ed137f88f2 tempest-SnapshotDependencyTests-770254984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.516s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:19 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6c503f6a-663c-4b1c-b88c-e7ed137f88f2 tempest-SnapshotDependencyTests-770254984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1665a1a5-6f97-4084-b112-92d9ca3cd210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df115741-408b-4893-80b4-54baa79858fe', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:19 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6c503f6a-663c-4b1c-b88c-e7ed137f88f2 tempest-SnapshotDependencyTests-770254984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7292b84f-dc81-4cc3-93c6-bb9efff216d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:19 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-6c503f6a-663c-4b1c-b88c-e7ed137f88f2 tempest-SnapshotDependencyTests-770254984 None] Volume volume-df115741-408b-4893-80b4-54baa79858fe (df115741-408b-4893-80b4-54baa79858fe): created successfully Jul 08 01:41:19 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6c503f6a-663c-4b1c-b88c-e7ed137f88f2 tempest-SnapshotDependencyTests-770254984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7292b84f-dc81-4cc3-93c6-bb9efff216d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:19 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6c503f6a-663c-4b1c-b88c-e7ed137f88f2 tempest-SnapshotDependencyTests-770254984 None] Flow 'volume_create_manager' (bfb4f976-c80d-442b-b8cd-aa9329c9d3c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:41:19 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-6c503f6a-663c-4b1c-b88c-e7ed137f88f2 tempest-SnapshotDependencyTests-770254984 None] Created volume successfully. Jul 08 01:41:19 devstack sudo[96338]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c9227695-e6ed-43ee-bf26-1697d6067467 tempest-VolumesSnapshotTestJSON-538859610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.161s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:19 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-c9227695-e6ed-43ee-bf26-1697d6067467 tempest-VolumesSnapshotTestJSON-538859610 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:41:19 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-c9227695-e6ed-43ee-bf26-1697d6067467 tempest-VolumesSnapshotTestJSON-538859610 None] Deleted volume successfully. Jul 08 01:41:19 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c9227695-e6ed-43ee-bf26-1697d6067467 tempest-VolumesSnapshotTestJSON-538859610 None] Lock "cinder-2d90040a-f015-437d-b3ea-f07a3c980759-delete_volume" released by "delete_volume" :: held 3.883s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:41:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ca97e479-0981-425f-9fe7-8bf2fa6b9878 tempest-SnapshotDependencyTests-770254984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ca97e479-0981-425f-9fe7-8bf2fa6b9878 tempest-SnapshotDependencyTests-770254984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:20 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-ca97e479-0981-425f-9fe7-8bf2fa6b9878 tempest-SnapshotDependencyTests-770254984 None] Creating offline snapshot 8be283ec-4f5d-4f37-9d78-34346a76b9fd of volume df115741-408b-4893-80b4-54baa79858fe {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:41:20 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[c665eb07-fcaf-476f-99fe-633c4444a02d]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:41:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ca97e479-0981-425f-9fe7-8bf2fa6b9878 tempest-SnapshotDependencyTests-770254984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:20 devstack sudo[96345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe Jul 08 01:41:20 devstack sudo[96345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:21 devstack sudo[96345]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ca97e479-0981-425f-9fe7-8bf2fa6b9878 tempest-SnapshotDependencyTests-770254984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe" returned: 0 in 1.358s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ca97e479-0981-425f-9fe7-8bf2fa6b9878 tempest-SnapshotDependencyTests-770254984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe.8be283ec-4f5d-4f37-9d78-34346a76b9fd 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:21 devstack sudo[96351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe.8be283ec-4f5d-4f37-9d78-34346a76b9fd 1G Jul 08 01:41:21 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:22 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ca97e479-0981-425f-9fe7-8bf2fa6b9878 tempest-SnapshotDependencyTests-770254984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe.8be283ec-4f5d-4f37-9d78-34346a76b9fd 1G" returned: 0 in 1.067s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ca97e479-0981-425f-9fe7-8bf2fa6b9878 tempest-SnapshotDependencyTests-770254984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df115741-408b-4893-80b4-54baa79858fe -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe.8be283ec-4f5d-4f37-9d78-34346a76b9fd {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:22 devstack sudo[96358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df115741-408b-4893-80b4-54baa79858fe -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe.8be283ec-4f5d-4f37-9d78-34346a76b9fd Jul 08 01:41:22 devstack sudo[96358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:23 devstack sudo[96358]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ca97e479-0981-425f-9fe7-8bf2fa6b9878 tempest-SnapshotDependencyTests-770254984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df115741-408b-4893-80b4-54baa79858fe -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe.8be283ec-4f5d-4f37-9d78-34346a76b9fd" returned: 0 in 0.830s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:23 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-ca97e479-0981-425f-9fe7-8bf2fa6b9878 tempest-SnapshotDependencyTests-770254984 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe.8be283ec-4f5d-4f37-9d78-34346a76b9fd is being set with open permissions: ugo+rw Jul 08 01:41:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ca97e479-0981-425f-9fe7-8bf2fa6b9878 tempest-SnapshotDependencyTests-770254984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe.8be283ec-4f5d-4f37-9d78-34346a76b9fd {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:23 devstack sudo[96363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe.8be283ec-4f5d-4f37-9d78-34346a76b9fd Jul 08 01:41:23 devstack sudo[96363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:24 devstack sudo[96363]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ca97e479-0981-425f-9fe7-8bf2fa6b9878 tempest-SnapshotDependencyTests-770254984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe.8be283ec-4f5d-4f37-9d78-34346a76b9fd" returned: 0 in 1.011s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ca97e479-0981-425f-9fe7-8bf2fa6b9878 tempest-SnapshotDependencyTests-770254984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:24 devstack sudo[96367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe.info Jul 08 01:41:24 devstack sudo[96367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:25 devstack sudo[96367]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ca97e479-0981-425f-9fe7-8bf2fa6b9878 tempest-SnapshotDependencyTests-770254984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe.info" returned: 0 in 1.102s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:25 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-ca97e479-0981-425f-9fe7-8bf2fa6b9878 tempest-SnapshotDependencyTests-770254984 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe.info is being set with open permissions: ugo+rw Jul 08 01:41:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ca97e479-0981-425f-9fe7-8bf2fa6b9878 tempest-SnapshotDependencyTests-770254984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:25 devstack sudo[96396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe.info Jul 08 01:41:25 devstack sudo[96396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:26 devstack sudo[96396]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ca97e479-0981-425f-9fe7-8bf2fa6b9878 tempest-SnapshotDependencyTests-770254984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe.info" returned: 0 in 1.309s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ca97e479-0981-425f-9fe7-8bf2fa6b9878 tempest-SnapshotDependencyTests-770254984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.851s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:26 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-ca97e479-0981-425f-9fe7-8bf2fa6b9878 tempest-SnapshotDependencyTests-770254984 None] Create snapshot completed successfully Jul 08 01:41:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-4aa170b6-7037-40b3-bb12-f8dd05d7a13c req-01402f39-0457-41f9-b37a-9c7d125a78a3 tempest-TestShelveInstance-1724066282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-4aa170b6-7037-40b3-bb12-f8dd05d7a13c req-01402f39-0457-41f9-b37a-9c7d125a78a3 tempest-TestShelveInstance-1724066282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:27 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[22298f4e-d954-4b38-b8f5-b1ff902ae7cb]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:41:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-4aa170b6-7037-40b3-bb12-f8dd05d7a13c req-01402f39-0457-41f9-b37a-9c7d125a78a3 tempest-TestShelveInstance-1724066282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:27 devstack sudo[96413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873 Jul 08 01:41:27 devstack sudo[96413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:28 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:41:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Flow 'volume_create_manager' (829e390f-9d8c-407d-9a1e-2e671055d253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:41:28 devstack sudo[96413]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7e19b5b-6d1b-46eb-a461-a701a173d3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-4aa170b6-7037-40b3-bb12-f8dd05d7a13c req-01402f39-0457-41f9-b37a-9c7d125a78a3 tempest-TestShelveInstance-1724066282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873" returned: 0 in 1.327s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-4aa170b6-7037-40b3-bb12-f8dd05d7a13c req-01402f39-0457-41f9-b37a-9c7d125a78a3 tempest-TestShelveInstance-1724066282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7e19b5b-6d1b-46eb-a461-a701a173d3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ff96b6e-71bf-4aa7-8c21-019e4350ccaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3252d1a77e9740d58180f20e6ef76f1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8be283ec-4f5d-4f37-9d78-34346a76b9fd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:41:28Z,use_quota=True,user_id='06526e07d65e41679cfc7591d78c153c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d9b8370-6202-4c33-a124-39054a984d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d9b8370-6202-4c33-a124-39054a984d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8ec2131-52b8-4f3b-b783-4c278f969c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8ec2131-52b8-4f3b-b783-4c278f969c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8ff96b6e-71bf-4aa7-8c21-019e4350ccaf', 'volume_name': 'volume-8ff96b6e-71bf-4aa7-8c21-019e4350ccaf', 'volume_size': 1, 'snapshot_id': '8be283ec-4f5d-4f37-9d78-34346a76b9fd'}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f20fb07-be9e-4f85-9018-a7d6f2d69dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f20fb07-be9e-4f85-9018-a7d6f2d69dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9af62116-fcb6-4999-85b3-8dc79d5413f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:28 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Volume 8ff96b6e-71bf-4aa7-8c21-019e4350ccaf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8ff96b6e-71bf-4aa7-8c21-019e4350ccaf', 'volume_size': 1, 'snapshot_id': '8be283ec-4f5d-4f37-9d78-34346a76b9fd'} Jul 08 01:41:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:28 devstack sudo[96417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873 Jul 08 01:41:28 devstack sudo[96417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:29 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e991827-655d-4c7b-9f59-02739e291445 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:41:29 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5e991827-655d-4c7b-9f59-02739e291445 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Flow 'volume_create_manager' (cc83dc35-43ca-4d01-96fa-994810b7c27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:41:29 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5e991827-655d-4c7b-9f59-02739e291445 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c5d290-38eb-4936-add1-5c752db0b4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:29 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5e991827-655d-4c7b-9f59-02739e291445 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c5d290-38eb-4936-add1-5c752db0b4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1174609137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58b8961d-0c44-4c5b-809d-25da4e6ad62e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bafe0260bf04041b8cc022e0f693811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:41:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:41:29Z,use_quota=True,user_id='3bfe7e1b2b084b6a8f12cabbfafd4103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:29 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5e991827-655d-4c7b-9f59-02739e291445 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84b3fd4f-ecc9-4699-b5c7-64200241ec4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:29 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5e991827-655d-4c7b-9f59-02739e291445 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84b3fd4f-ecc9-4699-b5c7-64200241ec4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:29 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5e991827-655d-4c7b-9f59-02739e291445 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (372e1e63-f7a8-416f-8f94-aeb999689b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:29 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5e991827-655d-4c7b-9f59-02739e291445 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (372e1e63-f7a8-416f-8f94-aeb999689b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58b8961d-0c44-4c5b-809d-25da4e6ad62e', 'volume_name': 'volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e', 'volume_size': 2}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:29 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5e991827-655d-4c7b-9f59-02739e291445 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79cabe8a-4eca-4d0a-bf92-2bc80321c508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:29 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5e991827-655d-4c7b-9f59-02739e291445 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79cabe8a-4eca-4d0a-bf92-2bc80321c508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:29 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5e991827-655d-4c7b-9f59-02739e291445 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (723d0b4a-7241-432b-8d96-c19fb0afad70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:29 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-5e991827-655d-4c7b-9f59-02739e291445 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Volume 58b8961d-0c44-4c5b-809d-25da4e6ad62e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e', 'volume_size': 2} Jul 08 01:41:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5e991827-655d-4c7b-9f59-02739e291445 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:29 devstack sudo[96417]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-4aa170b6-7037-40b3-bb12-f8dd05d7a13c req-01402f39-0457-41f9-b37a-9c7d125a78a3 tempest-TestShelveInstance-1724066282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873" returned: 1 in 0.999s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-4aa170b6-7037-40b3-bb12-f8dd05d7a13c req-01402f39-0457-41f9-b37a-9c7d125a78a3 tempest-TestShelveInstance-1724066282 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:41:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-4aa170b6-7037-40b3-bb12-f8dd05d7a13c req-01402f39-0457-41f9-b37a-9c7d125a78a3 tempest-TestShelveInstance-1724066282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.370s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.887s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:29 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Acquiring lock "cinder-quobyte-8be283ec-4f5d-4f37-9d78-34346a76b9fd-8ff96b6e-71bf-4aa7-8c21-019e4350ccaf" by "_create_volume_from_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:41:29 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Lock "cinder-quobyte-8be283ec-4f5d-4f37-9d78-34346a76b9fd-8ff96b6e-71bf-4aa7-8c21-019e4350ccaf" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:41:29 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Creating volume 8ff96b6e-71bf-4aa7-8c21-019e4350ccaf from snapshot 8be283ec-4f5d-4f37-9d78-34346a76b9fd {{(pid=87284) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 01:41:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:29 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:41:29 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:41:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:29 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:41:29 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Acquiring lock "cinder-quobyte-8ff96b6e-71bf-4aa7-8c21-019e4350ccaf" by "_copy_volume_from_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:41:29 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Lock "cinder-quobyte-8ff96b6e-71bf-4aa7-8c21-019e4350ccaf" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:41:29 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] snapshot: 8be283ec-4f5d-4f37-9d78-34346a76b9fd, volume: 8ff96b6e-71bf-4aa7-8c21-019e4350ccaf, {{(pid=87284) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:41:29 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-4aa170b6-7037-40b3-bb12-f8dd05d7a13c req-01402f39-0457-41f9-b37a-9c7d125a78a3 tempest-TestShelveInstance-1724066282 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96', 'name': 'volume-1680554d-f816-42a4-819c-b52eadf31873', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '733d42d2-fa8b-47d9-b01e-71d572f01397', 'enforce_multipath': True} {{(pid=87284) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:41:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:29 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:41:29 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:41:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:29 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c621faa-9965-4a24-b923-fab71a6a6873]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:41:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe.8be283ec-4f5d-4f37-9d78-34346a76b9fd {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:29 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-4aa170b6-7037-40b3-bb12-f8dd05d7a13c req-01402f39-0457-41f9-b37a-9c7d125a78a3 tempest-TestShelveInstance-1724066282 None] attachment_update completed successfully. Jul 08 01:41:29 devstack sudo[96423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe.8be283ec-4f5d-4f37-9d78-34346a76b9fd Jul 08 01:41:29 devstack sudo[96423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:30 devstack sudo[96423]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe.8be283ec-4f5d-4f37-9d78-34346a76b9fd" returned: 0 in 0.837s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:30 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df115741-408b-4893-80b4-54baa79858fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:41:30 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe {{(pid=87284) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:41:30 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Creating direct copy from snapshot {{(pid=87284) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:41:30 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ced694-afc0-4746-93d0-02a58202df76]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:41:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:30 devstack sudo[96464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe Jul 08 01:41:30 devstack sudo[96464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:31 devstack sudo[96464]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe" returned: 0 in 0.806s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:31 devstack cinder-volume[87284]: DEBUG cinder.utils [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Path /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8ff96b6e-71bf-4aa7-8c21-019e4350ccaf not found in is_blk_device check {{(pid=87284) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:41:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8ff96b6e-71bf-4aa7-8c21-019e4350ccaf {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:31 devstack sudo[96469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8ff96b6e-71bf-4aa7-8c21-019e4350ccaf Jul 08 01:41:31 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:39 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8ff96b6e-71bf-4aa7-8c21-019e4350ccaf" returned: 0 in 8.370s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:39 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d36c859-8022-4f92-993a-a98e697fc56a tempest-AttachVolumeNegativeTest-1884741045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:41:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5d36c859-8022-4f92-993a-a98e697fc56a tempest-AttachVolumeNegativeTest-1884741045 None] Flow 'volume_create_manager' (0121a763-b1fc-4535-8b39-23288d90cd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:41:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5d36c859-8022-4f92-993a-a98e697fc56a tempest-AttachVolumeNegativeTest-1884741045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (749bd7e6-f1fe-460f-9959-987f2bd0ae8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:39 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aeab259-eb59-4f37-be0e-36a1c6fd0c25]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:41:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5d36c859-8022-4f92-993a-a98e697fc56a tempest-AttachVolumeNegativeTest-1884741045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (749bd7e6-f1fe-460f-9959-987f2bd0ae8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:41:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1024903687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3e55320-da8b-4289-af08-cefabf6093e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b132a62bc75f428690d4a973fa99e0a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:41:40Z,use_quota=True,user_id='321acf045e5e4ab099b9a076a97db13e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5d36c859-8022-4f92-993a-a98e697fc56a tempest-AttachVolumeNegativeTest-1884741045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb559104-ef38-4d42-8301-ae9ad5198e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5d36c859-8022-4f92-993a-a98e697fc56a tempest-AttachVolumeNegativeTest-1884741045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb559104-ef38-4d42-8301-ae9ad5198e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5d36c859-8022-4f92-993a-a98e697fc56a tempest-AttachVolumeNegativeTest-1884741045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2a6434-4070-4e01-bb56-59f5f25c1a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5d36c859-8022-4f92-993a-a98e697fc56a tempest-AttachVolumeNegativeTest-1884741045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2a6434-4070-4e01-bb56-59f5f25c1a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3e55320-da8b-4289-af08-cefabf6093e2', 'volume_name': 'volume-d3e55320-da8b-4289-af08-cefabf6093e2', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5d36c859-8022-4f92-993a-a98e697fc56a tempest-AttachVolumeNegativeTest-1884741045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e490b1-d334-44e3-bc36-0903f964b37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5d36c859-8022-4f92-993a-a98e697fc56a tempest-AttachVolumeNegativeTest-1884741045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e490b1-d334-44e3-bc36-0903f964b37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5d36c859-8022-4f92-993a-a98e697fc56a tempest-AttachVolumeNegativeTest-1884741045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82647480-4038-4d66-af47-2e6e7e50eb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:39 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-5d36c859-8022-4f92-993a-a98e697fc56a tempest-AttachVolumeNegativeTest-1884741045 None] Volume d3e55320-da8b-4289-af08-cefabf6093e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3e55320-da8b-4289-af08-cefabf6093e2', 'volume_size': 1} Jul 08 01:41:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5d36c859-8022-4f92-993a-a98e697fc56a tempest-AttachVolumeNegativeTest-1884741045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:39 devstack sudo[96935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe Jul 08 01:41:39 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:41 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe" returned: 0 in 1.209s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:41 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Image conversion details: src /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe, size 1024.00 MB, duration 8.37 sec, destination /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8ff96b6e-71bf-4aa7-8c21-019e4350ccaf {{(pid=87284) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:41:41 devstack cinder-volume[87284]: INFO cinder.image.image_utils [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Converted 1024.00 MB image at 122.32 MB/s Jul 08 01:41:41 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8ff96b6e-71bf-4aa7-8c21-019e4350ccaf is being set with open permissions: ugo+rw Jul 08 01:41:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8ff96b6e-71bf-4aa7-8c21-019e4350ccaf {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:41 devstack sudo[96950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8ff96b6e-71bf-4aa7-8c21-019e4350ccaf Jul 08 01:41:41 devstack sudo[96950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:41 devstack sudo[96950]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8ff96b6e-71bf-4aa7-8c21-019e4350ccaf" returned: 0 in 0.875s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:41 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Lock "cinder-quobyte-8ff96b6e-71bf-4aa7-8c21-019e4350ccaf" released by "_copy_volume_from_snapshot" :: held 12.272s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:41:42 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Lock "cinder-quobyte-8be283ec-4f5d-4f37-9d78-34346a76b9fd-8ff96b6e-71bf-4aa7-8c21-019e4350ccaf" released by "_create_volume_from_snapshot" :: held 12.320s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:41:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.357s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5e991827-655d-4c7b-9f59-02739e291445 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.404s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:42 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5e991827-655d-4c7b-9f59-02739e291445 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1174609137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58b8961d-0c44-4c5b-809d-25da4e6ad62e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bafe0260bf04041b8cc022e0f693811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:41:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:41:29Z,use_quota=True,user_id='3bfe7e1b2b084b6a8f12cabbfafd4103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:41:42 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-5e991827-655d-4c7b-9f59-02739e291445 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Creating volume 58b8961d-0c44-4c5b-809d-25da4e6ad62e {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:41:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5e991827-655d-4c7b-9f59-02739e291445 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5e991827-655d-4c7b-9f59-02739e291445 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:42 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5e991827-655d-4c7b-9f59-02739e291445 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:41:42 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5e991827-655d-4c7b-9f59-02739e291445 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:41:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5e991827-655d-4c7b-9f59-02739e291445 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:42 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5e991827-655d-4c7b-9f59-02739e291445 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:41:42 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-5e991827-655d-4c7b-9f59-02739e291445 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:41:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5e991827-655d-4c7b-9f59-02739e291445 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e 2147483648 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:42 devstack sudo[96953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e 2147483648 Jul 08 01:41:42 devstack sudo[96953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:42 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9af62116-fcb6-4999-85b3-8dc79d5413f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ff96b6e-71bf-4aa7-8c21-019e4350ccaf', 'volume_size': 1, 'snapshot_id': '8be283ec-4f5d-4f37-9d78-34346a76b9fd'}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:42 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71b1b432-4da8-4f51-b1b3-6146441a5b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:42 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Volume volume-8ff96b6e-71bf-4aa7-8c21-019e4350ccaf (8ff96b6e-71bf-4aa7-8c21-019e4350ccaf): created successfully Jul 08 01:41:42 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71b1b432-4da8-4f51-b1b3-6146441a5b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:42 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Flow 'volume_create_manager' (829e390f-9d8c-407d-9a1e-2e671055d253) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:41:42 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-f158b194-5983-4d3d-8442-4167995b9c1c tempest-SnapshotDependencyTests-770254984 None] Created volume successfully. Jul 08 01:41:42 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2afe9117-7a73-49c6-be12-ed1d866cb711 tempest-SnapshotDependencyTests-770254984 None] Acquiring lock "cinder-8be283ec-4f5d-4f37-9d78-34346a76b9fd-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:41:42 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2afe9117-7a73-49c6-be12-ed1d866cb711 tempest-SnapshotDependencyTests-770254984 None] Lock "cinder-8be283ec-4f5d-4f37-9d78-34346a76b9fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:41:42 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2afe9117-7a73-49c6-be12-ed1d866cb711 tempest-SnapshotDependencyTests-770254984 None] Acquiring lock "cinder-quobyte-df115741-408b-4893-80b4-54baa79858fe" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:41:42 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2afe9117-7a73-49c6-be12-ed1d866cb711 tempest-SnapshotDependencyTests-770254984 None] Lock "cinder-quobyte-df115741-408b-4893-80b4-54baa79858fe" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:41:42 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2afe9117-7a73-49c6-be12-ed1d866cb711 tempest-SnapshotDependencyTests-770254984 None] Acquiring lock "cinder-quobyte-8be283ec-4f5d-4f37-9d78-34346a76b9fd" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:41:42 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2afe9117-7a73-49c6-be12-ed1d866cb711 tempest-SnapshotDependencyTests-770254984 None] Lock "cinder-quobyte-8be283ec-4f5d-4f37-9d78-34346a76b9fd" acquired by "_delete_snapshot" :: waited 0.055s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:41:42 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-2afe9117-7a73-49c6-be12-ed1d866cb711 tempest-SnapshotDependencyTests-770254984 None] Deleting offline snapshot 8be283ec-4f5d-4f37-9d78-34346a76b9fd of volume df115741-408b-4893-80b4-54baa79858fe {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:41:42 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-2afe9117-7a73-49c6-be12-ed1d866cb711 tempest-SnapshotDependencyTests-770254984 None] snapshot_file for this snap is: volume-df115741-408b-4893-80b4-54baa79858fe.8be283ec-4f5d-4f37-9d78-34346a76b9fd {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:41:42 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdf4963-cb98-4230-9b67-4ed6073de156]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:41:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2afe9117-7a73-49c6-be12-ed1d866cb711 tempest-SnapshotDependencyTests-770254984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe.8be283ec-4f5d-4f37-9d78-34346a76b9fd {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:42 devstack sudo[96955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe.8be283ec-4f5d-4f37-9d78-34346a76b9fd Jul 08 01:41:42 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:43 devstack sudo[96953]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5e991827-655d-4c7b-9f59-02739e291445 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e 2147483648" returned: 0 in 1.515s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5e991827-655d-4c7b-9f59-02739e291445 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:43 devstack sudo[96961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e Jul 08 01:41:43 devstack sudo[96961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:43 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2afe9117-7a73-49c6-be12-ed1d866cb711 tempest-SnapshotDependencyTests-770254984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe.8be283ec-4f5d-4f37-9d78-34346a76b9fd" returned: 0 in 1.246s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:43 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-2afe9117-7a73-49c6-be12-ed1d866cb711 tempest-SnapshotDependencyTests-770254984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df115741-408b-4893-80b4-54baa79858fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:41:44 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cd33ea-519a-4301-a59c-bce065f1f790]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:41:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2afe9117-7a73-49c6-be12-ed1d866cb711 tempest-SnapshotDependencyTests-770254984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:44 devstack sudo[96966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe Jul 08 01:41:44 devstack sudo[96966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:44 devstack sudo[96961]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5e991827-655d-4c7b-9f59-02739e291445 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e" returned: 0 in 1.015s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:44 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5e991827-655d-4c7b-9f59-02739e291445 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] <== create_volume: return (2615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:41:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5e991827-655d-4c7b-9f59-02739e291445 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.624s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5d36c859-8022-4f92-993a-a98e697fc56a tempest-AttachVolumeNegativeTest-1884741045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.695s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:44 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5d36c859-8022-4f92-993a-a98e697fc56a tempest-AttachVolumeNegativeTest-1884741045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:41:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1024903687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3e55320-da8b-4289-af08-cefabf6093e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b132a62bc75f428690d4a973fa99e0a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:41:40Z,use_quota=True,user_id='321acf045e5e4ab099b9a076a97db13e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:41:44 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-5d36c859-8022-4f92-993a-a98e697fc56a tempest-AttachVolumeNegativeTest-1884741045 None] Creating volume d3e55320-da8b-4289-af08-cefabf6093e2 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:41:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5d36c859-8022-4f92-993a-a98e697fc56a tempest-AttachVolumeNegativeTest-1884741045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5d36c859-8022-4f92-993a-a98e697fc56a tempest-AttachVolumeNegativeTest-1884741045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:44 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5d36c859-8022-4f92-993a-a98e697fc56a tempest-AttachVolumeNegativeTest-1884741045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:41:44 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5d36c859-8022-4f92-993a-a98e697fc56a tempest-AttachVolumeNegativeTest-1884741045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:41:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5d36c859-8022-4f92-993a-a98e697fc56a tempest-AttachVolumeNegativeTest-1884741045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:44 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5d36c859-8022-4f92-993a-a98e697fc56a tempest-AttachVolumeNegativeTest-1884741045 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:41:44 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-5d36c859-8022-4f92-993a-a98e697fc56a tempest-AttachVolumeNegativeTest-1884741045 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:41:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5d36c859-8022-4f92-993a-a98e697fc56a tempest-AttachVolumeNegativeTest-1884741045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d3e55320-da8b-4289-af08-cefabf6093e2 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:44 devstack sudo[96970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d3e55320-da8b-4289-af08-cefabf6093e2 1073741824 Jul 08 01:41:44 devstack sudo[96970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:44 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5e991827-655d-4c7b-9f59-02739e291445 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (723d0b4a-7241-432b-8d96-c19fb0afad70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e', 'volume_size': 2}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:44 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5e991827-655d-4c7b-9f59-02739e291445 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d47ba879-96dc-41bb-a382-3656548b5eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:44 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-5e991827-655d-4c7b-9f59-02739e291445 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Volume volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e (58b8961d-0c44-4c5b-809d-25da4e6ad62e): created successfully Jul 08 01:41:44 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5e991827-655d-4c7b-9f59-02739e291445 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d47ba879-96dc-41bb-a382-3656548b5eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:44 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5e991827-655d-4c7b-9f59-02739e291445 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Flow 'volume_create_manager' (cc83dc35-43ca-4d01-96fa-994810b7c27c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:41:44 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-5e991827-655d-4c7b-9f59-02739e291445 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Created volume successfully. Jul 08 01:41:45 devstack sudo[96966]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2afe9117-7a73-49c6-be12-ed1d866cb711 tempest-SnapshotDependencyTests-770254984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe" returned: 0 in 1.315s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2afe9117-7a73-49c6-be12-ed1d866cb711 tempest-SnapshotDependencyTests-770254984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe.8be283ec-4f5d-4f37-9d78-34346a76b9fd {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:45 devstack sudo[96977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe.8be283ec-4f5d-4f37-9d78-34346a76b9fd Jul 08 01:41:45 devstack sudo[96977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6c71522c-35cf-40f4-84fd-afc88114e965 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:45 devstack sudo[96970]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5d36c859-8022-4f92-993a-a98e697fc56a tempest-AttachVolumeNegativeTest-1884741045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d3e55320-da8b-4289-af08-cefabf6093e2 1073741824" returned: 0 in 1.133s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5d36c859-8022-4f92-993a-a98e697fc56a tempest-AttachVolumeNegativeTest-1884741045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d3e55320-da8b-4289-af08-cefabf6093e2 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:45 devstack sudo[96983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d3e55320-da8b-4289-af08-cefabf6093e2 Jul 08 01:41:45 devstack sudo[96983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:46 devstack sudo[96977]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2afe9117-7a73-49c6-be12-ed1d866cb711 tempest-SnapshotDependencyTests-770254984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe.8be283ec-4f5d-4f37-9d78-34346a76b9fd" returned: 0 in 0.955s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2afe9117-7a73-49c6-be12-ed1d866cb711 tempest-SnapshotDependencyTests-770254984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe.8be283ec-4f5d-4f37-9d78-34346a76b9fd {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:46 devstack sudo[96988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe.8be283ec-4f5d-4f37-9d78-34346a76b9fd Jul 08 01:41:46 devstack sudo[96988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:46 devstack sudo[96983]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5d36c859-8022-4f92-993a-a98e697fc56a tempest-AttachVolumeNegativeTest-1884741045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d3e55320-da8b-4289-af08-cefabf6093e2" returned: 0 in 0.825s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:46 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5d36c859-8022-4f92-993a-a98e697fc56a tempest-AttachVolumeNegativeTest-1884741045 None] <== create_volume: return (2011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:41:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5d36c859-8022-4f92-993a-a98e697fc56a tempest-AttachVolumeNegativeTest-1884741045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.015s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6c71522c-35cf-40f4-84fd-afc88114e965 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.268s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:46 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-6c71522c-35cf-40f4-84fd-afc88114e965 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Creating offline snapshot 6f58fef3-f922-44b5-b34a-25a768277b82 of volume 58b8961d-0c44-4c5b-809d-25da4e6ad62e {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:41:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5d36c859-8022-4f92-993a-a98e697fc56a tempest-AttachVolumeNegativeTest-1884741045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82647480-4038-4d66-af47-2e6e7e50eb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3e55320-da8b-4289-af08-cefabf6093e2', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5d36c859-8022-4f92-993a-a98e697fc56a tempest-AttachVolumeNegativeTest-1884741045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b23ce115-df4a-405d-bd02-250e99ce5ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:46 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[615becaf-5cf7-4fa1-8e4c-998d271d79ed]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:41:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6c71522c-35cf-40f4-84fd-afc88114e965 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:46 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-5d36c859-8022-4f92-993a-a98e697fc56a tempest-AttachVolumeNegativeTest-1884741045 None] Volume volume-d3e55320-da8b-4289-af08-cefabf6093e2 (d3e55320-da8b-4289-af08-cefabf6093e2): created successfully Jul 08 01:41:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5d36c859-8022-4f92-993a-a98e697fc56a tempest-AttachVolumeNegativeTest-1884741045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b23ce115-df4a-405d-bd02-250e99ce5ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5d36c859-8022-4f92-993a-a98e697fc56a tempest-AttachVolumeNegativeTest-1884741045 None] Flow 'volume_create_manager' (0121a763-b1fc-4535-8b39-23288d90cd6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:41:46 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-5d36c859-8022-4f92-993a-a98e697fc56a tempest-AttachVolumeNegativeTest-1884741045 None] Created volume successfully. Jul 08 01:41:46 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e Jul 08 01:41:46 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:47 devstack sudo[96988]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2afe9117-7a73-49c6-be12-ed1d866cb711 tempest-SnapshotDependencyTests-770254984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe.8be283ec-4f5d-4f37-9d78-34346a76b9fd" returned: 0 in 0.779s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:47 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2afe9117-7a73-49c6-be12-ed1d866cb711 tempest-SnapshotDependencyTests-770254984 None] Lock "cinder-quobyte-8be283ec-4f5d-4f37-9d78-34346a76b9fd" released by "_delete_snapshot" :: held 4.461s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:41:47 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2afe9117-7a73-49c6-be12-ed1d866cb711 tempest-SnapshotDependencyTests-770254984 None] Lock "cinder-quobyte-df115741-408b-4893-80b4-54baa79858fe" released by "delete_snapshot" :: held 4.526s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:41:47 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-2afe9117-7a73-49c6-be12-ed1d866cb711 tempest-SnapshotDependencyTests-770254984 None] Created reservations ['eb185b0c-2bb2-43ed-889c-30035d3912da', '2823c81b-aaa3-4f2f-a1c2-9c8b26b0ace8', '93acc0e0-700c-4066-a049-453c5ce3e9d2', 'd7448649-86f3-4c22-b175-903c4e8accf3'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:41:47 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-2afe9117-7a73-49c6-be12-ed1d866cb711 tempest-SnapshotDependencyTests-770254984 None] Delete snapshot completed successfully. Jul 08 01:41:47 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2afe9117-7a73-49c6-be12-ed1d866cb711 tempest-SnapshotDependencyTests-770254984 None] Lock "cinder-8be283ec-4f5d-4f37-9d78-34346a76b9fd-delete_snapshot" released by "delete_snapshot" :: held 4.717s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:41:47 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6c71522c-35cf-40f4-84fd-afc88114e965 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e" returned: 0 in 0.903s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6c71522c-35cf-40f4-84fd-afc88114e965 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e.6f58fef3-f922-44b5-b34a-25a768277b82 2G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:47 devstack sudo[97000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e.6f58fef3-f922-44b5-b34a-25a768277b82 2G Jul 08 01:41:47 devstack sudo[97000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:47 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2a98dd88-f0a6-45bc-bec1-cd28b7d324df tempest-SnapshotDependencyTests-770254984 None] Acquiring lock "cinder-df115741-408b-4893-80b4-54baa79858fe-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:41:47 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2a98dd88-f0a6-45bc-bec1-cd28b7d324df tempest-SnapshotDependencyTests-770254984 None] Lock "cinder-df115741-408b-4893-80b4-54baa79858fe-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:41:48 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2a98dd88-f0a6-45bc-bec1-cd28b7d324df tempest-SnapshotDependencyTests-770254984 None] Acquiring lock "cinder-quobyte-df115741-408b-4893-80b4-54baa79858fe" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:41:48 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2a98dd88-f0a6-45bc-bec1-cd28b7d324df tempest-SnapshotDependencyTests-770254984 None] Lock "cinder-quobyte-df115741-408b-4893-80b4-54baa79858fe" acquired by "delete_volume" :: waited 0.016s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:41:48 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3dae087-c4bc-47f4-986b-444d5157fe49]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:41:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2a98dd88-f0a6-45bc-bec1-cd28b7d324df tempest-SnapshotDependencyTests-770254984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:48 devstack sudo[97002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe Jul 08 01:41:48 devstack sudo[97002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:48 devstack sudo[97000]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6c71522c-35cf-40f4-84fd-afc88114e965 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e.6f58fef3-f922-44b5-b34a-25a768277b82 2G" returned: 0 in 0.958s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6c71522c-35cf-40f4-84fd-afc88114e965 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e.6f58fef3-f922-44b5-b34a-25a768277b82 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:48 devstack sudo[97008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e.6f58fef3-f922-44b5-b34a-25a768277b82 Jul 08 01:41:48 devstack sudo[97008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:48 devstack sudo[97002]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2a98dd88-f0a6-45bc-bec1-cd28b7d324df tempest-SnapshotDependencyTests-770254984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe" returned: 0 in 0.879s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2a98dd88-f0a6-45bc-bec1-cd28b7d324df tempest-SnapshotDependencyTests-770254984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:48 devstack sudo[97013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe Jul 08 01:41:48 devstack sudo[97013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:49 devstack sudo[97008]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6c71522c-35cf-40f4-84fd-afc88114e965 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e.6f58fef3-f922-44b5-b34a-25a768277b82" returned: 0 in 0.801s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:49 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-6c71522c-35cf-40f4-84fd-afc88114e965 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e.6f58fef3-f922-44b5-b34a-25a768277b82 is being set with open permissions: ugo+rw Jul 08 01:41:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6c71522c-35cf-40f4-84fd-afc88114e965 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e.6f58fef3-f922-44b5-b34a-25a768277b82 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:49 devstack sudo[97018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e.6f58fef3-f922-44b5-b34a-25a768277b82 Jul 08 01:41:49 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:49 devstack sudo[97013]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2a98dd88-f0a6-45bc-bec1-cd28b7d324df tempest-SnapshotDependencyTests-770254984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df115741-408b-4893-80b4-54baa79858fe" returned: 0 in 0.727s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:49 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2a98dd88-f0a6-45bc-bec1-cd28b7d324df tempest-SnapshotDependencyTests-770254984 None] Lock "cinder-quobyte-df115741-408b-4893-80b4-54baa79858fe" released by "delete_volume" :: held 1.682s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:41:49 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-2a98dd88-f0a6-45bc-bec1-cd28b7d324df tempest-SnapshotDependencyTests-770254984 None] Created reservations ['63c298b3-cefd-4177-8204-53928c02ff0c', '2c50c6cd-4597-4bef-b466-b5c22663a4aa', '66c1a17f-ded8-4ddf-b201-f9e8b3470aed', 'b4f4881d-ad8b-422b-a665-0289533457f5'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:41:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2a98dd88-f0a6-45bc-bec1-cd28b7d324df tempest-SnapshotDependencyTests-770254984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2a98dd88-f0a6-45bc-bec1-cd28b7d324df tempest-SnapshotDependencyTests-770254984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:49 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2a98dd88-f0a6-45bc-bec1-cd28b7d324df tempest-SnapshotDependencyTests-770254984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:41:49 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2a98dd88-f0a6-45bc-bec1-cd28b7d324df tempest-SnapshotDependencyTests-770254984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:41:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2a98dd88-f0a6-45bc-bec1-cd28b7d324df tempest-SnapshotDependencyTests-770254984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2a98dd88-f0a6-45bc-bec1-cd28b7d324df tempest-SnapshotDependencyTests-770254984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:49 devstack sudo[97021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:41:49 devstack sudo[97021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:50 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6c71522c-35cf-40f4-84fd-afc88114e965 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e.6f58fef3-f922-44b5-b34a-25a768277b82" returned: 0 in 0.803s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6c71522c-35cf-40f4-84fd-afc88114e965 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:50 devstack sudo[97024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e.info Jul 08 01:41:50 devstack sudo[97024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:50 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-858a46d9-98cd-4cdc-bab4-a78e69c1e5f5 tempest-SnapshotDependencyTests-770254984 None] Acquiring lock "cinder-8ff96b6e-71bf-4aa7-8c21-019e4350ccaf-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:41:50 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-858a46d9-98cd-4cdc-bab4-a78e69c1e5f5 tempest-SnapshotDependencyTests-770254984 None] Lock "cinder-8ff96b6e-71bf-4aa7-8c21-019e4350ccaf-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:41:50 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-858a46d9-98cd-4cdc-bab4-a78e69c1e5f5 tempest-SnapshotDependencyTests-770254984 None] Acquiring lock "cinder-quobyte-8ff96b6e-71bf-4aa7-8c21-019e4350ccaf" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:41:50 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-858a46d9-98cd-4cdc-bab4-a78e69c1e5f5 tempest-SnapshotDependencyTests-770254984 None] Lock "cinder-quobyte-8ff96b6e-71bf-4aa7-8c21-019e4350ccaf" acquired by "delete_volume" :: waited 0.031s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:41:50 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ad7767-e2aa-4a81-b1c4-cf1541945acc]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:41:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-858a46d9-98cd-4cdc-bab4-a78e69c1e5f5 tempest-SnapshotDependencyTests-770254984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8ff96b6e-71bf-4aa7-8c21-019e4350ccaf {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:50 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8ff96b6e-71bf-4aa7-8c21-019e4350ccaf Jul 08 01:41:50 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:50 devstack sudo[97021]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2a98dd88-f0a6-45bc-bec1-cd28b7d324df tempest-SnapshotDependencyTests-770254984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.947s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:50 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-2a98dd88-f0a6-45bc-bec1-cd28b7d324df tempest-SnapshotDependencyTests-770254984 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:41:50 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-2a98dd88-f0a6-45bc-bec1-cd28b7d324df tempest-SnapshotDependencyTests-770254984 None] Deleted volume successfully. Jul 08 01:41:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-90180cbb-02a9-46e9-b550-8835c04ef25d req-a2a52ed9-444f-4421-829b-23de07605d6a tempest-AttachVolumeNegativeTest-1884741045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:50 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2a98dd88-f0a6-45bc-bec1-cd28b7d324df tempest-SnapshotDependencyTests-770254984 None] Lock "cinder-df115741-408b-4893-80b4-54baa79858fe-delete_volume" released by "delete_volume" :: held 2.940s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:41:51 devstack sudo[97024]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6c71522c-35cf-40f4-84fd-afc88114e965 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e.info" returned: 0 in 0.928s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:51 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-6c71522c-35cf-40f4-84fd-afc88114e965 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e.info is being set with open permissions: ugo+rw Jul 08 01:41:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6c71522c-35cf-40f4-84fd-afc88114e965 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:51 devstack sudo[97038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e.info Jul 08 01:41:51 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:51 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-858a46d9-98cd-4cdc-bab4-a78e69c1e5f5 tempest-SnapshotDependencyTests-770254984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8ff96b6e-71bf-4aa7-8c21-019e4350ccaf" returned: 0 in 0.998s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-858a46d9-98cd-4cdc-bab4-a78e69c1e5f5 tempest-SnapshotDependencyTests-770254984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8ff96b6e-71bf-4aa7-8c21-019e4350ccaf {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:51 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8ff96b6e-71bf-4aa7-8c21-019e4350ccaf Jul 08 01:41:51 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:51 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6c71522c-35cf-40f4-84fd-afc88114e965 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e.info" returned: 0 in 0.741s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6c71522c-35cf-40f4-84fd-afc88114e965 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.275s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-90180cbb-02a9-46e9-b550-8835c04ef25d req-a2a52ed9-444f-4421-829b-23de07605d6a tempest-AttachVolumeNegativeTest-1884741045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.042s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:51 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4b319c-4bdf-445a-82aa-9ff3201c4334]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:41:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-90180cbb-02a9-46e9-b550-8835c04ef25d req-a2a52ed9-444f-4421-829b-23de07605d6a tempest-AttachVolumeNegativeTest-1884741045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d3e55320-da8b-4289-af08-cefabf6093e2 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:51 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-6c71522c-35cf-40f4-84fd-afc88114e965 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Create snapshot completed successfully Jul 08 01:41:52 devstack sudo[97046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d3e55320-da8b-4289-af08-cefabf6093e2 Jul 08 01:41:52 devstack sudo[97046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:52 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-858a46d9-98cd-4cdc-bab4-a78e69c1e5f5 tempest-SnapshotDependencyTests-770254984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8ff96b6e-71bf-4aa7-8c21-019e4350ccaf" returned: 0 in 0.690s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:52 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-858a46d9-98cd-4cdc-bab4-a78e69c1e5f5 tempest-SnapshotDependencyTests-770254984 None] Lock "cinder-quobyte-8ff96b6e-71bf-4aa7-8c21-019e4350ccaf" released by "delete_volume" :: held 1.769s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:41:52 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-858a46d9-98cd-4cdc-bab4-a78e69c1e5f5 tempest-SnapshotDependencyTests-770254984 None] Created reservations ['c4d7b859-dd47-476e-84b2-0dd210ebfb3b', '5918d04e-b6e2-46d4-a627-899a597cdc2b', '6a980766-9ed9-4b5f-8b00-e80852d4d13c', 'e2138999-0406-4b39-9c70-1ce1e6700319'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:41:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-858a46d9-98cd-4cdc-bab4-a78e69c1e5f5 tempest-SnapshotDependencyTests-770254984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-858a46d9-98cd-4cdc-bab4-a78e69c1e5f5 tempest-SnapshotDependencyTests-770254984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-858a46d9-98cd-4cdc-bab4-a78e69c1e5f5 tempest-SnapshotDependencyTests-770254984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:41:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-858a46d9-98cd-4cdc-bab4-a78e69c1e5f5 tempest-SnapshotDependencyTests-770254984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:41:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-858a46d9-98cd-4cdc-bab4-a78e69c1e5f5 tempest-SnapshotDependencyTests-770254984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-858a46d9-98cd-4cdc-bab4-a78e69c1e5f5 tempest-SnapshotDependencyTests-770254984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:52 devstack sudo[97073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:41:52 devstack sudo[97073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:52 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-a19de078-aaf7-4dfb-b95d-f8a2a85b5e78 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Acquiring lock "cinder-6f58fef3-f922-44b5-b34a-25a768277b82-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:41:53 devstack sudo[97046]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:53 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-a19de078-aaf7-4dfb-b95d-f8a2a85b5e78 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Lock "cinder-6f58fef3-f922-44b5-b34a-25a768277b82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:41:53 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-a19de078-aaf7-4dfb-b95d-f8a2a85b5e78 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Acquiring lock "cinder-quobyte-58b8961d-0c44-4c5b-809d-25da4e6ad62e" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:41:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-90180cbb-02a9-46e9-b550-8835c04ef25d req-a2a52ed9-444f-4421-829b-23de07605d6a tempest-AttachVolumeNegativeTest-1884741045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d3e55320-da8b-4289-af08-cefabf6093e2" returned: 0 in 1.067s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-90180cbb-02a9-46e9-b550-8835c04ef25d req-a2a52ed9-444f-4421-829b-23de07605d6a tempest-AttachVolumeNegativeTest-1884741045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.093s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:53 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-a19de078-aaf7-4dfb-b95d-f8a2a85b5e78 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Lock "cinder-quobyte-58b8961d-0c44-4c5b-809d-25da4e6ad62e" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:41:53 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-a19de078-aaf7-4dfb-b95d-f8a2a85b5e78 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Acquiring lock "cinder-quobyte-6f58fef3-f922-44b5-b34a-25a768277b82" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:41:53 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-a19de078-aaf7-4dfb-b95d-f8a2a85b5e78 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Lock "cinder-quobyte-6f58fef3-f922-44b5-b34a-25a768277b82" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:41:53 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-a19de078-aaf7-4dfb-b95d-f8a2a85b5e78 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Deleting offline snapshot 6f58fef3-f922-44b5-b34a-25a768277b82 of volume 58b8961d-0c44-4c5b-809d-25da4e6ad62e {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:41:53 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-a19de078-aaf7-4dfb-b95d-f8a2a85b5e78 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] snapshot_file for this snap is: volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e.6f58fef3-f922-44b5-b34a-25a768277b82 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:41:53 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdbf65e-a0c4-480b-8ea9-c22a92a7dc9a]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:41:53 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-90180cbb-02a9-46e9-b550-8835c04ef25d req-a2a52ed9-444f-4421-829b-23de07605d6a tempest-AttachVolumeNegativeTest-1884741045 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96', 'name': 'volume-d3e55320-da8b-4289-af08-cefabf6093e2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c8b4ef42-dcdd-4383-a187-a27eb1cbb955', 'enforce_multipath': True} {{(pid=87284) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:41:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a19de078-aaf7-4dfb-b95d-f8a2a85b5e78 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e.6f58fef3-f922-44b5-b34a-25a768277b82 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:53 devstack sudo[97073]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-858a46d9-98cd-4cdc-bab4-a78e69c1e5f5 tempest-SnapshotDependencyTests-770254984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.903s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:53 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-858a46d9-98cd-4cdc-bab4-a78e69c1e5f5 tempest-SnapshotDependencyTests-770254984 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:41:53 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-858a46d9-98cd-4cdc-bab4-a78e69c1e5f5 tempest-SnapshotDependencyTests-770254984 None] Deleted volume successfully. Jul 08 01:41:53 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-858a46d9-98cd-4cdc-bab4-a78e69c1e5f5 tempest-SnapshotDependencyTests-770254984 None] Lock "cinder-8ff96b6e-71bf-4aa7-8c21-019e4350ccaf-delete_volume" released by "delete_volume" :: held 3.013s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:41:53 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-90180cbb-02a9-46e9-b550-8835c04ef25d req-a2a52ed9-444f-4421-829b-23de07605d6a tempest-AttachVolumeNegativeTest-1884741045 None] attachment_update completed successfully. Jul 08 01:41:53 devstack sudo[97079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e.6f58fef3-f922-44b5-b34a-25a768277b82 Jul 08 01:41:53 devstack sudo[97079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:54 devstack sudo[97079]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a19de078-aaf7-4dfb-b95d-f8a2a85b5e78 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e.6f58fef3-f922-44b5-b34a-25a768277b82" returned: 0 in 1.279s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:54 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-a19de078-aaf7-4dfb-b95d-f8a2a85b5e78 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:41:54 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[335fc6a9-d285-45f3-b88e-30cee2ad5372]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:41:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a19de078-aaf7-4dfb-b95d-f8a2a85b5e78 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:54 devstack sudo[97151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e Jul 08 01:41:54 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:55 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:41:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:41:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:41:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:55 devstack sudo[97156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:41:55 devstack sudo[97156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:55 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a19de078-aaf7-4dfb-b95d-f8a2a85b5e78 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e" returned: 0 in 1.105s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a19de078-aaf7-4dfb-b95d-f8a2a85b5e78 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e.6f58fef3-f922-44b5-b34a-25a768277b82 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:55 devstack sudo[97162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e.6f58fef3-f922-44b5-b34a-25a768277b82 Jul 08 01:41:55 devstack sudo[97162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:56 devstack sudo[97156]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.933s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:56 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:41:56 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager._thread_info {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:41:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread count: 29 {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:41:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread info: [<_MainThread(MainThread, started 127058402500736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:41:56 devstack sudo[97162]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a19de078-aaf7-4dfb-b95d-f8a2a85b5e78 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e.6f58fef3-f922-44b5-b34a-25a768277b82" returned: 0 in 0.887s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a19de078-aaf7-4dfb-b95d-f8a2a85b5e78 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e.6f58fef3-f922-44b5-b34a-25a768277b82 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:56 devstack sudo[97169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e.6f58fef3-f922-44b5-b34a-25a768277b82 Jul 08 01:41:56 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:57 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a19de078-aaf7-4dfb-b95d-f8a2a85b5e78 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e.6f58fef3-f922-44b5-b34a-25a768277b82" returned: 0 in 0.780s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:57 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-a19de078-aaf7-4dfb-b95d-f8a2a85b5e78 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Lock "cinder-quobyte-6f58fef3-f922-44b5-b34a-25a768277b82" released by "_delete_snapshot" :: held 4.248s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:41:57 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-a19de078-aaf7-4dfb-b95d-f8a2a85b5e78 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Lock "cinder-quobyte-58b8961d-0c44-4c5b-809d-25da4e6ad62e" released by "delete_snapshot" :: held 4.291s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:41:57 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-a19de078-aaf7-4dfb-b95d-f8a2a85b5e78 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Created reservations ['34bc6d52-85ec-41df-9694-fb6e444932e0', 'ec7f7791-8286-47b0-b879-be5acef4fe85', '3a165a3e-f86e-4fcc-b9c4-8d07871c07e2', 'df873938-516b-40ce-8055-931604304727'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:41:57 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-a19de078-aaf7-4dfb-b95d-f8a2a85b5e78 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Delete snapshot completed successfully. Jul 08 01:41:57 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-a19de078-aaf7-4dfb-b95d-f8a2a85b5e78 tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Lock "cinder-6f58fef3-f922-44b5-b34a-25a768277b82-delete_snapshot" released by "delete_snapshot" :: held 4.537s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:41:58 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-8ad2d3a5-0953-4302-a08c-106e9412ac6c tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Acquiring lock "cinder-58b8961d-0c44-4c5b-809d-25da4e6ad62e-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:41:58 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-8ad2d3a5-0953-4302-a08c-106e9412ac6c tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Lock "cinder-58b8961d-0c44-4c5b-809d-25da4e6ad62e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:41:58 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-8ad2d3a5-0953-4302-a08c-106e9412ac6c tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Acquiring lock "cinder-quobyte-58b8961d-0c44-4c5b-809d-25da4e6ad62e" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:41:58 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-8ad2d3a5-0953-4302-a08c-106e9412ac6c tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Lock "cinder-quobyte-58b8961d-0c44-4c5b-809d-25da4e6ad62e" acquired by "delete_volume" :: waited 0.018s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:41:58 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[31315099-552e-4703-8874-1920a5aadce1]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:41:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8ad2d3a5-0953-4302-a08c-106e9412ac6c tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:58 devstack sudo[97175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e Jul 08 01:41:58 devstack sudo[97175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:59 devstack sudo[97175]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8ad2d3a5-0953-4302-a08c-106e9412ac6c tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e" returned: 0 in 0.991s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8ad2d3a5-0953-4302-a08c-106e9412ac6c tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:59 devstack sudo[97181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e Jul 08 01:41:59 devstack sudo[97181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:59 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:UPDATE=84,cinder:SELECT=83,cinder:DELETE=5,cinder:INSERT=26 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:41:59 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=77,cinder:INSERT=25,cinder:UPDATE=76,cinder:DELETE=8 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:41:59 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-1f3bd000-0722-4123-a75a-7dd82c78e09e req-bfab07e0-94d9-44b9-8d4d-3a6e11fe86d3 tempest-AttachVolumeNegativeTest-1884741045 None] Terminate volume connection completed successfully. Jul 08 01:41:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-1f3bd000-0722-4123-a75a-7dd82c78e09e req-bfab07e0-94d9-44b9-8d4d-3a6e11fe86d3 tempest-AttachVolumeNegativeTest-1884741045 None] Deleting attachment c8b4ef42-dcdd-4383-a187-a27eb1cbb955. {{(pid=87284) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:42:00 devstack sudo[97181]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8ad2d3a5-0953-4302-a08c-106e9412ac6c tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58b8961d-0c44-4c5b-809d-25da4e6ad62e" returned: 0 in 0.731s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:00 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-8ad2d3a5-0953-4302-a08c-106e9412ac6c tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Lock "cinder-quobyte-58b8961d-0c44-4c5b-809d-25da4e6ad62e" released by "delete_volume" :: held 1.823s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:42:00 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-8ad2d3a5-0953-4302-a08c-106e9412ac6c tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Created reservations ['80a5addc-62dc-4401-8200-37df4c136743', '97f81dcc-6901-4b7d-be89-9c2e5cb1a45c', 'f2cedf64-ba9e-4dcd-8a4c-b40dac819f82', '7470227d-360d-484a-9127-f943689758a8'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:42:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8ad2d3a5-0953-4302-a08c-106e9412ac6c tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:42:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8ad2d3a5-0953-4302-a08c-106e9412ac6c tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:42:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-8ad2d3a5-0953-4302-a08c-106e9412ac6c tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:42:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-8ad2d3a5-0953-4302-a08c-106e9412ac6c tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:42:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8ad2d3a5-0953-4302-a08c-106e9412ac6c tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:42:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8ad2d3a5-0953-4302-a08c-106e9412ac6c tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:00 devstack sudo[97187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:42:00 devstack sudo[97187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:01 devstack sudo[97187]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8ad2d3a5-0953-4302-a08c-106e9412ac6c tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.085s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:01 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-8ad2d3a5-0953-4302-a08c-106e9412ac6c tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:42:01 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-8ad2d3a5-0953-4302-a08c-106e9412ac6c tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Deleted volume successfully. Jul 08 01:42:01 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-8ad2d3a5-0953-4302-a08c-106e9412ac6c tempest-VolumesSnapshotNegativeTestJSON-1110632671 None] Lock "cinder-58b8961d-0c44-4c5b-809d-25da4e6ad62e-delete_volume" released by "delete_volume" :: held 3.236s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:42:10 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=3,cinder:INSERT=3,cinder:UPDATE=8 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:42:11 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-7e286bff-7002-46fc-81db-1304e9b6bd79 req-5565d66c-7ed4-4f2e-8b6a-126e26b196a6 tempest-TestShelveInstance-1724066282 None] Terminate volume connection completed successfully. Jul 08 01:42:11 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-7e286bff-7002-46fc-81db-1304e9b6bd79 req-5565d66c-7ed4-4f2e-8b6a-126e26b196a6 tempest-TestShelveInstance-1724066282 None] Deleting attachment 733d42d2-fa8b-47d9-b01e-71d572f01397. {{(pid=87284) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:42:11 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:42:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-f5ce643e-660d-4b84-9b77-9714ae338851 req-1b605602-d430-4030-a3e3-593d091fae41 tempest-TestShelveInstance-1724066282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:42:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-f5ce643e-660d-4b84-9b77-9714ae338851 req-1b605602-d430-4030-a3e3-593d091fae41 tempest-TestShelveInstance-1724066282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:42:18 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e031149-0e10-4271-bc16-d62602e21ad4]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:42:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-f5ce643e-660d-4b84-9b77-9714ae338851 req-1b605602-d430-4030-a3e3-593d091fae41 tempest-TestShelveInstance-1724066282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:18 devstack sudo[97262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873 Jul 08 01:42:18 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:19 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-f5ce643e-660d-4b84-9b77-9714ae338851 req-1b605602-d430-4030-a3e3-593d091fae41 tempest-TestShelveInstance-1724066282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873" returned: 0 in 0.936s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-f5ce643e-660d-4b84-9b77-9714ae338851 req-1b605602-d430-4030-a3e3-593d091fae41 tempest-TestShelveInstance-1724066282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:19 devstack sudo[97266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873 Jul 08 01:42:19 devstack sudo[97266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:20 devstack sudo[97266]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-f5ce643e-660d-4b84-9b77-9714ae338851 req-1b605602-d430-4030-a3e3-593d091fae41 tempest-TestShelveInstance-1724066282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873" returned: 1 in 0.923s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-f5ce643e-660d-4b84-9b77-9714ae338851 req-1b605602-d430-4030-a3e3-593d091fae41 tempest-TestShelveInstance-1724066282 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:42:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-f5ce643e-660d-4b84-9b77-9714ae338851 req-1b605602-d430-4030-a3e3-593d091fae41 tempest-TestShelveInstance-1724066282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.910s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:42:20 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-f5ce643e-660d-4b84-9b77-9714ae338851 req-1b605602-d430-4030-a3e3-593d091fae41 tempest-TestShelveInstance-1724066282 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96', 'name': 'volume-1680554d-f816-42a4-819c-b52eadf31873', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '24504668-d238-4a5c-8b15-775e2f435364', 'enforce_multipath': True} {{(pid=87284) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:42:20 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-f5ce643e-660d-4b84-9b77-9714ae338851 req-1b605602-d430-4030-a3e3-593d091fae41 tempest-TestShelveInstance-1724066282 None] attachment_update completed successfully. Jul 08 01:42:30 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:42:30 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:42:35 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-63f97538-e1cc-4956-951b-ed67b068ff12 tempest-TestInstancesWithCinderVolumes-1193651253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:42:35 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-63f97538-e1cc-4956-951b-ed67b068ff12 tempest-TestInstancesWithCinderVolumes-1193651253 None] Flow 'volume_create_manager' (cc4cea9e-87a4-46ec-b7bb-c6724acbd7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:42:35 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-63f97538-e1cc-4956-951b-ed67b068ff12 tempest-TestInstancesWithCinderVolumes-1193651253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3af13a0-6cc4-487b-8af3-87540d2cdad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:42:35 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-63f97538-e1cc-4956-951b-ed67b068ff12 tempest-TestInstancesWithCinderVolumes-1193651253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3af13a0-6cc4-487b-8af3-87540d2cdad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-233498603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07fc2280-ce7e-495e-bb9a-403b9873f0f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c21612107e640c89dd39bf34af26e02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:42:35Z,use_quota=True,user_id='e4547cd344764c51baed5d122d70e67a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f02e2f03-b56c-4037-8222-67d1d5cfd071),volume_type_id=f02e2f03-b56c-4037-8222-67d1d5cfd071)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:42:35 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-63f97538-e1cc-4956-951b-ed67b068ff12 tempest-TestInstancesWithCinderVolumes-1193651253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d2bbde6-cc0d-4ff5-95ba-3b1b1aa55d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:42:35 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-63f97538-e1cc-4956-951b-ed67b068ff12 tempest-TestInstancesWithCinderVolumes-1193651253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d2bbde6-cc0d-4ff5-95ba-3b1b1aa55d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:42:35 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-63f97538-e1cc-4956-951b-ed67b068ff12 tempest-TestInstancesWithCinderVolumes-1193651253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (455c4bff-a010-4545-945d-b3833ce0e28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:42:35 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-63f97538-e1cc-4956-951b-ed67b068ff12 tempest-TestInstancesWithCinderVolumes-1193651253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (455c4bff-a010-4545-945d-b3833ce0e28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07fc2280-ce7e-495e-bb9a-403b9873f0f1', 'volume_name': 'volume-07fc2280-ce7e-495e-bb9a-403b9873f0f1', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:42:35 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-63f97538-e1cc-4956-951b-ed67b068ff12 tempest-TestInstancesWithCinderVolumes-1193651253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1821bc5f-fa0c-44d6-a9a7-e6303b20a2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:42:35 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-63f97538-e1cc-4956-951b-ed67b068ff12 tempest-TestInstancesWithCinderVolumes-1193651253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1821bc5f-fa0c-44d6-a9a7-e6303b20a2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:42:35 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-63f97538-e1cc-4956-951b-ed67b068ff12 tempest-TestInstancesWithCinderVolumes-1193651253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de8a04bd-9844-4a00-b83d-9a11add5bdd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:42:35 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-63f97538-e1cc-4956-951b-ed67b068ff12 tempest-TestInstancesWithCinderVolumes-1193651253 None] Volume 07fc2280-ce7e-495e-bb9a-403b9873f0f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07fc2280-ce7e-495e-bb9a-403b9873f0f1', 'volume_size': 1} Jul 08 01:42:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-63f97538-e1cc-4956-951b-ed67b068ff12 tempest-TestInstancesWithCinderVolumes-1193651253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:42:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-63f97538-e1cc-4956-951b-ed67b068ff12 tempest-TestInstancesWithCinderVolumes-1193651253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:42:35 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-63f97538-e1cc-4956-951b-ed67b068ff12 tempest-TestInstancesWithCinderVolumes-1193651253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-233498603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07fc2280-ce7e-495e-bb9a-403b9873f0f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c21612107e640c89dd39bf34af26e02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:42:35Z,use_quota=True,user_id='e4547cd344764c51baed5d122d70e67a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f02e2f03-b56c-4037-8222-67d1d5cfd071),volume_type_id=f02e2f03-b56c-4037-8222-67d1d5cfd071)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:42:35 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-63f97538-e1cc-4956-951b-ed67b068ff12 tempest-TestInstancesWithCinderVolumes-1193651253 None] Creating volume 07fc2280-ce7e-495e-bb9a-403b9873f0f1 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:42:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-63f97538-e1cc-4956-951b-ed67b068ff12 tempest-TestInstancesWithCinderVolumes-1193651253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:42:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-63f97538-e1cc-4956-951b-ed67b068ff12 tempest-TestInstancesWithCinderVolumes-1193651253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:42:35 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-63f97538-e1cc-4956-951b-ed67b068ff12 tempest-TestInstancesWithCinderVolumes-1193651253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:42:35 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-63f97538-e1cc-4956-951b-ed67b068ff12 tempest-TestInstancesWithCinderVolumes-1193651253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:42:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-63f97538-e1cc-4956-951b-ed67b068ff12 tempest-TestInstancesWithCinderVolumes-1193651253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:42:35 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-63f97538-e1cc-4956-951b-ed67b068ff12 tempest-TestInstancesWithCinderVolumes-1193651253 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:42:35 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-63f97538-e1cc-4956-951b-ed67b068ff12 tempest-TestInstancesWithCinderVolumes-1193651253 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:42:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-63f97538-e1cc-4956-951b-ed67b068ff12 tempest-TestInstancesWithCinderVolumes-1193651253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-07fc2280-ce7e-495e-bb9a-403b9873f0f1 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:35 devstack sudo[97836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-07fc2280-ce7e-495e-bb9a-403b9873f0f1 1073741824 Jul 08 01:42:35 devstack sudo[97836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:36 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bf09980-f555-47ea-98c6-ab59a8187d7f tempest-TestInstancesWithCinderVolumes-1193651253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:42:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1bf09980-f555-47ea-98c6-ab59a8187d7f tempest-TestInstancesWithCinderVolumes-1193651253 None] Flow 'volume_create_manager' (c99d4065-85f5-4ef6-9c0d-97318dfd0b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:42:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1bf09980-f555-47ea-98c6-ab59a8187d7f tempest-TestInstancesWithCinderVolumes-1193651253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7b49bec-e8fd-4a08-b48f-da9bf4be1fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:42:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1bf09980-f555-47ea-98c6-ab59a8187d7f tempest-TestInstancesWithCinderVolumes-1193651253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7b49bec-e8fd-4a08-b48f-da9bf4be1fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1636794566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bb1941e-180e-4e09-8436-33a9ec823837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c21612107e640c89dd39bf34af26e02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:42:37Z,use_quota=True,user_id='e4547cd344764c51baed5d122d70e67a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e79e6684-e73f-448f-a815-deed3f28c4b2),volume_type_id=e79e6684-e73f-448f-a815-deed3f28c4b2)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:42:37 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1bf09980-f555-47ea-98c6-ab59a8187d7f tempest-TestInstancesWithCinderVolumes-1193651253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef2f73f3-b9df-47cb-89ea-5dc1bb8521b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:42:37 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1bf09980-f555-47ea-98c6-ab59a8187d7f tempest-TestInstancesWithCinderVolumes-1193651253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef2f73f3-b9df-47cb-89ea-5dc1bb8521b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:42:37 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1bf09980-f555-47ea-98c6-ab59a8187d7f tempest-TestInstancesWithCinderVolumes-1193651253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd1d78c-5c75-4e05-9e4a-10d4f69b88de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:42:37 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1bf09980-f555-47ea-98c6-ab59a8187d7f tempest-TestInstancesWithCinderVolumes-1193651253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd1d78c-5c75-4e05-9e4a-10d4f69b88de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bb1941e-180e-4e09-8436-33a9ec823837', 'volume_name': 'volume-9bb1941e-180e-4e09-8436-33a9ec823837', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:42:37 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1bf09980-f555-47ea-98c6-ab59a8187d7f tempest-TestInstancesWithCinderVolumes-1193651253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7736e577-eee0-4f95-bd31-d4456bdb744d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:42:37 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1bf09980-f555-47ea-98c6-ab59a8187d7f tempest-TestInstancesWithCinderVolumes-1193651253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7736e577-eee0-4f95-bd31-d4456bdb744d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:42:37 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1bf09980-f555-47ea-98c6-ab59a8187d7f tempest-TestInstancesWithCinderVolumes-1193651253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbaf8181-6f73-42d5-bb44-6306eedb46fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:42:37 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-1bf09980-f555-47ea-98c6-ab59a8187d7f tempest-TestInstancesWithCinderVolumes-1193651253 None] Volume 9bb1941e-180e-4e09-8436-33a9ec823837: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bb1941e-180e-4e09-8436-33a9ec823837', 'volume_size': 1} Jul 08 01:42:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-1bf09980-f555-47ea-98c6-ab59a8187d7f tempest-TestInstancesWithCinderVolumes-1193651253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:42:37 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:42:37 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Flow 'volume_create_manager' (de8380ac-12c4-4a28-8f5b-d8532ceae117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:42:37 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0752bf6b-ed3f-425c-b3c4-02663edf3659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:42:37 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0752bf6b-ed3f-425c-b3c4-02663edf3659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1851183224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2051111b-fd44-4106-b2e2-fa54c1b54825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c21612107e640c89dd39bf34af26e02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:42:38Z,use_quota=True,user_id='e4547cd344764c51baed5d122d70e67a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b39348b0-11dd-4860-820d-a9400fc3b378),volume_type_id=b39348b0-11dd-4860-820d-a9400fc3b378)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:42:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4addb6d6-197e-44c3-b0f5-d396c0431418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:42:38 devstack sudo[97836]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4addb6d6-197e-44c3-b0f5-d396c0431418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:42:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32554f72-7398-4778-b90d-29116ca8642e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:42:38 devstack cinder-volume[87284]: DEBUG cinder.image.glance [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Creating Keystone auth plugin from conf {{(pid=87284) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:42:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-63f97538-e1cc-4956-951b-ed67b068ff12 tempest-TestInstancesWithCinderVolumes-1193651253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-07fc2280-ce7e-495e-bb9a-403b9873f0f1 1073741824" returned: 0 in 2.410s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-63f97538-e1cc-4956-951b-ed67b068ff12 tempest-TestInstancesWithCinderVolumes-1193651253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-07fc2280-ce7e-495e-bb9a-403b9873f0f1 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:38 devstack sudo[97845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-07fc2280-ce7e-495e-bb9a-403b9873f0f1 Jul 08 01:42:38 devstack sudo[97845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32554f72-7398-4778-b90d-29116ca8642e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2051111b-fd44-4106-b2e2-fa54c1b54825', 'volume_name': 'volume-2051111b-fd44-4106-b2e2-fa54c1b54825', 'volume_size': 1, 'image_id': '33ac0880-a98f-43f5-ae7c-7a13e7439519', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33ac0880-a98f-43f5-ae7c-7a13e7439519', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--773722982', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c21612107e640c89dd39bf34af26e02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '33ac0880-a98f-43f5-ae7c-7a13e7439519', 'created_at': datetime.datetime(2026, 7, 7, 23, 42, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33ac0880-a98f-43f5-ae7c-7a13e7439519/file', 'properties': {}}, 'image_service': }' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:42:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf79a4df-ff60-42d5-87db-740cbfc03d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:42:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf79a4df-ff60-42d5-87db-740cbfc03d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:42:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ca98959-19f4-4d9d-961f-463f63723132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:42:38 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Volume 2051111b-fd44-4106-b2e2-fa54c1b54825: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2051111b-fd44-4106-b2e2-fa54c1b54825', 'volume_size': 1, 'image_id': '33ac0880-a98f-43f5-ae7c-7a13e7439519', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33ac0880-a98f-43f5-ae7c-7a13e7439519', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--773722982', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c21612107e640c89dd39bf34af26e02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '33ac0880-a98f-43f5-ae7c-7a13e7439519', 'created_at': datetime.datetime(2026, 7, 7, 23, 42, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33ac0880-a98f-43f5-ae7c-7a13e7439519/file', 'properties': {}}, 'image_service': } Jul 08 01:42:38 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Trying to clone 2051111b-fd44-4106-b2e2-fa54c1b54825 from image 33ac0880-a98f-43f5-ae7c-7a13e7439519 at location (None, [{'url': 'file:///opt/stack/data/glance/images/33ac0880-a98f-43f5-ae7c-7a13e7439519', 'metadata': {}}]). {{(pid=87284) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:42:39 devstack sudo[97845]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-63f97538-e1cc-4956-951b-ed67b068ff12 tempest-TestInstancesWithCinderVolumes-1193651253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-07fc2280-ce7e-495e-bb9a-403b9873f0f1" returned: 0 in 1.234s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:39 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-63f97538-e1cc-4956-951b-ed67b068ff12 tempest-TestInstancesWithCinderVolumes-1193651253 None] <== create_volume: return (3714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:42:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-63f97538-e1cc-4956-951b-ed67b068ff12 tempest-TestInstancesWithCinderVolumes-1193651253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.717s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:42:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-1bf09980-f555-47ea-98c6-ab59a8187d7f tempest-TestInstancesWithCinderVolumes-1193651253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.201s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:42:39 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-1bf09980-f555-47ea-98c6-ab59a8187d7f tempest-TestInstancesWithCinderVolumes-1193651253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1636794566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bb1941e-180e-4e09-8436-33a9ec823837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c21612107e640c89dd39bf34af26e02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:42:37Z,use_quota=True,user_id='e4547cd344764c51baed5d122d70e67a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e79e6684-e73f-448f-a815-deed3f28c4b2),volume_type_id=e79e6684-e73f-448f-a815-deed3f28c4b2)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:42:39 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-1bf09980-f555-47ea-98c6-ab59a8187d7f tempest-TestInstancesWithCinderVolumes-1193651253 None] Creating volume 9bb1941e-180e-4e09-8436-33a9ec823837 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:42:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-1bf09980-f555-47ea-98c6-ab59a8187d7f tempest-TestInstancesWithCinderVolumes-1193651253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:42:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-1bf09980-f555-47ea-98c6-ab59a8187d7f tempest-TestInstancesWithCinderVolumes-1193651253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:42:39 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-1bf09980-f555-47ea-98c6-ab59a8187d7f tempest-TestInstancesWithCinderVolumes-1193651253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:42:39 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-1bf09980-f555-47ea-98c6-ab59a8187d7f tempest-TestInstancesWithCinderVolumes-1193651253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:42:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-1bf09980-f555-47ea-98c6-ab59a8187d7f tempest-TestInstancesWithCinderVolumes-1193651253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:42:39 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-1bf09980-f555-47ea-98c6-ab59a8187d7f tempest-TestInstancesWithCinderVolumes-1193651253 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:42:39 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-1bf09980-f555-47ea-98c6-ab59a8187d7f tempest-TestInstancesWithCinderVolumes-1193651253 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:42:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1bf09980-f555-47ea-98c6-ab59a8187d7f tempest-TestInstancesWithCinderVolumes-1193651253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9bb1941e-180e-4e09-8436-33a9ec823837 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-63f97538-e1cc-4956-951b-ed67b068ff12 tempest-TestInstancesWithCinderVolumes-1193651253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de8a04bd-9844-4a00-b83d-9a11add5bdd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07fc2280-ce7e-495e-bb9a-403b9873f0f1', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:42:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-63f97538-e1cc-4956-951b-ed67b068ff12 tempest-TestInstancesWithCinderVolumes-1193651253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7494169c-715b-4a25-84fd-18ca65c4cb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:42:39 devstack sudo[97850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9bb1941e-180e-4e09-8436-33a9ec823837 1073741824 Jul 08 01:42:39 devstack sudo[97850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:39 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-63f97538-e1cc-4956-951b-ed67b068ff12 tempest-TestInstancesWithCinderVolumes-1193651253 None] Volume volume-07fc2280-ce7e-495e-bb9a-403b9873f0f1 (07fc2280-ce7e-495e-bb9a-403b9873f0f1): created successfully Jul 08 01:42:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-63f97538-e1cc-4956-951b-ed67b068ff12 tempest-TestInstancesWithCinderVolumes-1193651253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7494169c-715b-4a25-84fd-18ca65c4cb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:42:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-63f97538-e1cc-4956-951b-ed67b068ff12 tempest-TestInstancesWithCinderVolumes-1193651253 None] Flow 'volume_create_manager' (cc4cea9e-87a4-46ec-b7bb-c6724acbd7fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:42:39 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-63f97538-e1cc-4956-951b-ed67b068ff12 tempest-TestInstancesWithCinderVolumes-1193651253 None] Created volume successfully. Jul 08 01:42:41 devstack sudo[97850]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1bf09980-f555-47ea-98c6-ab59a8187d7f tempest-TestInstancesWithCinderVolumes-1193651253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9bb1941e-180e-4e09-8436-33a9ec823837 1073741824" returned: 0 in 1.755s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1bf09980-f555-47ea-98c6-ab59a8187d7f tempest-TestInstancesWithCinderVolumes-1193651253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9bb1941e-180e-4e09-8436-33a9ec823837 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:41 devstack sudo[97865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9bb1941e-180e-4e09-8436-33a9ec823837 Jul 08 01:42:41 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:42 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1bf09980-f555-47ea-98c6-ab59a8187d7f tempest-TestInstancesWithCinderVolumes-1193651253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9bb1941e-180e-4e09-8436-33a9ec823837" returned: 0 in 1.451s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:42 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-1bf09980-f555-47ea-98c6-ab59a8187d7f tempest-TestInstancesWithCinderVolumes-1193651253 None] <== create_volume: return (3301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:42:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-1bf09980-f555-47ea-98c6-ab59a8187d7f tempest-TestInstancesWithCinderVolumes-1193651253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.305s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:42:42 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1bf09980-f555-47ea-98c6-ab59a8187d7f tempest-TestInstancesWithCinderVolumes-1193651253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbaf8181-6f73-42d5-bb44-6306eedb46fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bb1941e-180e-4e09-8436-33a9ec823837', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:42:42 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1bf09980-f555-47ea-98c6-ab59a8187d7f tempest-TestInstancesWithCinderVolumes-1193651253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13ac5236-c9eb-45d6-83b6-90819a3f8141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:42:42 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-1bf09980-f555-47ea-98c6-ab59a8187d7f tempest-TestInstancesWithCinderVolumes-1193651253 None] Volume volume-9bb1941e-180e-4e09-8436-33a9ec823837 (9bb1941e-180e-4e09-8436-33a9ec823837): created successfully Jul 08 01:42:42 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1bf09980-f555-47ea-98c6-ab59a8187d7f tempest-TestInstancesWithCinderVolumes-1193651253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13ac5236-c9eb-45d6-83b6-90819a3f8141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:42:42 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1bf09980-f555-47ea-98c6-ab59a8187d7f tempest-TestInstancesWithCinderVolumes-1193651253 None] Flow 'volume_create_manager' (c99d4065-85f5-4ef6-9c0d-97318dfd0b48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:42:42 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-1bf09980-f555-47ea-98c6-ab59a8187d7f tempest-TestInstancesWithCinderVolumes-1193651253 None] Created volume successfully. Jul 08 01:42:44 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_33ac0880-a98f-43f5-ae7c-7a13e7439519_ggb4cysidevstack@QuobyteHD, size 20.69 MB, duration 5.60 sec {{(pid=87284) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:42:44 devstack cinder-volume[87284]: INFO cinder.image.image_utils [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Image download 20.69 MB at 3.70 MB/s Jul 08 01:42:44 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[e584c20b-81ff-43b1-9123-a66905636525]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:42:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33ac0880-a98f-43f5-ae7c-7a13e7439519_ggb4cysidevstack@QuobyteHD {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:44 devstack sudo[97870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33ac0880-a98f-43f5-ae7c-7a13e7439519_ggb4cysidevstack@QuobyteHD Jul 08 01:42:44 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:45 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33ac0880-a98f-43f5-ae7c-7a13e7439519_ggb4cysidevstack@QuobyteHD" returned: 0 in 0.801s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:45 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Temporary image 33ac0880-a98f-43f5-ae7c-7a13e7439519 is fetched for user e4547cd344764c51baed5d122d70e67a. {{(pid=87284) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:42:45 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6326346-674d-4fc0-9c67-9a16e52fae90]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:42:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33ac0880-a98f-43f5-ae7c-7a13e7439519_ggb4cysidevstack@QuobyteHD {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:45 devstack sudo[97876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33ac0880-a98f-43f5-ae7c-7a13e7439519_ggb4cysidevstack@QuobyteHD Jul 08 01:42:45 devstack sudo[97876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:45 devstack sudo[97876]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33ac0880-a98f-43f5-ae7c-7a13e7439519_ggb4cysidevstack@QuobyteHD" returned: 0 in 0.786s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:42:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:42:45 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1851183224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2051111b-fd44-4106-b2e2-fa54c1b54825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c21612107e640c89dd39bf34af26e02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:42:38Z,use_quota=True,user_id='e4547cd344764c51baed5d122d70e67a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b39348b0-11dd-4860-820d-a9400fc3b378),volume_type_id=b39348b0-11dd-4860-820d-a9400fc3b378)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:42:45 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Creating volume 2051111b-fd44-4106-b2e2-fa54c1b54825 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:42:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:42:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:42:45 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:42:45 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:42:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:42:45 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:42:45 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:42:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2051111b-fd44-4106-b2e2-fa54c1b54825 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:46 devstack sudo[97881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2051111b-fd44-4106-b2e2-fa54c1b54825 1073741824 Jul 08 01:42:46 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:46 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2051111b-fd44-4106-b2e2-fa54c1b54825 1073741824" returned: 0 in 0.973s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2051111b-fd44-4106-b2e2-fa54c1b54825 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:47 devstack sudo[97887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2051111b-fd44-4106-b2e2-fa54c1b54825 Jul 08 01:42:47 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:47 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2051111b-fd44-4106-b2e2-fa54c1b54825" returned: 0 in 0.749s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:47 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] <== create_volume: return (1781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:42:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:42:47 devstack cinder-volume[87284]: DEBUG cinder.volume.volume_utils [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Attempting download of 33ac0880-a98f-43f5-ae7c-7a13e7439519 ((None, [{'url': 'file:///opt/stack/data/glance/images/33ac0880-a98f-43f5-ae7c-7a13e7439519', 'metadata': {}}])) to volume 2051111b-fd44-4106-b2e2-fa54c1b54825. {{(pid=87284) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:42:47 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad9e6c6-f47a-46aa-a500-f9f3ac11def3]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:42:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33ac0880-a98f-43f5-ae7c-7a13e7439519_g5vsyypv {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:47 devstack sudo[97910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33ac0880-a98f-43f5-ae7c-7a13e7439519_g5vsyypv Jul 08 01:42:47 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:48 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33ac0880-a98f-43f5-ae7c-7a13e7439519_g5vsyypv" returned: 0 in 0.789s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33ac0880-a98f-43f5-ae7c-7a13e7439519_g5vsyypv {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:48 devstack sudo[97914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33ac0880-a98f-43f5-ae7c-7a13e7439519_g5vsyypv Jul 08 01:42:48 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:49 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33ac0880-a98f-43f5-ae7c-7a13e7439519_g5vsyypv" returned: 1 in 0.760s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33ac0880-a98f-43f5-ae7c-7a13e7439519_g5vsyypv' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:42:49 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[65adae59-4fd7-4747-ae89-cfbe5621f2a6]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:42:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33ac0880-a98f-43f5-ae7c-7a13e7439519_ggb4cysidevstack@QuobyteHD {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:49 devstack sudo[97918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33ac0880-a98f-43f5-ae7c-7a13e7439519_ggb4cysidevstack@QuobyteHD Jul 08 01:42:49 devstack sudo[97918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:50 devstack sudo[97918]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33ac0880-a98f-43f5-ae7c-7a13e7439519_ggb4cysidevstack@QuobyteHD" returned: 0 in 0.837s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:50 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] 33ac0880-a98f-43f5-ae7c-7a13e7439519 was qcow2, converting to raw {{(pid=87284) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:42:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_33ac0880-a98f-43f5-ae7c-7a13e7439519_ggb4cysidevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2051111b-fd44-4106-b2e2-fa54c1b54825 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:50 devstack sudo[97923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_33ac0880-a98f-43f5-ae7c-7a13e7439519_ggb4cysidevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2051111b-fd44-4106-b2e2-fa54c1b54825 Jul 08 01:42:50 devstack sudo[97923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:52 devstack sudo[97923]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_33ac0880-a98f-43f5-ae7c-7a13e7439519_ggb4cysidevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2051111b-fd44-4106-b2e2-fa54c1b54825" returned: 0 in 1.998s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:52 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_33ac0880-a98f-43f5-ae7c-7a13e7439519_ggb4cysidevstack@QuobyteHD, size 112.00 MB, duration 2.00 sec, destination /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2051111b-fd44-4106-b2e2-fa54c1b54825 {{(pid=87284) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:42:52 devstack cinder-volume[87284]: INFO cinder.image.image_utils [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Converted 112.00 MB image at 56.03 MB/s Jul 08 01:42:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2051111b-fd44-4106-b2e2-fa54c1b54825 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:52 devstack sudo[97962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2051111b-fd44-4106-b2e2-fa54c1b54825 1G Jul 08 01:42:52 devstack sudo[97962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:52 devstack sudo[97962]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2051111b-fd44-4106-b2e2-fa54c1b54825 1G" returned: 0 in 0.697s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:52 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[060b241d-021c-426e-b0e6-14146f73eaca]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:42:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2051111b-fd44-4106-b2e2-fa54c1b54825 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:53 devstack sudo[97976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2051111b-fd44-4106-b2e2-fa54c1b54825 Jul 08 01:42:53 devstack sudo[97976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:53 devstack sudo[97976]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2051111b-fd44-4106-b2e2-fa54c1b54825" returned: 0 in 0.780s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2051111b-fd44-4106-b2e2-fa54c1b54825 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:53 devstack sudo[97980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2051111b-fd44-4106-b2e2-fa54c1b54825 Jul 08 01:42:53 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:54 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2051111b-fd44-4106-b2e2-fa54c1b54825" returned: 1 in 0.752s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2051111b-fd44-4106-b2e2-fa54c1b54825' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:42:54 devstack cinder-volume[87284]: DEBUG cinder.volume.volume_utils [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Downloaded image 33ac0880-a98f-43f5-ae7c-7a13e7439519 ((None, [{'url': 'file:///opt/stack/data/glance/images/33ac0880-a98f-43f5-ae7c-7a13e7439519', 'metadata': {}}])) to volume 2051111b-fd44-4106-b2e2-fa54c1b54825 successfully. {{(pid=87284) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:42:54 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Temporary image 33ac0880-a98f-43f5-ae7c-7a13e7439519 for user e4547cd344764c51baed5d122d70e67a is deleted. {{(pid=87284) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:42:54 devstack cinder-volume[87284]: DEBUG cinder.volume.volume_utils [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Marking volume 2051111b-fd44-4106-b2e2-fa54c1b54825 as bootable. {{(pid=87284) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:42:54 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Copying metadata from image 33ac0880-a98f-43f5-ae7c-7a13e7439519 to 2051111b-fd44-4106-b2e2-fa54c1b54825. {{(pid=87284) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:42:54 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Creating volume glance metadata for volume 2051111b-fd44-4106-b2e2-fa54c1b54825 backed by image 33ac0880-a98f-43f5-ae7c-7a13e7439519 with: {'image_id': '33ac0880-a98f-43f5-ae7c-7a13e7439519', 'image_name': 'tempest-scenario-img--773722982', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87284) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:42:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ca98959-19f4-4d9d-961f-463f63723132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2051111b-fd44-4106-b2e2-fa54c1b54825', 'volume_size': 1, 'image_id': '33ac0880-a98f-43f5-ae7c-7a13e7439519', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33ac0880-a98f-43f5-ae7c-7a13e7439519', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--773722982', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c21612107e640c89dd39bf34af26e02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '33ac0880-a98f-43f5-ae7c-7a13e7439519', 'created_at': datetime.datetime(2026, 7, 7, 23, 42, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33ac0880-a98f-43f5-ae7c-7a13e7439519/file', 'properties': {}}, 'image_service': }' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:42:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40124a10-5d86-43f5-aaf7-ccc1296433f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:42:54 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Volume volume-2051111b-fd44-4106-b2e2-fa54c1b54825 (2051111b-fd44-4106-b2e2-fa54c1b54825): created successfully Jul 08 01:42:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40124a10-5d86-43f5-aaf7-ccc1296433f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:42:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Flow 'volume_create_manager' (de8380ac-12c4-4a28-8f5b-d8532ceae117) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:42:54 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-36991fed-ac7b-4038-a438-541383d006cc tempest-TestInstancesWithCinderVolumes-1193651253 None] Created volume successfully. Jul 08 01:42:55 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:42:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:42:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:42:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:42:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:42:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:42:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:55 devstack sudo[97986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:42:55 devstack sudo[97986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:55 devstack sudo[97986]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.731s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:55 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:42:55 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager._thread_info {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:42:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread count: 29 {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:42:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread info: [<_MainThread(MainThread, started 127058402500736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:43:00 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-393e7967-17d3-4356-b128-afba7e8f281c tempest-AttachVolumeNegativeTest-1884741045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:43:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-393e7967-17d3-4356-b128-afba7e8f281c tempest-AttachVolumeNegativeTest-1884741045 None] Flow 'volume_create_manager' (80a09bed-3362-4d7e-9290-acbaf2ebfa03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:43:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-393e7967-17d3-4356-b128-afba7e8f281c tempest-AttachVolumeNegativeTest-1884741045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05591368-d809-429a-bef7-43cefd8a53a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:43:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-393e7967-17d3-4356-b128-afba7e8f281c tempest-AttachVolumeNegativeTest-1884741045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05591368-d809-429a-bef7-43cefd8a53a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1959378462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6382b228-eb09-4f05-a085-5b48edfac2f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b132a62bc75f428690d4a973fa99e0a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:43:00Z,use_quota=True,user_id='321acf045e5e4ab099b9a076a97db13e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:43:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-393e7967-17d3-4356-b128-afba7e8f281c tempest-AttachVolumeNegativeTest-1884741045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75a157d9-73f4-47a0-b3b4-2bae7e21f0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:43:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-393e7967-17d3-4356-b128-afba7e8f281c tempest-AttachVolumeNegativeTest-1884741045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75a157d9-73f4-47a0-b3b4-2bae7e21f0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:43:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-393e7967-17d3-4356-b128-afba7e8f281c tempest-AttachVolumeNegativeTest-1884741045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1235bb-db48-47c9-bae4-6974f3871b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:43:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-393e7967-17d3-4356-b128-afba7e8f281c tempest-AttachVolumeNegativeTest-1884741045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1235bb-db48-47c9-bae4-6974f3871b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6382b228-eb09-4f05-a085-5b48edfac2f9', 'volume_name': 'volume-6382b228-eb09-4f05-a085-5b48edfac2f9', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:43:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-393e7967-17d3-4356-b128-afba7e8f281c tempest-AttachVolumeNegativeTest-1884741045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b944ce84-58a3-43f4-bae7-7a92bc623b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:43:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-393e7967-17d3-4356-b128-afba7e8f281c tempest-AttachVolumeNegativeTest-1884741045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b944ce84-58a3-43f4-bae7-7a92bc623b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:43:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-393e7967-17d3-4356-b128-afba7e8f281c tempest-AttachVolumeNegativeTest-1884741045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1205639d-dd68-48aa-9ce6-4bc3cc6c22bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:43:00 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-393e7967-17d3-4356-b128-afba7e8f281c tempest-AttachVolumeNegativeTest-1884741045 None] Volume 6382b228-eb09-4f05-a085-5b48edfac2f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6382b228-eb09-4f05-a085-5b48edfac2f9', 'volume_size': 1} Jul 08 01:43:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-393e7967-17d3-4356-b128-afba7e8f281c tempest-AttachVolumeNegativeTest-1884741045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:43:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-393e7967-17d3-4356-b128-afba7e8f281c tempest-AttachVolumeNegativeTest-1884741045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:43:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-393e7967-17d3-4356-b128-afba7e8f281c tempest-AttachVolumeNegativeTest-1884741045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1959378462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6382b228-eb09-4f05-a085-5b48edfac2f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b132a62bc75f428690d4a973fa99e0a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:43:00Z,use_quota=True,user_id='321acf045e5e4ab099b9a076a97db13e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:43:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-393e7967-17d3-4356-b128-afba7e8f281c tempest-AttachVolumeNegativeTest-1884741045 None] Creating volume 6382b228-eb09-4f05-a085-5b48edfac2f9 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:43:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-393e7967-17d3-4356-b128-afba7e8f281c tempest-AttachVolumeNegativeTest-1884741045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:43:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-393e7967-17d3-4356-b128-afba7e8f281c tempest-AttachVolumeNegativeTest-1884741045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:43:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-393e7967-17d3-4356-b128-afba7e8f281c tempest-AttachVolumeNegativeTest-1884741045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:43:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-393e7967-17d3-4356-b128-afba7e8f281c tempest-AttachVolumeNegativeTest-1884741045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:43:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-393e7967-17d3-4356-b128-afba7e8f281c tempest-AttachVolumeNegativeTest-1884741045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:43:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-393e7967-17d3-4356-b128-afba7e8f281c tempest-AttachVolumeNegativeTest-1884741045 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:43:00 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-393e7967-17d3-4356-b128-afba7e8f281c tempest-AttachVolumeNegativeTest-1884741045 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:43:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-393e7967-17d3-4356-b128-afba7e8f281c tempest-AttachVolumeNegativeTest-1884741045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6382b228-eb09-4f05-a085-5b48edfac2f9 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:43:00 devstack sudo[97997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6382b228-eb09-4f05-a085-5b48edfac2f9 1073741824 Jul 08 01:43:00 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:43:01 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root Jul 08 01:43:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-393e7967-17d3-4356-b128-afba7e8f281c tempest-AttachVolumeNegativeTest-1884741045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6382b228-eb09-4f05-a085-5b48edfac2f9 1073741824" returned: 0 in 0.988s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:43:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-393e7967-17d3-4356-b128-afba7e8f281c tempest-AttachVolumeNegativeTest-1884741045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6382b228-eb09-4f05-a085-5b48edfac2f9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:43:01 devstack sudo[98004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6382b228-eb09-4f05-a085-5b48edfac2f9 Jul 08 01:43:01 devstack sudo[98004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:43:02 devstack sudo[98004]: pam_unix(sudo:session): session closed for user root Jul 08 01:43:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-393e7967-17d3-4356-b128-afba7e8f281c tempest-AttachVolumeNegativeTest-1884741045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6382b228-eb09-4f05-a085-5b48edfac2f9" returned: 0 in 0.773s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:43:02 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-393e7967-17d3-4356-b128-afba7e8f281c tempest-AttachVolumeNegativeTest-1884741045 None] <== create_volume: return (1820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:43:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-393e7967-17d3-4356-b128-afba7e8f281c tempest-AttachVolumeNegativeTest-1884741045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.823s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:43:02 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-393e7967-17d3-4356-b128-afba7e8f281c tempest-AttachVolumeNegativeTest-1884741045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1205639d-dd68-48aa-9ce6-4bc3cc6c22bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6382b228-eb09-4f05-a085-5b48edfac2f9', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:43:02 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-393e7967-17d3-4356-b128-afba7e8f281c tempest-AttachVolumeNegativeTest-1884741045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82455326-e383-43a0-a321-a8910a82059e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:43:02 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-393e7967-17d3-4356-b128-afba7e8f281c tempest-AttachVolumeNegativeTest-1884741045 None] Volume volume-6382b228-eb09-4f05-a085-5b48edfac2f9 (6382b228-eb09-4f05-a085-5b48edfac2f9): created successfully Jul 08 01:43:02 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-393e7967-17d3-4356-b128-afba7e8f281c tempest-AttachVolumeNegativeTest-1884741045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82455326-e383-43a0-a321-a8910a82059e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:43:02 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-393e7967-17d3-4356-b128-afba7e8f281c tempest-AttachVolumeNegativeTest-1884741045 None] Flow 'volume_create_manager' (80a09bed-3362-4d7e-9290-acbaf2ebfa03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:43:02 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-393e7967-17d3-4356-b128-afba7e8f281c tempest-AttachVolumeNegativeTest-1884741045 None] Created volume successfully. Jul 08 01:43:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-809dcdd3-544b-4c23-951e-ba873b932d6e req-99bfb6b4-ac32-4787-81fb-94e8cd4fa9a4 tempest-TestInstancesWithCinderVolumes-1193651253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:43:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-809dcdd3-544b-4c23-951e-ba873b932d6e req-99bfb6b4-ac32-4787-81fb-94e8cd4fa9a4 tempest-TestInstancesWithCinderVolumes-1193651253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:43:02 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9986392-c183-4bc0-997c-af5ef492a98e]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:43:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-809dcdd3-544b-4c23-951e-ba873b932d6e req-99bfb6b4-ac32-4787-81fb-94e8cd4fa9a4 tempest-TestInstancesWithCinderVolumes-1193651253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2051111b-fd44-4106-b2e2-fa54c1b54825 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:43:02 devstack sudo[98018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2051111b-fd44-4106-b2e2-fa54c1b54825 Jul 08 01:43:02 devstack sudo[98018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:43:03 devstack sudo[98018]: pam_unix(sudo:session): session closed for user root Jul 08 01:43:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-809dcdd3-544b-4c23-951e-ba873b932d6e req-99bfb6b4-ac32-4787-81fb-94e8cd4fa9a4 tempest-TestInstancesWithCinderVolumes-1193651253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2051111b-fd44-4106-b2e2-fa54c1b54825" returned: 0 in 0.788s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:43:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-809dcdd3-544b-4c23-951e-ba873b932d6e req-99bfb6b4-ac32-4787-81fb-94e8cd4fa9a4 tempest-TestInstancesWithCinderVolumes-1193651253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2051111b-fd44-4106-b2e2-fa54c1b54825 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:43:03 devstack sudo[98023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2051111b-fd44-4106-b2e2-fa54c1b54825 Jul 08 01:43:03 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:43:04 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root Jul 08 01:43:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-809dcdd3-544b-4c23-951e-ba873b932d6e req-99bfb6b4-ac32-4787-81fb-94e8cd4fa9a4 tempest-TestInstancesWithCinderVolumes-1193651253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2051111b-fd44-4106-b2e2-fa54c1b54825" returned: 1 in 0.810s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:43:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-809dcdd3-544b-4c23-951e-ba873b932d6e req-99bfb6b4-ac32-4787-81fb-94e8cd4fa9a4 tempest-TestInstancesWithCinderVolumes-1193651253 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2051111b-fd44-4106-b2e2-fa54c1b54825' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:43:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-809dcdd3-544b-4c23-951e-ba873b932d6e req-99bfb6b4-ac32-4787-81fb-94e8cd4fa9a4 tempest-TestInstancesWithCinderVolumes-1193651253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.639s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:43:04 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-809dcdd3-544b-4c23-951e-ba873b932d6e req-99bfb6b4-ac32-4787-81fb-94e8cd4fa9a4 tempest-TestInstancesWithCinderVolumes-1193651253 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96', 'name': 'volume-2051111b-fd44-4106-b2e2-fa54c1b54825', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e2d8c3ab-7317-4764-af55-f0389aa1b97e', 'enforce_multipath': True} {{(pid=87284) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:43:04 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-809dcdd3-544b-4c23-951e-ba873b932d6e req-99bfb6b4-ac32-4787-81fb-94e8cd4fa9a4 tempest-TestInstancesWithCinderVolumes-1193651253 None] attachment_update completed successfully. Jul 08 01:43:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-0ac2fa95-5ea7-4781-8cb4-ff683ad6825d req-1aea11f0-19eb-4dcb-8512-1bef86f6a4db tempest-AttachVolumeNegativeTest-1884741045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:43:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-0ac2fa95-5ea7-4781-8cb4-ff683ad6825d req-1aea11f0-19eb-4dcb-8512-1bef86f6a4db tempest-AttachVolumeNegativeTest-1884741045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:43:05 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[c001cac9-b8fd-4afc-b8fc-e7c8483a2c5a]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:43:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-0ac2fa95-5ea7-4781-8cb4-ff683ad6825d req-1aea11f0-19eb-4dcb-8512-1bef86f6a4db tempest-AttachVolumeNegativeTest-1884741045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6382b228-eb09-4f05-a085-5b48edfac2f9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:43:05 devstack sudo[98038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6382b228-eb09-4f05-a085-5b48edfac2f9 Jul 08 01:43:05 devstack sudo[98038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:43:06 devstack sudo[98038]: pam_unix(sudo:session): session closed for user root Jul 08 01:43:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-0ac2fa95-5ea7-4781-8cb4-ff683ad6825d req-1aea11f0-19eb-4dcb-8512-1bef86f6a4db tempest-AttachVolumeNegativeTest-1884741045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6382b228-eb09-4f05-a085-5b48edfac2f9" returned: 0 in 0.824s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:43:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-0ac2fa95-5ea7-4781-8cb4-ff683ad6825d req-1aea11f0-19eb-4dcb-8512-1bef86f6a4db tempest-AttachVolumeNegativeTest-1884741045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.840s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:43:06 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-0ac2fa95-5ea7-4781-8cb4-ff683ad6825d req-1aea11f0-19eb-4dcb-8512-1bef86f6a4db tempest-AttachVolumeNegativeTest-1884741045 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96', 'name': 'volume-6382b228-eb09-4f05-a085-5b48edfac2f9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8875afae-3051-49d8-ba46-ae9cbf7f03fc', 'enforce_multipath': True} {{(pid=87284) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:43:06 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-0ac2fa95-5ea7-4781-8cb4-ff683ad6825d req-1aea11f0-19eb-4dcb-8512-1bef86f6a4db tempest-AttachVolumeNegativeTest-1884741045 None] attachment_update completed successfully. Jul 08 01:43:13 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-4e358b54-1b17-4a3a-b02a-841b6ca95fb9 req-0a91f89c-9c15-4156-be94-dfb1a6c17a7e tempest-AttachVolumeNegativeTest-1884741045 None] Terminate volume connection completed successfully. Jul 08 01:43:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-4e358b54-1b17-4a3a-b02a-841b6ca95fb9 req-0a91f89c-9c15-4156-be94-dfb1a6c17a7e tempest-AttachVolumeNegativeTest-1884741045 None] Deleting attachment 8875afae-3051-49d8-ba46-ae9cbf7f03fc. {{(pid=87284) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:43:19 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-c4bce23d-deb9-4f0f-9de0-b2d6f3e77da9 req-02fae59c-badb-4b61-a176-cad42a2b7f5c tempest-TestShelveInstance-1724066282 None] Terminate volume connection completed successfully. Jul 08 01:43:19 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-c4bce23d-deb9-4f0f-9de0-b2d6f3e77da9 req-02fae59c-badb-4b61-a176-cad42a2b7f5c tempest-TestShelveInstance-1724066282 None] Deleting attachment 24504668-d238-4a5c-8b15-775e2f435364. {{(pid=87284) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:43:20 devstack cinder-volume[87284]: DEBUG cinder.coordination [req-c4bce23d-deb9-4f0f-9de0-b2d6f3e77da9 req-1a05f27a-bb1d-4aa8-8f24-9be50deb61ef tempest-TestShelveInstance-1724066282 None] Acquiring lock "cinder-1680554d-f816-42a4-819c-b52eadf31873-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:43:20 devstack cinder-volume[87284]: DEBUG cinder.coordination [req-c4bce23d-deb9-4f0f-9de0-b2d6f3e77da9 req-1a05f27a-bb1d-4aa8-8f24-9be50deb61ef tempest-TestShelveInstance-1724066282 None] Lock "cinder-1680554d-f816-42a4-819c-b52eadf31873-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:43:20 devstack cinder-volume[87284]: DEBUG cinder.coordination [req-c4bce23d-deb9-4f0f-9de0-b2d6f3e77da9 req-1a05f27a-bb1d-4aa8-8f24-9be50deb61ef tempest-TestShelveInstance-1724066282 None] Acquiring lock "cinder-quobyte-1680554d-f816-42a4-819c-b52eadf31873" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:43:20 devstack cinder-volume[87284]: DEBUG cinder.coordination [req-c4bce23d-deb9-4f0f-9de0-b2d6f3e77da9 req-1a05f27a-bb1d-4aa8-8f24-9be50deb61ef tempest-TestShelveInstance-1724066282 None] Lock "cinder-quobyte-1680554d-f816-42a4-819c-b52eadf31873" acquired by "delete_volume" :: waited 0.022s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:43:20 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[69233e9f-87a8-42cc-841d-6c69d32d2c29]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:43:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-c4bce23d-deb9-4f0f-9de0-b2d6f3e77da9 req-1a05f27a-bb1d-4aa8-8f24-9be50deb61ef tempest-TestShelveInstance-1724066282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:43:21 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873 Jul 08 01:43:21 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:43:21 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Jul 08 01:43:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-c4bce23d-deb9-4f0f-9de0-b2d6f3e77da9 req-1a05f27a-bb1d-4aa8-8f24-9be50deb61ef tempest-TestShelveInstance-1724066282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873" returned: 0 in 0.915s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:43:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-c4bce23d-deb9-4f0f-9de0-b2d6f3e77da9 req-1a05f27a-bb1d-4aa8-8f24-9be50deb61ef tempest-TestShelveInstance-1724066282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:43:21 devstack sudo[98171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873 Jul 08 01:43:21 devstack sudo[98171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:43:22 devstack sudo[98171]: pam_unix(sudo:session): session closed for user root Jul 08 01:43:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-c4bce23d-deb9-4f0f-9de0-b2d6f3e77da9 req-1a05f27a-bb1d-4aa8-8f24-9be50deb61ef tempest-TestShelveInstance-1724066282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873" returned: 1 in 0.833s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:43:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-c4bce23d-deb9-4f0f-9de0-b2d6f3e77da9 req-1a05f27a-bb1d-4aa8-8f24-9be50deb61ef tempest-TestShelveInstance-1724066282 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:43:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-c4bce23d-deb9-4f0f-9de0-b2d6f3e77da9 req-1a05f27a-bb1d-4aa8-8f24-9be50deb61ef tempest-TestShelveInstance-1724066282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:43:22 devstack sudo[98176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873 Jul 08 01:43:22 devstack sudo[98176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:43:23 devstack sudo[98176]: pam_unix(sudo:session): session closed for user root Jul 08 01:43:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-c4bce23d-deb9-4f0f-9de0-b2d6f3e77da9 req-1a05f27a-bb1d-4aa8-8f24-9be50deb61ef tempest-TestShelveInstance-1724066282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1680554d-f816-42a4-819c-b52eadf31873" returned: 0 in 0.726s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:43:23 devstack cinder-volume[87284]: DEBUG cinder.coordination [req-c4bce23d-deb9-4f0f-9de0-b2d6f3e77da9 req-1a05f27a-bb1d-4aa8-8f24-9be50deb61ef tempest-TestShelveInstance-1724066282 None] Lock "cinder-quobyte-1680554d-f816-42a4-819c-b52eadf31873" released by "delete_volume" :: held 2.604s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:43:23 devstack cinder-volume[87284]: DEBUG cinder.quota [req-c4bce23d-deb9-4f0f-9de0-b2d6f3e77da9 req-1a05f27a-bb1d-4aa8-8f24-9be50deb61ef tempest-TestShelveInstance-1724066282 None] Created reservations ['f505d9b2-b78d-4ce5-8170-4e173ee622d3', 'b31f4f58-c352-4efd-9469-d1a1439cca0c', 'e5894b0f-3b6e-4b69-9f9d-8d858dc6db2a', 'acdb70e5-98c9-400b-a829-1fcc6a083914'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:43:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-c4bce23d-deb9-4f0f-9de0-b2d6f3e77da9 req-1a05f27a-bb1d-4aa8-8f24-9be50deb61ef tempest-TestShelveInstance-1724066282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:43:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-c4bce23d-deb9-4f0f-9de0-b2d6f3e77da9 req-1a05f27a-bb1d-4aa8-8f24-9be50deb61ef tempest-TestShelveInstance-1724066282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:43:23 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [req-c4bce23d-deb9-4f0f-9de0-b2d6f3e77da9 req-1a05f27a-bb1d-4aa8-8f24-9be50deb61ef tempest-TestShelveInstance-1724066282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:43:23 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [req-c4bce23d-deb9-4f0f-9de0-b2d6f3e77da9 req-1a05f27a-bb1d-4aa8-8f24-9be50deb61ef tempest-TestShelveInstance-1724066282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:43:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-c4bce23d-deb9-4f0f-9de0-b2d6f3e77da9 req-1a05f27a-bb1d-4aa8-8f24-9be50deb61ef tempest-TestShelveInstance-1724066282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:43:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-c4bce23d-deb9-4f0f-9de0-b2d6f3e77da9 req-1a05f27a-bb1d-4aa8-8f24-9be50deb61ef tempest-TestShelveInstance-1724066282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:43:23 devstack sudo[98179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:43:23 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:43:24 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root Jul 08 01:43:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-c4bce23d-deb9-4f0f-9de0-b2d6f3e77da9 req-1a05f27a-bb1d-4aa8-8f24-9be50deb61ef tempest-TestShelveInstance-1724066282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.849s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:43:24 devstack cinder-volume[87284]: DEBUG cinder.manager [req-c4bce23d-deb9-4f0f-9de0-b2d6f3e77da9 req-1a05f27a-bb1d-4aa8-8f24-9be50deb61ef tempest-TestShelveInstance-1724066282 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:43:24 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-c4bce23d-deb9-4f0f-9de0-b2d6f3e77da9 req-1a05f27a-bb1d-4aa8-8f24-9be50deb61ef tempest-TestShelveInstance-1724066282 None] Deleted volume successfully. Jul 08 01:43:24 devstack cinder-volume[87284]: DEBUG cinder.coordination [req-c4bce23d-deb9-4f0f-9de0-b2d6f3e77da9 req-1a05f27a-bb1d-4aa8-8f24-9be50deb61ef tempest-TestShelveInstance-1724066282 None] Lock "cinder-1680554d-f816-42a4-819c-b52eadf31873-delete_volume" released by "delete_volume" :: held 3.785s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:43:26 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ac547991-aaed-4bfa-981f-82ff53bf1f20 tempest-AttachVolumeNegativeTest-1884741045 None] Acquiring lock "cinder-6382b228-eb09-4f05-a085-5b48edfac2f9-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:43:26 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ac547991-aaed-4bfa-981f-82ff53bf1f20 tempest-AttachVolumeNegativeTest-1884741045 None] Lock "cinder-6382b228-eb09-4f05-a085-5b48edfac2f9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:43:26 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ac547991-aaed-4bfa-981f-82ff53bf1f20 tempest-AttachVolumeNegativeTest-1884741045 None] Acquiring lock "cinder-quobyte-6382b228-eb09-4f05-a085-5b48edfac2f9" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:43:26 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ac547991-aaed-4bfa-981f-82ff53bf1f20 tempest-AttachVolumeNegativeTest-1884741045 None] Lock "cinder-quobyte-6382b228-eb09-4f05-a085-5b48edfac2f9" acquired by "delete_volume" :: waited 0.027s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:43:26 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21cb0dd-b4eb-4e14-874f-703e6e2bcad0]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:43:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ac547991-aaed-4bfa-981f-82ff53bf1f20 tempest-AttachVolumeNegativeTest-1884741045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6382b228-eb09-4f05-a085-5b48edfac2f9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:43:26 devstack sudo[98246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6382b228-eb09-4f05-a085-5b48edfac2f9 Jul 08 01:43:26 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:43:27 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root Jul 08 01:43:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ac547991-aaed-4bfa-981f-82ff53bf1f20 tempest-AttachVolumeNegativeTest-1884741045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6382b228-eb09-4f05-a085-5b48edfac2f9" returned: 0 in 0.925s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:43:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ac547991-aaed-4bfa-981f-82ff53bf1f20 tempest-AttachVolumeNegativeTest-1884741045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6382b228-eb09-4f05-a085-5b48edfac2f9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:43:27 devstack sudo[98251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6382b228-eb09-4f05-a085-5b48edfac2f9 Jul 08 01:43:27 devstack sudo[98251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:43:28 devstack sudo[98251]: pam_unix(sudo:session): session closed for user root Jul 08 01:43:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ac547991-aaed-4bfa-981f-82ff53bf1f20 tempest-AttachVolumeNegativeTest-1884741045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6382b228-eb09-4f05-a085-5b48edfac2f9" returned: 0 in 0.661s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:43:28 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ac547991-aaed-4bfa-981f-82ff53bf1f20 tempest-AttachVolumeNegativeTest-1884741045 None] Lock "cinder-quobyte-6382b228-eb09-4f05-a085-5b48edfac2f9" released by "delete_volume" :: held 1.643s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:43:28 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-ac547991-aaed-4bfa-981f-82ff53bf1f20 tempest-AttachVolumeNegativeTest-1884741045 None] Created reservations ['5d3c094a-431b-4519-b78f-fe167272897e', '0176b819-c299-4946-be4c-3c79a298cd83', 'd2874d4a-464d-4ccc-9a27-fd5ea22ebc06', '43f885d7-59bd-436b-9d15-cc09e0055543'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:43:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ac547991-aaed-4bfa-981f-82ff53bf1f20 tempest-AttachVolumeNegativeTest-1884741045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:43:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ac547991-aaed-4bfa-981f-82ff53bf1f20 tempest-AttachVolumeNegativeTest-1884741045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:43:28 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-ac547991-aaed-4bfa-981f-82ff53bf1f20 tempest-AttachVolumeNegativeTest-1884741045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:43:28 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-ac547991-aaed-4bfa-981f-82ff53bf1f20 tempest-AttachVolumeNegativeTest-1884741045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:43:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ac547991-aaed-4bfa-981f-82ff53bf1f20 tempest-AttachVolumeNegativeTest-1884741045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:43:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ac547991-aaed-4bfa-981f-82ff53bf1f20 tempest-AttachVolumeNegativeTest-1884741045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:43:28 devstack sudo[98255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:43:28 devstack sudo[98255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:43:28 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-816e9d0c-b37d-4b82-bc25-99672017f6a7 tempest-AttachVolumeNegativeTest-1884741045 None] Acquiring lock "cinder-d3e55320-da8b-4289-af08-cefabf6093e2-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:43:28 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-816e9d0c-b37d-4b82-bc25-99672017f6a7 tempest-AttachVolumeNegativeTest-1884741045 None] Lock "cinder-d3e55320-da8b-4289-af08-cefabf6093e2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:43:28 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-816e9d0c-b37d-4b82-bc25-99672017f6a7 tempest-AttachVolumeNegativeTest-1884741045 None] Acquiring lock "cinder-quobyte-d3e55320-da8b-4289-af08-cefabf6093e2" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:43:28 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-816e9d0c-b37d-4b82-bc25-99672017f6a7 tempest-AttachVolumeNegativeTest-1884741045 None] Lock "cinder-quobyte-d3e55320-da8b-4289-af08-cefabf6093e2" acquired by "delete_volume" :: waited 0.020s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:43:28 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9e3707-87d6-4760-80d3-916af697a7e6]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:43:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-816e9d0c-b37d-4b82-bc25-99672017f6a7 tempest-AttachVolumeNegativeTest-1884741045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d3e55320-da8b-4289-af08-cefabf6093e2 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:43:28 devstack sudo[98255]: pam_unix(sudo:session): session closed for user root Jul 08 01:43:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ac547991-aaed-4bfa-981f-82ff53bf1f20 tempest-AttachVolumeNegativeTest-1884741045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.756s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:43:28 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-ac547991-aaed-4bfa-981f-82ff53bf1f20 tempest-AttachVolumeNegativeTest-1884741045 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:43:28 devstack sudo[98258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d3e55320-da8b-4289-af08-cefabf6093e2 Jul 08 01:43:28 devstack sudo[98258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:43:28 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-ac547991-aaed-4bfa-981f-82ff53bf1f20 tempest-AttachVolumeNegativeTest-1884741045 None] Deleted volume successfully. Jul 08 01:43:28 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ac547991-aaed-4bfa-981f-82ff53bf1f20 tempest-AttachVolumeNegativeTest-1884741045 None] Lock "cinder-6382b228-eb09-4f05-a085-5b48edfac2f9-delete_volume" released by "delete_volume" :: held 2.650s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:43:29 devstack sudo[98258]: pam_unix(sudo:session): session closed for user root Jul 08 01:43:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-816e9d0c-b37d-4b82-bc25-99672017f6a7 tempest-AttachVolumeNegativeTest-1884741045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d3e55320-da8b-4289-af08-cefabf6093e2" returned: 0 in 0.816s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:43:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-816e9d0c-b37d-4b82-bc25-99672017f6a7 tempest-AttachVolumeNegativeTest-1884741045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d3e55320-da8b-4289-af08-cefabf6093e2 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:43:29 devstack sudo[98265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d3e55320-da8b-4289-af08-cefabf6093e2 Jul 08 01:43:29 devstack sudo[98265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:43:30 devstack sudo[98265]: pam_unix(sudo:session): session closed for user root Jul 08 01:43:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-816e9d0c-b37d-4b82-bc25-99672017f6a7 tempest-AttachVolumeNegativeTest-1884741045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d3e55320-da8b-4289-af08-cefabf6093e2" returned: 0 in 0.656s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:43:30 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-816e9d0c-b37d-4b82-bc25-99672017f6a7 tempest-AttachVolumeNegativeTest-1884741045 None] Lock "cinder-quobyte-d3e55320-da8b-4289-af08-cefabf6093e2" released by "delete_volume" :: held 1.519s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:43:30 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-816e9d0c-b37d-4b82-bc25-99672017f6a7 tempest-AttachVolumeNegativeTest-1884741045 None] Created reservations ['58530294-0d11-4e79-8a5b-18a5e03694bc', 'd68e14a4-8423-4a9b-aff6-975eb503c160', '97d1aab7-862a-4d3c-be52-0949c3149b14', 'eae9e5b7-1230-424f-b4dd-fc29ea572f78'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:43:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-816e9d0c-b37d-4b82-bc25-99672017f6a7 tempest-AttachVolumeNegativeTest-1884741045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:43:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-816e9d0c-b37d-4b82-bc25-99672017f6a7 tempest-AttachVolumeNegativeTest-1884741045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:43:30 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-816e9d0c-b37d-4b82-bc25-99672017f6a7 tempest-AttachVolumeNegativeTest-1884741045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:43:30 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-816e9d0c-b37d-4b82-bc25-99672017f6a7 tempest-AttachVolumeNegativeTest-1884741045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:43:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-816e9d0c-b37d-4b82-bc25-99672017f6a7 tempest-AttachVolumeNegativeTest-1884741045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:43:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-816e9d0c-b37d-4b82-bc25-99672017f6a7 tempest-AttachVolumeNegativeTest-1884741045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:43:30 devstack sudo[98268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:43:30 devstack sudo[98268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:43:31 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1819ae76-d518-4acc-9628-8004f0f1a91b tempest-AttachVolumeNegativeTest-1884741045 None] Acquiring lock "cinder-0cf1dc8e-a1a6-4fd1-a222-1d0e82849437-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:43:31 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1819ae76-d518-4acc-9628-8004f0f1a91b tempest-AttachVolumeNegativeTest-1884741045 None] Lock "cinder-0cf1dc8e-a1a6-4fd1-a222-1d0e82849437-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:43:31 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:UPDATE=37,cinder:SELECT=42,cinder:DELETE=4,cinder:INSERT=14 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:43:31 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=43,cinder:UPDATE=46,cinder:INSERT=11,cinder:DELETE=2 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:43:31 devstack sudo[98268]: pam_unix(sudo:session): session closed for user root Jul 08 01:43:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-816e9d0c-b37d-4b82-bc25-99672017f6a7 tempest-AttachVolumeNegativeTest-1884741045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.850s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:43:31 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-816e9d0c-b37d-4b82-bc25-99672017f6a7 tempest-AttachVolumeNegativeTest-1884741045 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:43:31 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-816e9d0c-b37d-4b82-bc25-99672017f6a7 tempest-AttachVolumeNegativeTest-1884741045 None] Deleted volume successfully. Jul 08 01:43:31 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1819ae76-d518-4acc-9628-8004f0f1a91b tempest-AttachVolumeNegativeTest-1884741045 None] Acquiring lock "cinder-quobyte-0cf1dc8e-a1a6-4fd1-a222-1d0e82849437" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:43:31 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1819ae76-d518-4acc-9628-8004f0f1a91b tempest-AttachVolumeNegativeTest-1884741045 None] Lock "cinder-quobyte-0cf1dc8e-a1a6-4fd1-a222-1d0e82849437" acquired by "delete_volume" :: waited 0.026s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:43:31 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-816e9d0c-b37d-4b82-bc25-99672017f6a7 tempest-AttachVolumeNegativeTest-1884741045 None] Lock "cinder-d3e55320-da8b-4289-af08-cefabf6093e2-delete_volume" released by "delete_volume" :: held 2.645s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:43:31 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e60765-f1d4-4e20-9a16-8101ffaed484]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:43:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1819ae76-d518-4acc-9628-8004f0f1a91b tempest-AttachVolumeNegativeTest-1884741045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0cf1dc8e-a1a6-4fd1-a222-1d0e82849437 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:43:31 devstack sudo[98271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0cf1dc8e-a1a6-4fd1-a222-1d0e82849437 Jul 08 01:43:31 devstack sudo[98271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:43:32 devstack sudo[98271]: pam_unix(sudo:session): session closed for user root Jul 08 01:43:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1819ae76-d518-4acc-9628-8004f0f1a91b tempest-AttachVolumeNegativeTest-1884741045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0cf1dc8e-a1a6-4fd1-a222-1d0e82849437" returned: 0 in 0.897s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:43:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1819ae76-d518-4acc-9628-8004f0f1a91b tempest-AttachVolumeNegativeTest-1884741045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0cf1dc8e-a1a6-4fd1-a222-1d0e82849437 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:43:32 devstack sudo[98313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0cf1dc8e-a1a6-4fd1-a222-1d0e82849437 Jul 08 01:43:32 devstack sudo[98313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:43:33 devstack sudo[98313]: pam_unix(sudo:session): session closed for user root Jul 08 01:43:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1819ae76-d518-4acc-9628-8004f0f1a91b tempest-AttachVolumeNegativeTest-1884741045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0cf1dc8e-a1a6-4fd1-a222-1d0e82849437" returned: 0 in 0.753s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:43:33 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1819ae76-d518-4acc-9628-8004f0f1a91b tempest-AttachVolumeNegativeTest-1884741045 None] Lock "cinder-quobyte-0cf1dc8e-a1a6-4fd1-a222-1d0e82849437" released by "delete_volume" :: held 1.717s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:43:33 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-1819ae76-d518-4acc-9628-8004f0f1a91b tempest-AttachVolumeNegativeTest-1884741045 None] Created reservations ['6048bf19-1465-41ed-b11e-b732379f27ef', 'd61530f6-ea16-4385-a00d-59868c56f7d2', 'afcdf0c7-f443-408b-bf54-aa33e582f1b6', '4cfb0206-5389-4035-b28f-6747a8fd56b4'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:43:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-1819ae76-d518-4acc-9628-8004f0f1a91b tempest-AttachVolumeNegativeTest-1884741045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:43:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-1819ae76-d518-4acc-9628-8004f0f1a91b tempest-AttachVolumeNegativeTest-1884741045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:43:33 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-1819ae76-d518-4acc-9628-8004f0f1a91b tempest-AttachVolumeNegativeTest-1884741045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:43:33 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-1819ae76-d518-4acc-9628-8004f0f1a91b tempest-AttachVolumeNegativeTest-1884741045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:43:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-1819ae76-d518-4acc-9628-8004f0f1a91b tempest-AttachVolumeNegativeTest-1884741045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:43:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1819ae76-d518-4acc-9628-8004f0f1a91b tempest-AttachVolumeNegativeTest-1884741045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:43:33 devstack sudo[98316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:43:33 devstack sudo[98316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:43:33 devstack sudo[98316]: pam_unix(sudo:session): session closed for user root Jul 08 01:43:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1819ae76-d518-4acc-9628-8004f0f1a91b tempest-AttachVolumeNegativeTest-1884741045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.714s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:43:33 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-1819ae76-d518-4acc-9628-8004f0f1a91b tempest-AttachVolumeNegativeTest-1884741045 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:43:33 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-1819ae76-d518-4acc-9628-8004f0f1a91b tempest-AttachVolumeNegativeTest-1884741045 None] Deleted volume successfully. Jul 08 01:43:33 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1819ae76-d518-4acc-9628-8004f0f1a91b tempest-AttachVolumeNegativeTest-1884741045 None] Lock "cinder-0cf1dc8e-a1a6-4fd1-a222-1d0e82849437-delete_volume" released by "delete_volume" :: held 2.723s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:43:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-63c8df21-56ba-45b2-a42f-b09e95534e60 req-596c44fd-344a-414d-8190-caf6638515e9 tempest-TestInstancesWithCinderVolumes-1193651253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:43:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-63c8df21-56ba-45b2-a42f-b09e95534e60 req-596c44fd-344a-414d-8190-caf6638515e9 tempest-TestInstancesWithCinderVolumes-1193651253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:43:38 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1e420b-ceb1-431e-85cf-f8abd12a2587]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:43:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-63c8df21-56ba-45b2-a42f-b09e95534e60 req-596c44fd-344a-414d-8190-caf6638515e9 tempest-TestInstancesWithCinderVolumes-1193651253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-07fc2280-ce7e-495e-bb9a-403b9873f0f1 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:43:39 devstack sudo[98337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-07fc2280-ce7e-495e-bb9a-403b9873f0f1 Jul 08 01:43:39 devstack sudo[98337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:43:39 devstack sudo[98337]: pam_unix(sudo:session): session closed for user root Jul 08 01:43:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-63c8df21-56ba-45b2-a42f-b09e95534e60 req-596c44fd-344a-414d-8190-caf6638515e9 tempest-TestInstancesWithCinderVolumes-1193651253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-07fc2280-ce7e-495e-bb9a-403b9873f0f1" returned: 0 in 0.903s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:43:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-63c8df21-56ba-45b2-a42f-b09e95534e60 req-596c44fd-344a-414d-8190-caf6638515e9 tempest-TestInstancesWithCinderVolumes-1193651253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.925s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:43:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-63c8df21-56ba-45b2-a42f-b09e95534e60 req-596c44fd-344a-414d-8190-caf6638515e9 tempest-TestInstancesWithCinderVolumes-1193651253 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96', 'name': 'volume-07fc2280-ce7e-495e-bb9a-403b9873f0f1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4997223d-1e0e-48f5-9a32-c9f654079944', 'enforce_multipath': True} {{(pid=87284) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:43:40 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-63c8df21-56ba-45b2-a42f-b09e95534e60 req-596c44fd-344a-414d-8190-caf6638515e9 tempest-TestInstancesWithCinderVolumes-1193651253 None] attachment_update completed successfully. Jul 08 01:43:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-b95178d2-c65e-4d12-ae4b-783fab0f1fac req-e9842176-6e9f-4efd-b430-adb8c4e8ca51 tempest-TestInstancesWithCinderVolumes-1193651253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:43:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-b95178d2-c65e-4d12-ae4b-783fab0f1fac req-e9842176-6e9f-4efd-b430-adb8c4e8ca51 tempest-TestInstancesWithCinderVolumes-1193651253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:43:48 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a71443-acb9-451a-974c-3adc6d83427c]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:43:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-b95178d2-c65e-4d12-ae4b-783fab0f1fac req-e9842176-6e9f-4efd-b430-adb8c4e8ca51 tempest-TestInstancesWithCinderVolumes-1193651253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9bb1941e-180e-4e09-8436-33a9ec823837 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:43:48 devstack sudo[98364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9bb1941e-180e-4e09-8436-33a9ec823837 Jul 08 01:43:48 devstack sudo[98364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:43:49 devstack sudo[98364]: pam_unix(sudo:session): session closed for user root Jul 08 01:43:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-b95178d2-c65e-4d12-ae4b-783fab0f1fac req-e9842176-6e9f-4efd-b430-adb8c4e8ca51 tempest-TestInstancesWithCinderVolumes-1193651253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9bb1941e-180e-4e09-8436-33a9ec823837" returned: 0 in 0.939s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:43:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-b95178d2-c65e-4d12-ae4b-783fab0f1fac req-e9842176-6e9f-4efd-b430-adb8c4e8ca51 tempest-TestInstancesWithCinderVolumes-1193651253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.975s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:43:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-b95178d2-c65e-4d12-ae4b-783fab0f1fac req-e9842176-6e9f-4efd-b430-adb8c4e8ca51 tempest-TestInstancesWithCinderVolumes-1193651253 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96', 'name': 'volume-9bb1941e-180e-4e09-8436-33a9ec823837', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e3d97860-9ae6-46e9-a42e-470c630d7964', 'enforce_multipath': True} {{(pid=87284) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:43:49 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-b95178d2-c65e-4d12-ae4b-783fab0f1fac req-e9842176-6e9f-4efd-b430-adb8c4e8ca51 tempest-TestInstancesWithCinderVolumes-1193651253 None] attachment_update completed successfully. Jul 08 01:43:53 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-916ef3e1-747d-4549-a3a7-1abc2c3820a7 tempest-GroupsV320Test-353388458 None] Group tempest-GroupsV320Test-Group-165194285: creating Jul 08 01:43:53 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-916ef3e1-747d-4549-a3a7-1abc2c3820a7 tempest-GroupsV320Test-353388458 None] Group tempest-GroupsV320Test-Group-165194285: created successfully Jul 08 01:43:53 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-916ef3e1-747d-4549-a3a7-1abc2c3820a7 tempest-GroupsV320Test-353388458 None] Create group completed successfully. Jul 08 01:43:55 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-2ccb1087-4c1c-4f0f-aad6-c022bfe83292 tempest-GroupsV320Test-353388458 None] Created reservations ['15c6e046-bcca-401f-bd98-59391402e57d'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:43:55 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:43:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:43:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:43:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:43:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:43:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:43:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:43:55 devstack sudo[98380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:43:55 devstack sudo[98380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:43:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2ccb1087-4c1c-4f0f-aad6-c022bfe83292 tempest-GroupsV320Test-353388458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:43:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2ccb1087-4c1c-4f0f-aad6-c022bfe83292 tempest-GroupsV320Test-353388458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:43:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2ccb1087-4c1c-4f0f-aad6-c022bfe83292 tempest-GroupsV320Test-353388458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:43:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2ccb1087-4c1c-4f0f-aad6-c022bfe83292 tempest-GroupsV320Test-353388458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:43:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2ccb1087-4c1c-4f0f-aad6-c022bfe83292 tempest-GroupsV320Test-353388458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:43:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2ccb1087-4c1c-4f0f-aad6-c022bfe83292 tempest-GroupsV320Test-353388458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:43:55 devstack sudo[98382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:43:55 devstack sudo[98382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:43:56 devstack sudo[98380]: pam_unix(sudo:session): session closed for user root Jul 08 01:43:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.050s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:43:56 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:43:56 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager._thread_info {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:43:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread count: 29 {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:43:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread info: [<_MainThread(MainThread, started 127058402500736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:43:56 devstack sudo[98382]: pam_unix(sudo:session): session closed for user root Jul 08 01:43:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2ccb1087-4c1c-4f0f-aad6-c022bfe83292 tempest-GroupsV320Test-353388458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.202s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:43:56 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-2ccb1087-4c1c-4f0f-aad6-c022bfe83292 tempest-GroupsV320Test-353388458 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:43:56 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-2ccb1087-4c1c-4f0f-aad6-c022bfe83292 tempest-GroupsV320Test-353388458 None] Delete group completed successfully. Jul 08 01:44:00 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-21b132d3-230e-495c-af76-a8c3ee65a508 req-ad4de25f-8971-4eff-80fc-8166c3fc8a3b tempest-TestInstancesWithCinderVolumes-1193651253 None] Terminate volume connection completed successfully. Jul 08 01:44:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-21b132d3-230e-495c-af76-a8c3ee65a508 req-ad4de25f-8971-4eff-80fc-8166c3fc8a3b tempest-TestInstancesWithCinderVolumes-1193651253 None] Deleting attachment 4997223d-1e0e-48f5-9a32-c9f654079944. {{(pid=87284) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:44:02 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-853ea0a9-3158-418b-95e9-217ceb4139c9 tempest-TestInstancesWithCinderVolumes-1193651253 None] Acquiring lock "cinder-07fc2280-ce7e-495e-bb9a-403b9873f0f1-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:44:02 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-853ea0a9-3158-418b-95e9-217ceb4139c9 tempest-TestInstancesWithCinderVolumes-1193651253 None] Lock "cinder-07fc2280-ce7e-495e-bb9a-403b9873f0f1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:44:02 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-853ea0a9-3158-418b-95e9-217ceb4139c9 tempest-TestInstancesWithCinderVolumes-1193651253 None] Acquiring lock "cinder-quobyte-07fc2280-ce7e-495e-bb9a-403b9873f0f1" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:44:02 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-853ea0a9-3158-418b-95e9-217ceb4139c9 tempest-TestInstancesWithCinderVolumes-1193651253 None] Lock "cinder-quobyte-07fc2280-ce7e-495e-bb9a-403b9873f0f1" acquired by "delete_volume" :: waited 0.023s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:44:03 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c4a6dd-4e12-4bbb-8825-e05219457dd1]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:44:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-853ea0a9-3158-418b-95e9-217ceb4139c9 tempest-TestInstancesWithCinderVolumes-1193651253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-07fc2280-ce7e-495e-bb9a-403b9873f0f1 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:03 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-acbae2c7-d5e3-42ee-91cb-fa23f583e602 tempest-TestStampPattern-1873432706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:44:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-acbae2c7-d5e3-42ee-91cb-fa23f583e602 tempest-TestStampPattern-1873432706 None] Flow 'volume_create_manager' (3e56b4b5-1bee-42dc-a6ba-aa1147dfc297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:44:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-acbae2c7-d5e3-42ee-91cb-fa23f583e602 tempest-TestStampPattern-1873432706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d97c7651-0f8f-4bb3-82d3-e14fef3a98c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:03 devstack sudo[98418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-07fc2280-ce7e-495e-bb9a-403b9873f0f1 Jul 08 01:44:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-acbae2c7-d5e3-42ee-91cb-fa23f583e602 tempest-TestStampPattern-1873432706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d97c7651-0f8f-4bb3-82d3-e14fef3a98c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:44:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1221068240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d254098a-3644-4edf-a91a-f89e94d9c147,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2e595c568944df5af1513902fcc0aa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:44:03Z,use_quota=True,user_id='15d69951b7314a85a2a64d85b3dcfa5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:03 devstack sudo[98418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-acbae2c7-d5e3-42ee-91cb-fa23f583e602 tempest-TestStampPattern-1873432706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccb9ef92-e44f-4812-809e-7f155f5dad28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-acbae2c7-d5e3-42ee-91cb-fa23f583e602 tempest-TestStampPattern-1873432706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccb9ef92-e44f-4812-809e-7f155f5dad28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-acbae2c7-d5e3-42ee-91cb-fa23f583e602 tempest-TestStampPattern-1873432706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (156e9a31-245a-424b-b67b-28ffc7a32ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-acbae2c7-d5e3-42ee-91cb-fa23f583e602 tempest-TestStampPattern-1873432706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (156e9a31-245a-424b-b67b-28ffc7a32ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd254098a-3644-4edf-a91a-f89e94d9c147', 'volume_name': 'volume-d254098a-3644-4edf-a91a-f89e94d9c147', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-acbae2c7-d5e3-42ee-91cb-fa23f583e602 tempest-TestStampPattern-1873432706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77642e77-b734-41c0-ac06-34cbd1023910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-acbae2c7-d5e3-42ee-91cb-fa23f583e602 tempest-TestStampPattern-1873432706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77642e77-b734-41c0-ac06-34cbd1023910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-acbae2c7-d5e3-42ee-91cb-fa23f583e602 tempest-TestStampPattern-1873432706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbbef17b-fed3-486e-beb0-3f17606d30f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:03 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-acbae2c7-d5e3-42ee-91cb-fa23f583e602 tempest-TestStampPattern-1873432706 None] Volume d254098a-3644-4edf-a91a-f89e94d9c147: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d254098a-3644-4edf-a91a-f89e94d9c147', 'volume_size': 1} Jul 08 01:44:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-acbae2c7-d5e3-42ee-91cb-fa23f583e602 tempest-TestStampPattern-1873432706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-acbae2c7-d5e3-42ee-91cb-fa23f583e602 tempest-TestStampPattern-1873432706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:03 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-acbae2c7-d5e3-42ee-91cb-fa23f583e602 tempest-TestStampPattern-1873432706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:44:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1221068240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d254098a-3644-4edf-a91a-f89e94d9c147,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2e595c568944df5af1513902fcc0aa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:44:03Z,use_quota=True,user_id='15d69951b7314a85a2a64d85b3dcfa5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:44:03 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-acbae2c7-d5e3-42ee-91cb-fa23f583e602 tempest-TestStampPattern-1873432706 None] Creating volume d254098a-3644-4edf-a91a-f89e94d9c147 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:44:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-acbae2c7-d5e3-42ee-91cb-fa23f583e602 tempest-TestStampPattern-1873432706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-acbae2c7-d5e3-42ee-91cb-fa23f583e602 tempest-TestStampPattern-1873432706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:03 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-acbae2c7-d5e3-42ee-91cb-fa23f583e602 tempest-TestStampPattern-1873432706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:44:03 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-acbae2c7-d5e3-42ee-91cb-fa23f583e602 tempest-TestStampPattern-1873432706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:44:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-acbae2c7-d5e3-42ee-91cb-fa23f583e602 tempest-TestStampPattern-1873432706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:03 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-acbae2c7-d5e3-42ee-91cb-fa23f583e602 tempest-TestStampPattern-1873432706 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:44:03 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-acbae2c7-d5e3-42ee-91cb-fa23f583e602 tempest-TestStampPattern-1873432706 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:44:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-acbae2c7-d5e3-42ee-91cb-fa23f583e602 tempest-TestStampPattern-1873432706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:03 devstack sudo[98420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147 1073741824 Jul 08 01:44:03 devstack sudo[98420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:04 devstack sudo[98418]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-853ea0a9-3158-418b-95e9-217ceb4139c9 tempest-TestInstancesWithCinderVolumes-1193651253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-07fc2280-ce7e-495e-bb9a-403b9873f0f1" returned: 0 in 1.111s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-853ea0a9-3158-418b-95e9-217ceb4139c9 tempest-TestInstancesWithCinderVolumes-1193651253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-07fc2280-ce7e-495e-bb9a-403b9873f0f1 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:04 devstack sudo[98425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-07fc2280-ce7e-495e-bb9a-403b9873f0f1 Jul 08 01:44:04 devstack sudo[98425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:04 devstack sudo[98420]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-acbae2c7-d5e3-42ee-91cb-fa23f583e602 tempest-TestStampPattern-1873432706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147 1073741824" returned: 0 in 1.497s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-acbae2c7-d5e3-42ee-91cb-fa23f583e602 tempest-TestStampPattern-1873432706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:04 devstack sudo[98436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147 Jul 08 01:44:04 devstack sudo[98436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:05 devstack sudo[98425]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-853ea0a9-3158-418b-95e9-217ceb4139c9 tempest-TestInstancesWithCinderVolumes-1193651253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-07fc2280-ce7e-495e-bb9a-403b9873f0f1" returned: 0 in 1.174s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:05 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-853ea0a9-3158-418b-95e9-217ceb4139c9 tempest-TestInstancesWithCinderVolumes-1193651253 None] Lock "cinder-quobyte-07fc2280-ce7e-495e-bb9a-403b9873f0f1" released by "delete_volume" :: held 2.354s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:44:05 devstack cinder-volume[87284]: WARNING cinder.quota [None req-853ea0a9-3158-418b-95e9-217ceb4139c9 tempest-TestInstancesWithCinderVolumes-1193651253 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1757477808-126608598 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1757477808-126608598, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:44:05 devstack cinder-volume[87284]: WARNING cinder.quota [None req-853ea0a9-3158-418b-95e9-217ceb4139c9 tempest-TestInstancesWithCinderVolumes-1193651253 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1757477808-126608598 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1757477808-126608598, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:44:05 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-853ea0a9-3158-418b-95e9-217ceb4139c9 tempest-TestInstancesWithCinderVolumes-1193651253 None] Created reservations ['6536387e-46a8-4fe8-9dea-485ae7571ec3', '719e1830-b102-4681-b3df-4f79e19e185f', '28ca38a1-6e33-441d-8f82-9ac6afaa7c23', '1ed9ea49-8624-499e-abcc-9d1418d6e48b'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:44:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-853ea0a9-3158-418b-95e9-217ceb4139c9 tempest-TestInstancesWithCinderVolumes-1193651253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-853ea0a9-3158-418b-95e9-217ceb4139c9 tempest-TestInstancesWithCinderVolumes-1193651253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:05 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-853ea0a9-3158-418b-95e9-217ceb4139c9 tempest-TestInstancesWithCinderVolumes-1193651253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:44:05 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-853ea0a9-3158-418b-95e9-217ceb4139c9 tempest-TestInstancesWithCinderVolumes-1193651253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:44:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-853ea0a9-3158-418b-95e9-217ceb4139c9 tempest-TestInstancesWithCinderVolumes-1193651253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-853ea0a9-3158-418b-95e9-217ceb4139c9 tempest-TestInstancesWithCinderVolumes-1193651253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:05 devstack sudo[98440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:44:05 devstack sudo[98440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:05 devstack sudo[98436]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-acbae2c7-d5e3-42ee-91cb-fa23f583e602 tempest-TestStampPattern-1873432706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147" returned: 0 in 0.892s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:05 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-acbae2c7-d5e3-42ee-91cb-fa23f583e602 tempest-TestStampPattern-1873432706 None] <== create_volume: return (2457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:44:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-acbae2c7-d5e3-42ee-91cb-fa23f583e602 tempest-TestStampPattern-1873432706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.465s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:05 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-acbae2c7-d5e3-42ee-91cb-fa23f583e602 tempest-TestStampPattern-1873432706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbbef17b-fed3-486e-beb0-3f17606d30f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d254098a-3644-4edf-a91a-f89e94d9c147', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:05 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-acbae2c7-d5e3-42ee-91cb-fa23f583e602 tempest-TestStampPattern-1873432706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (774e0378-b2d3-441b-adb6-36b8d58d0225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:05 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-acbae2c7-d5e3-42ee-91cb-fa23f583e602 tempest-TestStampPattern-1873432706 None] Volume volume-d254098a-3644-4edf-a91a-f89e94d9c147 (d254098a-3644-4edf-a91a-f89e94d9c147): created successfully Jul 08 01:44:05 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-acbae2c7-d5e3-42ee-91cb-fa23f583e602 tempest-TestStampPattern-1873432706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (774e0378-b2d3-441b-adb6-36b8d58d0225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:05 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-acbae2c7-d5e3-42ee-91cb-fa23f583e602 tempest-TestStampPattern-1873432706 None] Flow 'volume_create_manager' (3e56b4b5-1bee-42dc-a6ba-aa1147dfc297) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:44:05 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-acbae2c7-d5e3-42ee-91cb-fa23f583e602 tempest-TestStampPattern-1873432706 None] Created volume successfully. Jul 08 01:44:06 devstack sudo[98440]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-853ea0a9-3158-418b-95e9-217ceb4139c9 tempest-TestInstancesWithCinderVolumes-1193651253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.997s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:06 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-853ea0a9-3158-418b-95e9-217ceb4139c9 tempest-TestInstancesWithCinderVolumes-1193651253 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:44:06 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-853ea0a9-3158-418b-95e9-217ceb4139c9 tempest-TestInstancesWithCinderVolumes-1193651253 None] Deleted volume successfully. Jul 08 01:44:06 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-853ea0a9-3158-418b-95e9-217ceb4139c9 tempest-TestInstancesWithCinderVolumes-1193651253 None] Lock "cinder-07fc2280-ce7e-495e-bb9a-403b9873f0f1-delete_volume" released by "delete_volume" :: held 3.699s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:44:08 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-de79378f-e232-42bf-8d4b-dc9b01961614 req-aee03edc-fa9f-45a1-8dc8-75ed2c5b5b6c tempest-TestInstancesWithCinderVolumes-1193651253 None] Terminate volume connection completed successfully. Jul 08 01:44:08 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-de79378f-e232-42bf-8d4b-dc9b01961614 req-aee03edc-fa9f-45a1-8dc8-75ed2c5b5b6c tempest-TestInstancesWithCinderVolumes-1193651253 None] Deleting attachment e3d97860-9ae6-46e9-a42e-470c630d7964. {{(pid=87284) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:44:10 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-cae05596-0177-4145-b5d3-d5aa1cbc5982 tempest-TestInstancesWithCinderVolumes-1193651253 None] Acquiring lock "cinder-9bb1941e-180e-4e09-8436-33a9ec823837-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:44:10 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-cae05596-0177-4145-b5d3-d5aa1cbc5982 tempest-TestInstancesWithCinderVolumes-1193651253 None] Lock "cinder-9bb1941e-180e-4e09-8436-33a9ec823837-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:44:11 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-cae05596-0177-4145-b5d3-d5aa1cbc5982 tempest-TestInstancesWithCinderVolumes-1193651253 None] Acquiring lock "cinder-quobyte-9bb1941e-180e-4e09-8436-33a9ec823837" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:44:11 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-cae05596-0177-4145-b5d3-d5aa1cbc5982 tempest-TestInstancesWithCinderVolumes-1193651253 None] Lock "cinder-quobyte-9bb1941e-180e-4e09-8436-33a9ec823837" acquired by "delete_volume" :: waited 0.056s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:44:11 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0157d05-d6bc-4f13-9b8c-a4faf2956746]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:44:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cae05596-0177-4145-b5d3-d5aa1cbc5982 tempest-TestInstancesWithCinderVolumes-1193651253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9bb1941e-180e-4e09-8436-33a9ec823837 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:11 devstack sudo[98467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9bb1941e-180e-4e09-8436-33a9ec823837 Jul 08 01:44:11 devstack sudo[98467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:12 devstack sudo[98467]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cae05596-0177-4145-b5d3-d5aa1cbc5982 tempest-TestInstancesWithCinderVolumes-1193651253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9bb1941e-180e-4e09-8436-33a9ec823837" returned: 0 in 1.217s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cae05596-0177-4145-b5d3-d5aa1cbc5982 tempest-TestInstancesWithCinderVolumes-1193651253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9bb1941e-180e-4e09-8436-33a9ec823837 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:12 devstack sudo[98476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9bb1941e-180e-4e09-8436-33a9ec823837 Jul 08 01:44:12 devstack sudo[98476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:13 devstack sudo[98476]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cae05596-0177-4145-b5d3-d5aa1cbc5982 tempest-TestInstancesWithCinderVolumes-1193651253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9bb1941e-180e-4e09-8436-33a9ec823837" returned: 0 in 1.136s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:13 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-cae05596-0177-4145-b5d3-d5aa1cbc5982 tempest-TestInstancesWithCinderVolumes-1193651253 None] Lock "cinder-quobyte-9bb1941e-180e-4e09-8436-33a9ec823837" released by "delete_volume" :: held 2.440s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:44:13 devstack cinder-volume[87284]: WARNING cinder.quota [None req-cae05596-0177-4145-b5d3-d5aa1cbc5982 tempest-TestInstancesWithCinderVolumes-1193651253 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-585365392-792051324 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-585365392-792051324, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:44:13 devstack cinder-volume[87284]: WARNING cinder.quota [None req-cae05596-0177-4145-b5d3-d5aa1cbc5982 tempest-TestInstancesWithCinderVolumes-1193651253 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-585365392-792051324 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-585365392-792051324, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:44:13 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-cae05596-0177-4145-b5d3-d5aa1cbc5982 tempest-TestInstancesWithCinderVolumes-1193651253 None] Created reservations ['ff641ac0-618e-4cfd-930c-a902687842e0', 'a0c915f3-9669-4ef6-84bf-66b8ef2360b1', '8a5761ed-8c0a-4fe3-a53f-0a28b6c6542f', 'd963abde-fb97-40b9-8bfa-8f3159b362b4'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:44:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-cae05596-0177-4145-b5d3-d5aa1cbc5982 tempest-TestInstancesWithCinderVolumes-1193651253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-cae05596-0177-4145-b5d3-d5aa1cbc5982 tempest-TestInstancesWithCinderVolumes-1193651253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:13 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-cae05596-0177-4145-b5d3-d5aa1cbc5982 tempest-TestInstancesWithCinderVolumes-1193651253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:44:13 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-cae05596-0177-4145-b5d3-d5aa1cbc5982 tempest-TestInstancesWithCinderVolumes-1193651253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:44:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-cae05596-0177-4145-b5d3-d5aa1cbc5982 tempest-TestInstancesWithCinderVolumes-1193651253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cae05596-0177-4145-b5d3-d5aa1cbc5982 tempest-TestInstancesWithCinderVolumes-1193651253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:13 devstack sudo[98492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:44:13 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:14 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cae05596-0177-4145-b5d3-d5aa1cbc5982 tempest-TestInstancesWithCinderVolumes-1193651253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.907s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:14 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-cae05596-0177-4145-b5d3-d5aa1cbc5982 tempest-TestInstancesWithCinderVolumes-1193651253 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:44:14 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-cae05596-0177-4145-b5d3-d5aa1cbc5982 tempest-TestInstancesWithCinderVolumes-1193651253 None] Deleted volume successfully. Jul 08 01:44:14 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-cae05596-0177-4145-b5d3-d5aa1cbc5982 tempest-TestInstancesWithCinderVolumes-1193651253 None] Lock "cinder-9bb1941e-180e-4e09-8436-33a9ec823837-delete_volume" released by "delete_volume" :: held 3.843s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:44:21 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-6be5554d-a1f0-4cdd-b9b5-9b2a17df5b02 req-b8d5cf4b-7efc-439b-814e-7db1466c19d3 tempest-TestInstancesWithCinderVolumes-1193651253 None] Terminate volume connection completed successfully. Jul 08 01:44:21 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-6be5554d-a1f0-4cdd-b9b5-9b2a17df5b02 req-b8d5cf4b-7efc-439b-814e-7db1466c19d3 tempest-TestInstancesWithCinderVolumes-1193651253 None] Deleting attachment e2d8c3ab-7317-4764-af55-f0389aa1b97e. {{(pid=87284) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:44:25 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f8585ca3-dc69-4b59-b44e-d3217b1e23a1 tempest-TestInstancesWithCinderVolumes-1193651253 None] Acquiring lock "cinder-2051111b-fd44-4106-b2e2-fa54c1b54825-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:44:25 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f8585ca3-dc69-4b59-b44e-d3217b1e23a1 tempest-TestInstancesWithCinderVolumes-1193651253 None] Lock "cinder-2051111b-fd44-4106-b2e2-fa54c1b54825-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:44:25 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f8585ca3-dc69-4b59-b44e-d3217b1e23a1 tempest-TestInstancesWithCinderVolumes-1193651253 None] Acquiring lock "cinder-quobyte-2051111b-fd44-4106-b2e2-fa54c1b54825" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:44:25 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f8585ca3-dc69-4b59-b44e-d3217b1e23a1 tempest-TestInstancesWithCinderVolumes-1193651253 None] Lock "cinder-quobyte-2051111b-fd44-4106-b2e2-fa54c1b54825" acquired by "delete_volume" :: waited 0.026s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:44:25 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[057ee528-da83-426c-a28d-691f16d21048]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:44:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f8585ca3-dc69-4b59-b44e-d3217b1e23a1 tempest-TestInstancesWithCinderVolumes-1193651253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2051111b-fd44-4106-b2e2-fa54c1b54825 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:25 devstack sudo[98590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2051111b-fd44-4106-b2e2-fa54c1b54825 Jul 08 01:44:25 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:26 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f8585ca3-dc69-4b59-b44e-d3217b1e23a1 tempest-TestInstancesWithCinderVolumes-1193651253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2051111b-fd44-4106-b2e2-fa54c1b54825" returned: 0 in 1.069s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f8585ca3-dc69-4b59-b44e-d3217b1e23a1 tempest-TestInstancesWithCinderVolumes-1193651253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2051111b-fd44-4106-b2e2-fa54c1b54825 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:26 devstack sudo[98600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2051111b-fd44-4106-b2e2-fa54c1b54825 Jul 08 01:44:26 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:27 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f8585ca3-dc69-4b59-b44e-d3217b1e23a1 tempest-TestInstancesWithCinderVolumes-1193651253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2051111b-fd44-4106-b2e2-fa54c1b54825" returned: 1 in 1.236s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f8585ca3-dc69-4b59-b44e-d3217b1e23a1 tempest-TestInstancesWithCinderVolumes-1193651253 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2051111b-fd44-4106-b2e2-fa54c1b54825' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:44:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f8585ca3-dc69-4b59-b44e-d3217b1e23a1 tempest-TestInstancesWithCinderVolumes-1193651253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2051111b-fd44-4106-b2e2-fa54c1b54825 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:28 devstack sudo[98607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2051111b-fd44-4106-b2e2-fa54c1b54825 Jul 08 01:44:28 devstack sudo[98607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:28 devstack sudo[98607]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f8585ca3-dc69-4b59-b44e-d3217b1e23a1 tempest-TestInstancesWithCinderVolumes-1193651253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2051111b-fd44-4106-b2e2-fa54c1b54825" returned: 0 in 0.972s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:28 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f8585ca3-dc69-4b59-b44e-d3217b1e23a1 tempest-TestInstancesWithCinderVolumes-1193651253 None] Lock "cinder-quobyte-2051111b-fd44-4106-b2e2-fa54c1b54825" released by "delete_volume" :: held 3.391s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:44:29 devstack cinder-volume[87284]: WARNING cinder.quota [None req-f8585ca3-dc69-4b59-b44e-d3217b1e23a1 tempest-TestInstancesWithCinderVolumes-1193651253 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-659509946-1214348693 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-659509946-1214348693, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:44:29 devstack cinder-volume[87284]: WARNING cinder.quota [None req-f8585ca3-dc69-4b59-b44e-d3217b1e23a1 tempest-TestInstancesWithCinderVolumes-1193651253 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-659509946-1214348693 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-659509946-1214348693, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:44:29 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-f8585ca3-dc69-4b59-b44e-d3217b1e23a1 tempest-TestInstancesWithCinderVolumes-1193651253 None] Created reservations ['a528e044-e20b-471e-be10-89915a2073ab', '00cb60c0-e535-4429-8047-10a286e972db', 'eef49fbf-d248-472a-a6a5-f922cf683d29', 'bfd7cdbf-b36b-4275-9333-ebefbd0857bb'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:44:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f8585ca3-dc69-4b59-b44e-d3217b1e23a1 tempest-TestInstancesWithCinderVolumes-1193651253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f8585ca3-dc69-4b59-b44e-d3217b1e23a1 tempest-TestInstancesWithCinderVolumes-1193651253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:29 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f8585ca3-dc69-4b59-b44e-d3217b1e23a1 tempest-TestInstancesWithCinderVolumes-1193651253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:44:29 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f8585ca3-dc69-4b59-b44e-d3217b1e23a1 tempest-TestInstancesWithCinderVolumes-1193651253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:44:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f8585ca3-dc69-4b59-b44e-d3217b1e23a1 tempest-TestInstancesWithCinderVolumes-1193651253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f8585ca3-dc69-4b59-b44e-d3217b1e23a1 tempest-TestInstancesWithCinderVolumes-1193651253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:29 devstack sudo[98610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:44:29 devstack sudo[98610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:30 devstack sudo[98610]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f8585ca3-dc69-4b59-b44e-d3217b1e23a1 tempest-TestInstancesWithCinderVolumes-1193651253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.884s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:30 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-f8585ca3-dc69-4b59-b44e-d3217b1e23a1 tempest-TestInstancesWithCinderVolumes-1193651253 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:44:30 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-f8585ca3-dc69-4b59-b44e-d3217b1e23a1 tempest-TestInstancesWithCinderVolumes-1193651253 None] Deleted volume successfully. Jul 08 01:44:30 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f8585ca3-dc69-4b59-b44e-d3217b1e23a1 tempest-TestInstancesWithCinderVolumes-1193651253 None] Lock "cinder-2051111b-fd44-4106-b2e2-fa54c1b54825-delete_volume" released by "delete_volume" :: held 4.692s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:44:37 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=40,cinder:DELETE=4,cinder:INSERT=8,cinder:UPDATE=43 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:44:37 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=45,cinder:INSERT=10,cinder:UPDATE=40,cinder:DELETE=2 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:44:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-84ce67d0-d51e-467d-af95-b6bb3dc5136c req-a5974b66-dbf0-42f4-9a68-20f1d6a181fc tempest-TestStampPattern-1873432706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-84ce67d0-d51e-467d-af95-b6bb3dc5136c req-a5974b66-dbf0-42f4-9a68-20f1d6a181fc tempest-TestStampPattern-1873432706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:51 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1112ace-c249-4e0a-a60f-4e852e500a4d]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:44:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-84ce67d0-d51e-467d-af95-b6bb3dc5136c req-a5974b66-dbf0-42f4-9a68-20f1d6a181fc tempest-TestStampPattern-1873432706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:51 devstack sudo[98701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147 Jul 08 01:44:51 devstack sudo[98701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:52 devstack sudo[98701]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-84ce67d0-d51e-467d-af95-b6bb3dc5136c req-a5974b66-dbf0-42f4-9a68-20f1d6a181fc tempest-TestStampPattern-1873432706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147" returned: 0 in 0.887s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-84ce67d0-d51e-467d-af95-b6bb3dc5136c req-a5974b66-dbf0-42f4-9a68-20f1d6a181fc tempest-TestStampPattern-1873432706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.916s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:52 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-84ce67d0-d51e-467d-af95-b6bb3dc5136c req-a5974b66-dbf0-42f4-9a68-20f1d6a181fc tempest-TestStampPattern-1873432706 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96', 'name': 'volume-d254098a-3644-4edf-a91a-f89e94d9c147', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ae722591-ecd9-47a9-8878-9b9c51290390', 'enforce_multipath': True} {{(pid=87284) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:44:52 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-84ce67d0-d51e-467d-af95-b6bb3dc5136c req-a5974b66-dbf0-42f4-9a68-20f1d6a181fc tempest-TestStampPattern-1873432706 None] attachment_update completed successfully. Jul 08 01:44:55 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:44:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:44:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:44:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:55 devstack sudo[99090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:44:55 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:56 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.853s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:56 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:44:56 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager._thread_info {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:44:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread count: 29 {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:44:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread info: [<_MainThread(MainThread, started 127058402500736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:45:01 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-d01fa34d-9685-4df6-87a8-ecf7ea89c0b0 req-a3eb53b9-77e9-44f5-8fa0-fa43678a44a2 tempest-TestStampPattern-1873432706 None] Terminate volume connection completed successfully. Jul 08 01:45:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-d01fa34d-9685-4df6-87a8-ecf7ea89c0b0 req-a3eb53b9-77e9-44f5-8fa0-fa43678a44a2 tempest-TestStampPattern-1873432706 None] Deleting attachment ae722591-ecd9-47a9-8878-9b9c51290390. {{(pid=87284) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:45:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-79f33ce6-12b3-4e8f-a1b3-20fd1fd97de2 tempest-TestStampPattern-1873432706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-79f33ce6-12b3-4e8f-a1b3-20fd1fd97de2 tempest-TestStampPattern-1873432706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:04 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-79f33ce6-12b3-4e8f-a1b3-20fd1fd97de2 tempest-TestStampPattern-1873432706 None] Creating offline snapshot 46b1eecb-2227-4fc6-b94e-3f4bc503947e of volume d254098a-3644-4edf-a91a-f89e94d9c147 {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:45:04 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[9498af43-765c-46db-81a6-ae7f931c27ca]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:45:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-79f33ce6-12b3-4e8f-a1b3-20fd1fd97de2 tempest-TestStampPattern-1873432706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:04 devstack sudo[99156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147 Jul 08 01:45:04 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:05 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-79f33ce6-12b3-4e8f-a1b3-20fd1fd97de2 tempest-TestStampPattern-1873432706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147" returned: 0 in 1.356s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-79f33ce6-12b3-4e8f-a1b3-20fd1fd97de2 tempest-TestStampPattern-1873432706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147.46b1eecb-2227-4fc6-b94e-3f4bc503947e 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:05 devstack sudo[99175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147.46b1eecb-2227-4fc6-b94e-3f4bc503947e 1G Jul 08 01:45:05 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:06 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-79f33ce6-12b3-4e8f-a1b3-20fd1fd97de2 tempest-TestStampPattern-1873432706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147.46b1eecb-2227-4fc6-b94e-3f4bc503947e 1G" returned: 0 in 1.038s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-79f33ce6-12b3-4e8f-a1b3-20fd1fd97de2 tempest-TestStampPattern-1873432706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d254098a-3644-4edf-a91a-f89e94d9c147 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147.46b1eecb-2227-4fc6-b94e-3f4bc503947e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:06 devstack sudo[99183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d254098a-3644-4edf-a91a-f89e94d9c147 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147.46b1eecb-2227-4fc6-b94e-3f4bc503947e Jul 08 01:45:06 devstack sudo[99183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:07 devstack sudo[99183]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-79f33ce6-12b3-4e8f-a1b3-20fd1fd97de2 tempest-TestStampPattern-1873432706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d254098a-3644-4edf-a91a-f89e94d9c147 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147.46b1eecb-2227-4fc6-b94e-3f4bc503947e" returned: 0 in 0.876s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:07 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-79f33ce6-12b3-4e8f-a1b3-20fd1fd97de2 tempest-TestStampPattern-1873432706 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147.46b1eecb-2227-4fc6-b94e-3f4bc503947e is being set with open permissions: ugo+rw Jul 08 01:45:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-79f33ce6-12b3-4e8f-a1b3-20fd1fd97de2 tempest-TestStampPattern-1873432706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147.46b1eecb-2227-4fc6-b94e-3f4bc503947e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:07 devstack sudo[99189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147.46b1eecb-2227-4fc6-b94e-3f4bc503947e Jul 08 01:45:07 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:08 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-79f33ce6-12b3-4e8f-a1b3-20fd1fd97de2 tempest-TestStampPattern-1873432706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147.46b1eecb-2227-4fc6-b94e-3f4bc503947e" returned: 0 in 0.695s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-79f33ce6-12b3-4e8f-a1b3-20fd1fd97de2 tempest-TestStampPattern-1873432706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:08 devstack sudo[99192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147.info Jul 08 01:45:08 devstack sudo[99192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:08 devstack sudo[99192]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-79f33ce6-12b3-4e8f-a1b3-20fd1fd97de2 tempest-TestStampPattern-1873432706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147.info" returned: 0 in 0.811s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:08 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-79f33ce6-12b3-4e8f-a1b3-20fd1fd97de2 tempest-TestStampPattern-1873432706 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147.info is being set with open permissions: ugo+rw Jul 08 01:45:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-79f33ce6-12b3-4e8f-a1b3-20fd1fd97de2 tempest-TestStampPattern-1873432706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:08 devstack sudo[99195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147.info Jul 08 01:45:09 devstack sudo[99195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:09 devstack sudo[99195]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-79f33ce6-12b3-4e8f-a1b3-20fd1fd97de2 tempest-TestStampPattern-1873432706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147.info" returned: 0 in 0.939s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-79f33ce6-12b3-4e8f-a1b3-20fd1fd97de2 tempest-TestStampPattern-1873432706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.853s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:09 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-79f33ce6-12b3-4e8f-a1b3-20fd1fd97de2 tempest-TestStampPattern-1873432706 None] Create snapshot completed successfully Jul 08 01:45:15 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-237e5543-f814-4a87-9be3-40533585bd99 tempest-VolumesActionsTest-1859311328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:45:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-237e5543-f814-4a87-9be3-40533585bd99 tempest-VolumesActionsTest-1859311328 None] Flow 'volume_create_manager' (0887717e-bc79-4685-a758-cdb498208224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:45:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-237e5543-f814-4a87-9be3-40533585bd99 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (747ceaa2-e10a-4cb7-b2b3-fd99f4dc1156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-237e5543-f814-4a87-9be3-40533585bd99 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (747ceaa2-e10a-4cb7-b2b3-fd99f4dc1156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1151549572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f639ef-135a-4b9e-956f-de08beaf1a83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e473aa21b6f49e7820aedf7019901f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:45:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:45:16Z,use_quota=True,user_id='d61bef3a50fe4493806c662def909a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-237e5543-f814-4a87-9be3-40533585bd99 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc0d8803-e331-4e23-a3e2-b2003a528477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-237e5543-f814-4a87-9be3-40533585bd99 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc0d8803-e331-4e23-a3e2-b2003a528477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-237e5543-f814-4a87-9be3-40533585bd99 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91fa1bd5-3945-482b-b551-ab8035ef7365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-237e5543-f814-4a87-9be3-40533585bd99 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91fa1bd5-3945-482b-b551-ab8035ef7365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61f639ef-135a-4b9e-956f-de08beaf1a83', 'volume_name': 'volume-61f639ef-135a-4b9e-956f-de08beaf1a83', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-237e5543-f814-4a87-9be3-40533585bd99 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea15ce9c-b94b-4838-96e5-34ddce63cb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-237e5543-f814-4a87-9be3-40533585bd99 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea15ce9c-b94b-4838-96e5-34ddce63cb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-237e5543-f814-4a87-9be3-40533585bd99 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc07bd3f-6244-4297-aa1d-78063e502e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:15 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-237e5543-f814-4a87-9be3-40533585bd99 tempest-VolumesActionsTest-1859311328 None] Volume 61f639ef-135a-4b9e-956f-de08beaf1a83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61f639ef-135a-4b9e-956f-de08beaf1a83', 'volume_size': 1} Jul 08 01:45:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-237e5543-f814-4a87-9be3-40533585bd99 tempest-VolumesActionsTest-1859311328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-237e5543-f814-4a87-9be3-40533585bd99 tempest-VolumesActionsTest-1859311328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:15 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-237e5543-f814-4a87-9be3-40533585bd99 tempest-VolumesActionsTest-1859311328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1151549572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f639ef-135a-4b9e-956f-de08beaf1a83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e473aa21b6f49e7820aedf7019901f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:45:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:45:16Z,use_quota=True,user_id='d61bef3a50fe4493806c662def909a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:45:15 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-237e5543-f814-4a87-9be3-40533585bd99 tempest-VolumesActionsTest-1859311328 None] Creating volume 61f639ef-135a-4b9e-956f-de08beaf1a83 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:45:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-237e5543-f814-4a87-9be3-40533585bd99 tempest-VolumesActionsTest-1859311328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-237e5543-f814-4a87-9be3-40533585bd99 tempest-VolumesActionsTest-1859311328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:15 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-237e5543-f814-4a87-9be3-40533585bd99 tempest-VolumesActionsTest-1859311328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:45:15 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-237e5543-f814-4a87-9be3-40533585bd99 tempest-VolumesActionsTest-1859311328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:45:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-237e5543-f814-4a87-9be3-40533585bd99 tempest-VolumesActionsTest-1859311328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:15 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-237e5543-f814-4a87-9be3-40533585bd99 tempest-VolumesActionsTest-1859311328 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:45:15 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-237e5543-f814-4a87-9be3-40533585bd99 tempest-VolumesActionsTest-1859311328 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:45:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-237e5543-f814-4a87-9be3-40533585bd99 tempest-VolumesActionsTest-1859311328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-61f639ef-135a-4b9e-956f-de08beaf1a83 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:15 devstack sudo[99295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-61f639ef-135a-4b9e-956f-de08beaf1a83 1073741824 Jul 08 01:45:15 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:16 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-237e5543-f814-4a87-9be3-40533585bd99 tempest-VolumesActionsTest-1859311328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-61f639ef-135a-4b9e-956f-de08beaf1a83 1073741824" returned: 0 in 1.141s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-237e5543-f814-4a87-9be3-40533585bd99 tempest-VolumesActionsTest-1859311328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-61f639ef-135a-4b9e-956f-de08beaf1a83 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:17 devstack sudo[99310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-61f639ef-135a-4b9e-956f-de08beaf1a83 Jul 08 01:45:17 devstack sudo[99310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:17 devstack sudo[99310]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-237e5543-f814-4a87-9be3-40533585bd99 tempest-VolumesActionsTest-1859311328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-61f639ef-135a-4b9e-956f-de08beaf1a83" returned: 0 in 0.739s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:17 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-237e5543-f814-4a87-9be3-40533585bd99 tempest-VolumesActionsTest-1859311328 None] <== create_volume: return (1974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:45:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-237e5543-f814-4a87-9be3-40533585bd99 tempest-VolumesActionsTest-1859311328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.978s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:17 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-237e5543-f814-4a87-9be3-40533585bd99 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc07bd3f-6244-4297-aa1d-78063e502e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61f639ef-135a-4b9e-956f-de08beaf1a83', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:17 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-237e5543-f814-4a87-9be3-40533585bd99 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69c51286-30bc-46d0-8221-489156300579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:17 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-237e5543-f814-4a87-9be3-40533585bd99 tempest-VolumesActionsTest-1859311328 None] Volume volume-61f639ef-135a-4b9e-956f-de08beaf1a83 (61f639ef-135a-4b9e-956f-de08beaf1a83): created successfully Jul 08 01:45:17 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-237e5543-f814-4a87-9be3-40533585bd99 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69c51286-30bc-46d0-8221-489156300579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:17 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-237e5543-f814-4a87-9be3-40533585bd99 tempest-VolumesActionsTest-1859311328 None] Flow 'volume_create_manager' (0887717e-bc79-4685-a758-cdb498208224) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:45:17 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-237e5543-f814-4a87-9be3-40533585bd99 tempest-VolumesActionsTest-1859311328 None] Created volume successfully. Jul 08 01:45:18 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-df0152ed-2541-4eb5-8a0e-69b2aba0093f tempest-VolumesActionsTest-1859311328 None] Acquiring lock "cinder-61f639ef-135a-4b9e-956f-de08beaf1a83" by "attach_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:18 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-df0152ed-2541-4eb5-8a0e-69b2aba0093f tempest-VolumesActionsTest-1859311328 None] Lock "cinder-61f639ef-135a-4b9e-956f-de08beaf1a83" acquired by "attach_volume" :: waited 0.030s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:18 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-df0152ed-2541-4eb5-8a0e-69b2aba0093f tempest-VolumesActionsTest-1859311328 None] Attaching volume 61f639ef-135a-4b9e-956f-de08beaf1a83 to instance 2ddd3437-0e99-4ba3-9a40-ffdf5c770500 at mountpoint /dev/vdb on host None. Jul 08 01:45:18 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-df0152ed-2541-4eb5-8a0e-69b2aba0093f tempest-VolumesActionsTest-1859311328 None] Attach volume completed successfully. Jul 08 01:45:19 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-df0152ed-2541-4eb5-8a0e-69b2aba0093f tempest-VolumesActionsTest-1859311328 None] Lock "cinder-61f639ef-135a-4b9e-956f-de08beaf1a83" released by "attach_volume" :: held 0.164s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:20 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-2e87bab6-c996-4b02-b9d8-16d91ecef360 tempest-VolumesActionsTest-1984105427 None] Terminate volume connection completed successfully. Jul 08 01:45:21 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2e87bab6-c996-4b02-b9d8-16d91ecef360 tempest-VolumesActionsTest-1984105427 None] Acquiring lock "cinder-61f639ef-135a-4b9e-956f-de08beaf1a83-detach_volume" by "detach_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:21 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2e87bab6-c996-4b02-b9d8-16d91ecef360 tempest-VolumesActionsTest-1984105427 None] Lock "cinder-61f639ef-135a-4b9e-956f-de08beaf1a83-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:21 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-2e87bab6-c996-4b02-b9d8-16d91ecef360 tempest-VolumesActionsTest-1984105427 None] Detaching volume 61f639ef-135a-4b9e-956f-de08beaf1a83 from instance 2ddd3437-0e99-4ba3-9a40-ffdf5c770500. Jul 08 01:45:21 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-2e87bab6-c996-4b02-b9d8-16d91ecef360 tempest-VolumesActionsTest-1984105427 None] Detach volume completed successfully. Jul 08 01:45:21 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2e87bab6-c996-4b02-b9d8-16d91ecef360 tempest-VolumesActionsTest-1984105427 None] Lock "cinder-61f639ef-135a-4b9e-956f-de08beaf1a83-detach_volume" released by "detach_volume" :: held 0.103s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:21 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2d46f956-a6e9-4010-a627-36fece0cddb9 tempest-VolumesActionsTest-1859311328 None] Acquiring lock "cinder-61f639ef-135a-4b9e-956f-de08beaf1a83-detach_volume" by "detach_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:21 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2d46f956-a6e9-4010-a627-36fece0cddb9 tempest-VolumesActionsTest-1859311328 None] Lock "cinder-61f639ef-135a-4b9e-956f-de08beaf1a83-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:21 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-2d46f956-a6e9-4010-a627-36fece0cddb9 tempest-VolumesActionsTest-1859311328 None] Volume detach called, but volume not attached. Jul 08 01:45:21 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2d46f956-a6e9-4010-a627-36fece0cddb9 tempest-VolumesActionsTest-1859311328 None] Lock "cinder-61f639ef-135a-4b9e-956f-de08beaf1a83-detach_volume" released by "detach_volume" :: held 0.027s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:22 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:45:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Flow 'volume_create_manager' (9bc43846-4105-467d-bb2d-b6cf8b9c8278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:45:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (744aa8b2-5bfa-4970-8db9-97ea15c948b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (744aa8b2-5bfa-4970-8db9-97ea15c948b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1551121957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64871dd3-7a1b-45f1-b847-c0ba3628df5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2e595c568944df5af1513902fcc0aa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=46b1eecb-2227-4fc6-b94e-3f4bc503947e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:45:22Z,use_quota=True,user_id='15d69951b7314a85a2a64d85b3dcfa5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80880234-0b37-49af-898e-41df1e795eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80880234-0b37-49af-898e-41df1e795eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7103080d-4f47-4eb0-b1ef-64587f51bea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7103080d-4f47-4eb0-b1ef-64587f51bea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '64871dd3-7a1b-45f1-b847-c0ba3628df5c', 'volume_name': 'volume-64871dd3-7a1b-45f1-b847-c0ba3628df5c', 'volume_size': 1, 'snapshot_id': '46b1eecb-2227-4fc6-b94e-3f4bc503947e'}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d25a870-bf53-4ca1-a5b6-ea78f970dec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d25a870-bf53-4ca1-a5b6-ea78f970dec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57a33a73-8f70-47fd-aad2-c2088d4f84af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:22 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Volume 64871dd3-7a1b-45f1-b847-c0ba3628df5c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-64871dd3-7a1b-45f1-b847-c0ba3628df5c', 'volume_size': 1, 'snapshot_id': '46b1eecb-2227-4fc6-b94e-3f4bc503947e'} Jul 08 01:45:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:22 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Acquiring lock "cinder-quobyte-46b1eecb-2227-4fc6-b94e-3f4bc503947e-64871dd3-7a1b-45f1-b847-c0ba3628df5c" by "_create_volume_from_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:22 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Lock "cinder-quobyte-46b1eecb-2227-4fc6-b94e-3f4bc503947e-64871dd3-7a1b-45f1-b847-c0ba3628df5c" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:22 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Creating volume 64871dd3-7a1b-45f1-b847-c0ba3628df5c from snapshot 46b1eecb-2227-4fc6-b94e-3f4bc503947e {{(pid=87284) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 01:45:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:22 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:45:22 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:45:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:22 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:45:22 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Acquiring lock "cinder-quobyte-64871dd3-7a1b-45f1-b847-c0ba3628df5c" by "_copy_volume_from_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:22 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Lock "cinder-quobyte-64871dd3-7a1b-45f1-b847-c0ba3628df5c" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:22 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] snapshot: 46b1eecb-2227-4fc6-b94e-3f4bc503947e, volume: 64871dd3-7a1b-45f1-b847-c0ba3628df5c, {{(pid=87284) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:45:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:22 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:45:22 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:45:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:22 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f22135-d87d-4fe1-84bb-2678d855f2a4]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:45:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147.46b1eecb-2227-4fc6-b94e-3f4bc503947e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:22 devstack sudo[99313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147.46b1eecb-2227-4fc6-b94e-3f4bc503947e Jul 08 01:45:22 devstack sudo[99313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:22 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d08a2a00-ab61-4073-82ab-ae4921584973 tempest-VolumesActionsTest-1859311328 None] Acquiring lock "cinder-61f639ef-135a-4b9e-956f-de08beaf1a83-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:22 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d08a2a00-ab61-4073-82ab-ae4921584973 tempest-VolumesActionsTest-1859311328 None] Lock "cinder-61f639ef-135a-4b9e-956f-de08beaf1a83-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:22 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d08a2a00-ab61-4073-82ab-ae4921584973 tempest-VolumesActionsTest-1859311328 None] Acquiring lock "cinder-quobyte-61f639ef-135a-4b9e-956f-de08beaf1a83" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:22 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d08a2a00-ab61-4073-82ab-ae4921584973 tempest-VolumesActionsTest-1859311328 None] Lock "cinder-quobyte-61f639ef-135a-4b9e-956f-de08beaf1a83" acquired by "delete_volume" :: waited 0.023s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:22 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a06180-026b-49bd-94a8-afd30f93e51e]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:45:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d08a2a00-ab61-4073-82ab-ae4921584973 tempest-VolumesActionsTest-1859311328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-61f639ef-135a-4b9e-956f-de08beaf1a83 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:23 devstack sudo[99315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-61f639ef-135a-4b9e-956f-de08beaf1a83 Jul 08 01:45:23 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:23 devstack sudo[99313]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147.46b1eecb-2227-4fc6-b94e-3f4bc503947e" returned: 0 in 1.278s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:23 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d254098a-3644-4edf-a91a-f89e94d9c147(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:45:23 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147 {{(pid=87284) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:45:23 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Creating direct copy from snapshot {{(pid=87284) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:45:23 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6d9698-713e-4894-b360-5abed4ef3a93]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:45:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:23 devstack sudo[99321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147 Jul 08 01:45:23 devstack sudo[99321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:24 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d08a2a00-ab61-4073-82ab-ae4921584973 tempest-VolumesActionsTest-1859311328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-61f639ef-135a-4b9e-956f-de08beaf1a83" returned: 0 in 1.746s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d08a2a00-ab61-4073-82ab-ae4921584973 tempest-VolumesActionsTest-1859311328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-61f639ef-135a-4b9e-956f-de08beaf1a83 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:24 devstack sudo[99328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-61f639ef-135a-4b9e-956f-de08beaf1a83 Jul 08 01:45:24 devstack sudo[99328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:24 devstack sudo[99321]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147" returned: 0 in 1.156s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:24 devstack cinder-volume[87284]: DEBUG cinder.utils [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Path /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64871dd3-7a1b-45f1-b847-c0ba3628df5c not found in is_blk_device check {{(pid=87284) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:45:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64871dd3-7a1b-45f1-b847-c0ba3628df5c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:24 devstack sudo[99367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64871dd3-7a1b-45f1-b847-c0ba3628df5c Jul 08 01:45:24 devstack sudo[99367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:25 devstack sudo[99328]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d08a2a00-ab61-4073-82ab-ae4921584973 tempest-VolumesActionsTest-1859311328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-61f639ef-135a-4b9e-956f-de08beaf1a83" returned: 0 in 1.227s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:25 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d08a2a00-ab61-4073-82ab-ae4921584973 tempest-VolumesActionsTest-1859311328 None] Lock "cinder-quobyte-61f639ef-135a-4b9e-956f-de08beaf1a83" released by "delete_volume" :: held 3.051s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:25 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-d08a2a00-ab61-4073-82ab-ae4921584973 tempest-VolumesActionsTest-1859311328 None] Created reservations ['eb117662-7dd3-4f0f-b4b0-1aa5414e73e3', '793cfc01-052d-42aa-a69b-eb5dbc47e65f', '2fced06b-9b56-47ff-ac71-1d1d315b67fc', 'a9a9200e-2b26-4793-b8cd-cfc724d2ab2d'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:45:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-d08a2a00-ab61-4073-82ab-ae4921584973 tempest-VolumesActionsTest-1859311328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-d08a2a00-ab61-4073-82ab-ae4921584973 tempest-VolumesActionsTest-1859311328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:26 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-d08a2a00-ab61-4073-82ab-ae4921584973 tempest-VolumesActionsTest-1859311328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:45:26 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-d08a2a00-ab61-4073-82ab-ae4921584973 tempest-VolumesActionsTest-1859311328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:45:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-d08a2a00-ab61-4073-82ab-ae4921584973 tempest-VolumesActionsTest-1859311328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d08a2a00-ab61-4073-82ab-ae4921584973 tempest-VolumesActionsTest-1859311328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:26 devstack sudo[99376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:45:26 devstack sudo[99376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:27 devstack sudo[99376]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d08a2a00-ab61-4073-82ab-ae4921584973 tempest-VolumesActionsTest-1859311328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.615s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:27 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-d08a2a00-ab61-4073-82ab-ae4921584973 tempest-VolumesActionsTest-1859311328 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:45:27 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-d08a2a00-ab61-4073-82ab-ae4921584973 tempest-VolumesActionsTest-1859311328 None] Deleted volume successfully. Jul 08 01:45:27 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d08a2a00-ab61-4073-82ab-ae4921584973 tempest-VolumesActionsTest-1859311328 None] Lock "cinder-61f639ef-135a-4b9e-956f-de08beaf1a83-delete_volume" released by "delete_volume" :: held 5.084s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:32 devstack sudo[99367]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64871dd3-7a1b-45f1-b847-c0ba3628df5c" returned: 0 in 7.148s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:32 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a25197-7b3f-4b49-aa15-31b195c11cf3]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:45:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:32 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147 Jul 08 01:45:32 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:33 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147" returned: 0 in 1.510s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:33 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Image conversion details: src /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147, size 1024.00 MB, duration 7.15 sec, destination /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64871dd3-7a1b-45f1-b847-c0ba3628df5c {{(pid=87284) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:45:33 devstack cinder-volume[87284]: INFO cinder.image.image_utils [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Converted 1024.00 MB image at 143.24 MB/s Jul 08 01:45:33 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64871dd3-7a1b-45f1-b847-c0ba3628df5c is being set with open permissions: ugo+rw Jul 08 01:45:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64871dd3-7a1b-45f1-b847-c0ba3628df5c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:33 devstack sudo[99459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64871dd3-7a1b-45f1-b847-c0ba3628df5c Jul 08 01:45:33 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:34 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64871dd3-7a1b-45f1-b847-c0ba3628df5c" returned: 0 in 1.002s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:34 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Lock "cinder-quobyte-64871dd3-7a1b-45f1-b847-c0ba3628df5c" released by "_copy_volume_from_snapshot" :: held 12.269s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:34 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Lock "cinder-quobyte-46b1eecb-2227-4fc6-b94e-3f4bc503947e-64871dd3-7a1b-45f1-b847-c0ba3628df5c" released by "_create_volume_from_snapshot" :: held 12.324s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.353s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:34 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57a33a73-8f70-47fd-aad2-c2088d4f84af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64871dd3-7a1b-45f1-b847-c0ba3628df5c', 'volume_size': 1, 'snapshot_id': '46b1eecb-2227-4fc6-b94e-3f4bc503947e'}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:34 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (739136b2-b609-4b90-a901-a43811a1fc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:34 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Volume volume-64871dd3-7a1b-45f1-b847-c0ba3628df5c (64871dd3-7a1b-45f1-b847-c0ba3628df5c): created successfully Jul 08 01:45:34 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (739136b2-b609-4b90-a901-a43811a1fc7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:34 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Flow 'volume_create_manager' (9bc43846-4105-467d-bb2d-b6cf8b9c8278) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:45:34 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-2905893b-82de-44ff-a71b-159a684ca6e8 tempest-TestStampPattern-1873432706 None] Created volume successfully. Jul 08 01:45:36 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-f64a9cdf-382b-4b21-9d48-4bbea2c90600 tempest-VolumesActionsTest-1859311328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:45:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f64a9cdf-382b-4b21-9d48-4bbea2c90600 tempest-VolumesActionsTest-1859311328 None] Flow 'volume_create_manager' (f3e67e50-9b11-4b36-9e4c-c2307fa593a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:45:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f64a9cdf-382b-4b21-9d48-4bbea2c90600 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49f43230-bcc7-429e-86a5-49e956b3688f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f64a9cdf-382b-4b21-9d48-4bbea2c90600 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49f43230-bcc7-429e-86a5-49e956b3688f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1973242413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f266cb6-0ae3-47d2-a840-e6079f10e5ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e473aa21b6f49e7820aedf7019901f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:45:37Z,use_quota=True,user_id='d61bef3a50fe4493806c662def909a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f64a9cdf-382b-4b21-9d48-4bbea2c90600 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e026f78f-eea5-4763-86ec-ff5edc703001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f64a9cdf-382b-4b21-9d48-4bbea2c90600 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e026f78f-eea5-4763-86ec-ff5edc703001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f64a9cdf-382b-4b21-9d48-4bbea2c90600 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a5fb71c-574c-4e64-b9b9-4daf83240fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f64a9cdf-382b-4b21-9d48-4bbea2c90600 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a5fb71c-574c-4e64-b9b9-4daf83240fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f266cb6-0ae3-47d2-a840-e6079f10e5ce', 'volume_name': 'volume-8f266cb6-0ae3-47d2-a840-e6079f10e5ce', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f64a9cdf-382b-4b21-9d48-4bbea2c90600 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb7677a-c3e2-4551-a013-1fb1cd97d6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f64a9cdf-382b-4b21-9d48-4bbea2c90600 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb7677a-c3e2-4551-a013-1fb1cd97d6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f64a9cdf-382b-4b21-9d48-4bbea2c90600 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2816f308-7d91-414e-ac73-8beaa9a9d7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:36 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-f64a9cdf-382b-4b21-9d48-4bbea2c90600 tempest-VolumesActionsTest-1859311328 None] Volume 8f266cb6-0ae3-47d2-a840-e6079f10e5ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f266cb6-0ae3-47d2-a840-e6079f10e5ce', 'volume_size': 1} Jul 08 01:45:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f64a9cdf-382b-4b21-9d48-4bbea2c90600 tempest-VolumesActionsTest-1859311328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f64a9cdf-382b-4b21-9d48-4bbea2c90600 tempest-VolumesActionsTest-1859311328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f64a9cdf-382b-4b21-9d48-4bbea2c90600 tempest-VolumesActionsTest-1859311328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1973242413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f266cb6-0ae3-47d2-a840-e6079f10e5ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e473aa21b6f49e7820aedf7019901f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:45:37Z,use_quota=True,user_id='d61bef3a50fe4493806c662def909a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:45:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-f64a9cdf-382b-4b21-9d48-4bbea2c90600 tempest-VolumesActionsTest-1859311328 None] Creating volume 8f266cb6-0ae3-47d2-a840-e6079f10e5ce {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:45:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f64a9cdf-382b-4b21-9d48-4bbea2c90600 tempest-VolumesActionsTest-1859311328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f64a9cdf-382b-4b21-9d48-4bbea2c90600 tempest-VolumesActionsTest-1859311328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f64a9cdf-382b-4b21-9d48-4bbea2c90600 tempest-VolumesActionsTest-1859311328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:45:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f64a9cdf-382b-4b21-9d48-4bbea2c90600 tempest-VolumesActionsTest-1859311328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:45:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f64a9cdf-382b-4b21-9d48-4bbea2c90600 tempest-VolumesActionsTest-1859311328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f64a9cdf-382b-4b21-9d48-4bbea2c90600 tempest-VolumesActionsTest-1859311328 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:45:36 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-f64a9cdf-382b-4b21-9d48-4bbea2c90600 tempest-VolumesActionsTest-1859311328 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:45:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f64a9cdf-382b-4b21-9d48-4bbea2c90600 tempest-VolumesActionsTest-1859311328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8f266cb6-0ae3-47d2-a840-e6079f10e5ce 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:36 devstack sudo[99510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8f266cb6-0ae3-47d2-a840-e6079f10e5ce 1073741824 Jul 08 01:45:36 devstack sudo[99510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:37 devstack sudo[99510]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f64a9cdf-382b-4b21-9d48-4bbea2c90600 tempest-VolumesActionsTest-1859311328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8f266cb6-0ae3-47d2-a840-e6079f10e5ce 1073741824" returned: 0 in 0.953s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f64a9cdf-382b-4b21-9d48-4bbea2c90600 tempest-VolumesActionsTest-1859311328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8f266cb6-0ae3-47d2-a840-e6079f10e5ce {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:37 devstack sudo[99516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8f266cb6-0ae3-47d2-a840-e6079f10e5ce Jul 08 01:45:37 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:38 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f64a9cdf-382b-4b21-9d48-4bbea2c90600 tempest-VolumesActionsTest-1859311328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8f266cb6-0ae3-47d2-a840-e6079f10e5ce" returned: 0 in 0.744s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:38 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f64a9cdf-382b-4b21-9d48-4bbea2c90600 tempest-VolumesActionsTest-1859311328 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:45:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f64a9cdf-382b-4b21-9d48-4bbea2c90600 tempest-VolumesActionsTest-1859311328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.770s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f64a9cdf-382b-4b21-9d48-4bbea2c90600 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2816f308-7d91-414e-ac73-8beaa9a9d7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f266cb6-0ae3-47d2-a840-e6079f10e5ce', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f64a9cdf-382b-4b21-9d48-4bbea2c90600 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf1c806b-e636-48f9-8f59-8de3f27de2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:38 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-f64a9cdf-382b-4b21-9d48-4bbea2c90600 tempest-VolumesActionsTest-1859311328 None] Volume volume-8f266cb6-0ae3-47d2-a840-e6079f10e5ce (8f266cb6-0ae3-47d2-a840-e6079f10e5ce): created successfully Jul 08 01:45:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f64a9cdf-382b-4b21-9d48-4bbea2c90600 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf1c806b-e636-48f9-8f59-8de3f27de2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f64a9cdf-382b-4b21-9d48-4bbea2c90600 tempest-VolumesActionsTest-1859311328 None] Flow 'volume_create_manager' (f3e67e50-9b11-4b36-9e4c-c2307fa593a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:45:38 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-f64a9cdf-382b-4b21-9d48-4bbea2c90600 tempest-VolumesActionsTest-1859311328 None] Created volume successfully. Jul 08 01:45:38 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ae195e06-60e2-49a3-b266-c8f51d6ad6d4 tempest-VolumesActionsTest-1984105427 None] Acquiring lock "cinder-8f266cb6-0ae3-47d2-a840-e6079f10e5ce-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:38 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ae195e06-60e2-49a3-b266-c8f51d6ad6d4 tempest-VolumesActionsTest-1984105427 None] Lock "cinder-8f266cb6-0ae3-47d2-a840-e6079f10e5ce-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:38 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ae195e06-60e2-49a3-b266-c8f51d6ad6d4 tempest-VolumesActionsTest-1984105427 None] Acquiring lock "cinder-quobyte-8f266cb6-0ae3-47d2-a840-e6079f10e5ce" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:38 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ae195e06-60e2-49a3-b266-c8f51d6ad6d4 tempest-VolumesActionsTest-1984105427 None] Lock "cinder-quobyte-8f266cb6-0ae3-47d2-a840-e6079f10e5ce" acquired by "delete_volume" :: waited 0.028s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:39 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[49136638-6d8a-41f5-b0d2-e38651fd52c8]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:45:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae195e06-60e2-49a3-b266-c8f51d6ad6d4 tempest-VolumesActionsTest-1984105427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8f266cb6-0ae3-47d2-a840-e6079f10e5ce {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:39 devstack sudo[99544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8f266cb6-0ae3-47d2-a840-e6079f10e5ce Jul 08 01:45:39 devstack sudo[99544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:40 devstack sudo[99544]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae195e06-60e2-49a3-b266-c8f51d6ad6d4 tempest-VolumesActionsTest-1984105427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8f266cb6-0ae3-47d2-a840-e6079f10e5ce" returned: 0 in 1.251s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae195e06-60e2-49a3-b266-c8f51d6ad6d4 tempest-VolumesActionsTest-1984105427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8f266cb6-0ae3-47d2-a840-e6079f10e5ce {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:40 devstack sudo[99589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8f266cb6-0ae3-47d2-a840-e6079f10e5ce Jul 08 01:45:40 devstack sudo[99589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:41 devstack sudo[99589]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae195e06-60e2-49a3-b266-c8f51d6ad6d4 tempest-VolumesActionsTest-1984105427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8f266cb6-0ae3-47d2-a840-e6079f10e5ce" returned: 0 in 0.882s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:41 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ae195e06-60e2-49a3-b266-c8f51d6ad6d4 tempest-VolumesActionsTest-1984105427 None] Lock "cinder-quobyte-8f266cb6-0ae3-47d2-a840-e6079f10e5ce" released by "delete_volume" :: held 2.299s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:41 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-ae195e06-60e2-49a3-b266-c8f51d6ad6d4 tempest-VolumesActionsTest-1984105427 None] Created reservations ['05fabe7a-3b14-47c8-80a1-597c138080e2', 'e9e0df46-58da-44bb-81ab-4147f035898f', 'ae75f8a3-2309-4d35-8709-f8bbac830217', 'a4140dc6-e963-4ead-ad4d-64c9a431e408'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:45:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ae195e06-60e2-49a3-b266-c8f51d6ad6d4 tempest-VolumesActionsTest-1984105427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ae195e06-60e2-49a3-b266-c8f51d6ad6d4 tempest-VolumesActionsTest-1984105427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:41 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-ae195e06-60e2-49a3-b266-c8f51d6ad6d4 tempest-VolumesActionsTest-1984105427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:45:41 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-ae195e06-60e2-49a3-b266-c8f51d6ad6d4 tempest-VolumesActionsTest-1984105427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:45:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ae195e06-60e2-49a3-b266-c8f51d6ad6d4 tempest-VolumesActionsTest-1984105427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae195e06-60e2-49a3-b266-c8f51d6ad6d4 tempest-VolumesActionsTest-1984105427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:41 devstack sudo[99637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:45:41 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:42 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae195e06-60e2-49a3-b266-c8f51d6ad6d4 tempest-VolumesActionsTest-1984105427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.688s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:42 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-ae195e06-60e2-49a3-b266-c8f51d6ad6d4 tempest-VolumesActionsTest-1984105427 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:45:42 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-ae195e06-60e2-49a3-b266-c8f51d6ad6d4 tempest-VolumesActionsTest-1984105427 None] Deleted volume successfully. Jul 08 01:45:42 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ae195e06-60e2-49a3-b266-c8f51d6ad6d4 tempest-VolumesActionsTest-1984105427 None] Lock "cinder-8f266cb6-0ae3-47d2-a840-e6079f10e5ce-delete_volume" released by "delete_volume" :: held 3.299s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:43 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-71c3c7e3-bad4-45fc-b0d9-9e5868627eb4 tempest-VolumesActionsTest-1859311328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:45:43 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-71c3c7e3-bad4-45fc-b0d9-9e5868627eb4 tempest-VolumesActionsTest-1859311328 None] Flow 'volume_create_manager' (1b7c5eab-2415-462f-8706-122df10eab27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:45:43 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-71c3c7e3-bad4-45fc-b0d9-9e5868627eb4 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0590a263-a9b1-43df-ae1a-df00f5bf945f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:43 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-71c3c7e3-bad4-45fc-b0d9-9e5868627eb4 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0590a263-a9b1-43df-ae1a-df00f5bf945f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1770827420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a964f09-a082-49f1-9974-15f42e6d2145,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e473aa21b6f49e7820aedf7019901f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:45:43Z,use_quota=True,user_id='d61bef3a50fe4493806c662def909a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:43 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-71c3c7e3-bad4-45fc-b0d9-9e5868627eb4 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a9ab76-f1aa-4d48-865d-a7facbc2290f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:43 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-71c3c7e3-bad4-45fc-b0d9-9e5868627eb4 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a9ab76-f1aa-4d48-865d-a7facbc2290f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:43 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-71c3c7e3-bad4-45fc-b0d9-9e5868627eb4 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af80dada-b094-4774-9236-44dd29671a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:43 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-71c3c7e3-bad4-45fc-b0d9-9e5868627eb4 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af80dada-b094-4774-9236-44dd29671a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a964f09-a082-49f1-9974-15f42e6d2145', 'volume_name': 'volume-8a964f09-a082-49f1-9974-15f42e6d2145', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:43 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-71c3c7e3-bad4-45fc-b0d9-9e5868627eb4 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65cfcb7d-a726-4845-b525-da166886fa3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:43 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-71c3c7e3-bad4-45fc-b0d9-9e5868627eb4 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65cfcb7d-a726-4845-b525-da166886fa3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:43 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-71c3c7e3-bad4-45fc-b0d9-9e5868627eb4 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7fc08a4-2a9e-48ac-8a5f-462e0b277fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:43 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-71c3c7e3-bad4-45fc-b0d9-9e5868627eb4 tempest-VolumesActionsTest-1859311328 None] Volume 8a964f09-a082-49f1-9974-15f42e6d2145: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a964f09-a082-49f1-9974-15f42e6d2145', 'volume_size': 1} Jul 08 01:45:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-71c3c7e3-bad4-45fc-b0d9-9e5868627eb4 tempest-VolumesActionsTest-1859311328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-71c3c7e3-bad4-45fc-b0d9-9e5868627eb4 tempest-VolumesActionsTest-1859311328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:43 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-71c3c7e3-bad4-45fc-b0d9-9e5868627eb4 tempest-VolumesActionsTest-1859311328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1770827420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a964f09-a082-49f1-9974-15f42e6d2145,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e473aa21b6f49e7820aedf7019901f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:45:43Z,use_quota=True,user_id='d61bef3a50fe4493806c662def909a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:45:43 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-71c3c7e3-bad4-45fc-b0d9-9e5868627eb4 tempest-VolumesActionsTest-1859311328 None] Creating volume 8a964f09-a082-49f1-9974-15f42e6d2145 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:45:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-71c3c7e3-bad4-45fc-b0d9-9e5868627eb4 tempest-VolumesActionsTest-1859311328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-71c3c7e3-bad4-45fc-b0d9-9e5868627eb4 tempest-VolumesActionsTest-1859311328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:43 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-71c3c7e3-bad4-45fc-b0d9-9e5868627eb4 tempest-VolumesActionsTest-1859311328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:45:43 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-71c3c7e3-bad4-45fc-b0d9-9e5868627eb4 tempest-VolumesActionsTest-1859311328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:45:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-71c3c7e3-bad4-45fc-b0d9-9e5868627eb4 tempest-VolumesActionsTest-1859311328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:43 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-71c3c7e3-bad4-45fc-b0d9-9e5868627eb4 tempest-VolumesActionsTest-1859311328 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:45:43 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-71c3c7e3-bad4-45fc-b0d9-9e5868627eb4 tempest-VolumesActionsTest-1859311328 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:45:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-71c3c7e3-bad4-45fc-b0d9-9e5868627eb4 tempest-VolumesActionsTest-1859311328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8a964f09-a082-49f1-9974-15f42e6d2145 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:43 devstack sudo[99646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8a964f09-a082-49f1-9974-15f42e6d2145 1073741824 Jul 08 01:45:43 devstack sudo[99646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:45 devstack sudo[99646]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-71c3c7e3-bad4-45fc-b0d9-9e5868627eb4 tempest-VolumesActionsTest-1859311328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8a964f09-a082-49f1-9974-15f42e6d2145 1073741824" returned: 0 in 2.049s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-71c3c7e3-bad4-45fc-b0d9-9e5868627eb4 tempest-VolumesActionsTest-1859311328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8a964f09-a082-49f1-9974-15f42e6d2145 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:45 devstack sudo[99676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8a964f09-a082-49f1-9974-15f42e6d2145 Jul 08 01:45:45 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:46 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-71c3c7e3-bad4-45fc-b0d9-9e5868627eb4 tempest-VolumesActionsTest-1859311328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8a964f09-a082-49f1-9974-15f42e6d2145" returned: 0 in 1.098s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:46 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-71c3c7e3-bad4-45fc-b0d9-9e5868627eb4 tempest-VolumesActionsTest-1859311328 None] <== create_volume: return (3250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:45:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-71c3c7e3-bad4-45fc-b0d9-9e5868627eb4 tempest-VolumesActionsTest-1859311328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.254s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-71c3c7e3-bad4-45fc-b0d9-9e5868627eb4 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7fc08a4-2a9e-48ac-8a5f-462e0b277fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a964f09-a082-49f1-9974-15f42e6d2145', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-71c3c7e3-bad4-45fc-b0d9-9e5868627eb4 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6963a023-1feb-4b9d-b359-14f2b72fb3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:46 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-71c3c7e3-bad4-45fc-b0d9-9e5868627eb4 tempest-VolumesActionsTest-1859311328 None] Volume volume-8a964f09-a082-49f1-9974-15f42e6d2145 (8a964f09-a082-49f1-9974-15f42e6d2145): created successfully Jul 08 01:45:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-71c3c7e3-bad4-45fc-b0d9-9e5868627eb4 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6963a023-1feb-4b9d-b359-14f2b72fb3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-71c3c7e3-bad4-45fc-b0d9-9e5868627eb4 tempest-VolumesActionsTest-1859311328 None] Flow 'volume_create_manager' (1b7c5eab-2415-462f-8706-122df10eab27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:45:46 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-71c3c7e3-bad4-45fc-b0d9-9e5868627eb4 tempest-VolumesActionsTest-1859311328 None] Created volume successfully. Jul 08 01:45:47 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-389bcada-389d-4245-9764-c61d6d42cca5 tempest-VolumesActionsTest-1984105427 None] Acquiring lock "cinder-8a964f09-a082-49f1-9974-15f42e6d2145-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:47 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-389bcada-389d-4245-9764-c61d6d42cca5 tempest-VolumesActionsTest-1984105427 None] Lock "cinder-8a964f09-a082-49f1-9974-15f42e6d2145-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:47 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=37,cinder:UPDATE=32,cinder:INSERT=6,cinder:DELETE=3 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:45:47 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=36,cinder:UPDATE=36,cinder:INSERT=8,cinder:DELETE=4 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:45:47 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-389bcada-389d-4245-9764-c61d6d42cca5 tempest-VolumesActionsTest-1984105427 None] Acquiring lock "cinder-quobyte-8a964f09-a082-49f1-9974-15f42e6d2145" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:47 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-389bcada-389d-4245-9764-c61d6d42cca5 tempest-VolumesActionsTest-1984105427 None] Lock "cinder-quobyte-8a964f09-a082-49f1-9974-15f42e6d2145" acquired by "delete_volume" :: waited 0.049s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:48 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc77d783-c0a5-4093-8e32-58ebd376a2cb]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:45:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-389bcada-389d-4245-9764-c61d6d42cca5 tempest-VolumesActionsTest-1984105427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8a964f09-a082-49f1-9974-15f42e6d2145 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:48 devstack sudo[99682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8a964f09-a082-49f1-9974-15f42e6d2145 Jul 08 01:45:48 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:48 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-389bcada-389d-4245-9764-c61d6d42cca5 tempest-VolumesActionsTest-1984105427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8a964f09-a082-49f1-9974-15f42e6d2145" returned: 0 in 0.915s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-389bcada-389d-4245-9764-c61d6d42cca5 tempest-VolumesActionsTest-1984105427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8a964f09-a082-49f1-9974-15f42e6d2145 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:48 devstack sudo[99688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8a964f09-a082-49f1-9974-15f42e6d2145 Jul 08 01:45:48 devstack sudo[99688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:49 devstack sudo[99688]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-389bcada-389d-4245-9764-c61d6d42cca5 tempest-VolumesActionsTest-1984105427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8a964f09-a082-49f1-9974-15f42e6d2145" returned: 0 in 0.901s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:49 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-389bcada-389d-4245-9764-c61d6d42cca5 tempest-VolumesActionsTest-1984105427 None] Lock "cinder-quobyte-8a964f09-a082-49f1-9974-15f42e6d2145" released by "delete_volume" :: held 1.888s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:49 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-389bcada-389d-4245-9764-c61d6d42cca5 tempest-VolumesActionsTest-1984105427 None] Created reservations ['8011c2b4-977a-48d1-bc9f-8ef6562d873a', '60438803-276b-4e58-b407-780aae0a9879', '60413ee4-7277-44fd-97d8-3f02bb4574f4', '703697ed-5699-4838-9537-ba735cca5f19'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:45:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-389bcada-389d-4245-9764-c61d6d42cca5 tempest-VolumesActionsTest-1984105427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-389bcada-389d-4245-9764-c61d6d42cca5 tempest-VolumesActionsTest-1984105427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-389bcada-389d-4245-9764-c61d6d42cca5 tempest-VolumesActionsTest-1984105427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:45:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-389bcada-389d-4245-9764-c61d6d42cca5 tempest-VolumesActionsTest-1984105427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:45:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-389bcada-389d-4245-9764-c61d6d42cca5 tempest-VolumesActionsTest-1984105427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-389bcada-389d-4245-9764-c61d6d42cca5 tempest-VolumesActionsTest-1984105427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:50 devstack sudo[99691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:45:50 devstack sudo[99691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:50 devstack sudo[99691]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-389bcada-389d-4245-9764-c61d6d42cca5 tempest-VolumesActionsTest-1984105427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.881s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:50 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-389bcada-389d-4245-9764-c61d6d42cca5 tempest-VolumesActionsTest-1984105427 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:45:50 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-389bcada-389d-4245-9764-c61d6d42cca5 tempest-VolumesActionsTest-1984105427 None] Deleted volume successfully. Jul 08 01:45:51 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-389bcada-389d-4245-9764-c61d6d42cca5 tempest-VolumesActionsTest-1984105427 None] Lock "cinder-8a964f09-a082-49f1-9974-15f42e6d2145-delete_volume" released by "delete_volume" :: held 3.173s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:51 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-13837bde-0c5b-48a5-af4b-4ca5fa90bb32 tempest-VolumesActionsTest-1859311328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:45:51 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-13837bde-0c5b-48a5-af4b-4ca5fa90bb32 tempest-VolumesActionsTest-1859311328 None] Flow 'volume_create_manager' (16e4446e-13c1-401d-833b-5b44b60b172e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:45:51 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-13837bde-0c5b-48a5-af4b-4ca5fa90bb32 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09132725-7742-4f41-ab1f-f3e4cff26e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:51 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-13837bde-0c5b-48a5-af4b-4ca5fa90bb32 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09132725-7742-4f41-ab1f-f3e4cff26e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:45:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1153356740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a93e941-b0d1-4d7d-ac60-22516c657946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e473aa21b6f49e7820aedf7019901f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:45:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:45:51Z,use_quota=True,user_id='d61bef3a50fe4493806c662def909a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:51 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-13837bde-0c5b-48a5-af4b-4ca5fa90bb32 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acde1f0f-0d57-41fe-a004-904005f9d9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:51 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-13837bde-0c5b-48a5-af4b-4ca5fa90bb32 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acde1f0f-0d57-41fe-a004-904005f9d9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:51 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-13837bde-0c5b-48a5-af4b-4ca5fa90bb32 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecb46024-c594-4225-b79b-2792b06a3712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:51 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-13837bde-0c5b-48a5-af4b-4ca5fa90bb32 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecb46024-c594-4225-b79b-2792b06a3712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a93e941-b0d1-4d7d-ac60-22516c657946', 'volume_name': 'volume-1a93e941-b0d1-4d7d-ac60-22516c657946', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:51 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-13837bde-0c5b-48a5-af4b-4ca5fa90bb32 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ca11b3-b0c0-427a-a8c6-c25b09be0013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:51 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-13837bde-0c5b-48a5-af4b-4ca5fa90bb32 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ca11b3-b0c0-427a-a8c6-c25b09be0013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:51 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-13837bde-0c5b-48a5-af4b-4ca5fa90bb32 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb19d8b-004e-4618-969d-9443440fc836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:51 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-13837bde-0c5b-48a5-af4b-4ca5fa90bb32 tempest-VolumesActionsTest-1859311328 None] Volume 1a93e941-b0d1-4d7d-ac60-22516c657946: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a93e941-b0d1-4d7d-ac60-22516c657946', 'volume_size': 1} Jul 08 01:45:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-13837bde-0c5b-48a5-af4b-4ca5fa90bb32 tempest-VolumesActionsTest-1859311328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-13837bde-0c5b-48a5-af4b-4ca5fa90bb32 tempest-VolumesActionsTest-1859311328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:51 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-13837bde-0c5b-48a5-af4b-4ca5fa90bb32 tempest-VolumesActionsTest-1859311328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:45:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1153356740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a93e941-b0d1-4d7d-ac60-22516c657946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e473aa21b6f49e7820aedf7019901f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:45:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:45:51Z,use_quota=True,user_id='d61bef3a50fe4493806c662def909a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:45:51 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-13837bde-0c5b-48a5-af4b-4ca5fa90bb32 tempest-VolumesActionsTest-1859311328 None] Creating volume 1a93e941-b0d1-4d7d-ac60-22516c657946 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:45:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-13837bde-0c5b-48a5-af4b-4ca5fa90bb32 tempest-VolumesActionsTest-1859311328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-13837bde-0c5b-48a5-af4b-4ca5fa90bb32 tempest-VolumesActionsTest-1859311328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:51 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-13837bde-0c5b-48a5-af4b-4ca5fa90bb32 tempest-VolumesActionsTest-1859311328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:45:51 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-13837bde-0c5b-48a5-af4b-4ca5fa90bb32 tempest-VolumesActionsTest-1859311328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:45:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-13837bde-0c5b-48a5-af4b-4ca5fa90bb32 tempest-VolumesActionsTest-1859311328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:51 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-13837bde-0c5b-48a5-af4b-4ca5fa90bb32 tempest-VolumesActionsTest-1859311328 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:45:51 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-13837bde-0c5b-48a5-af4b-4ca5fa90bb32 tempest-VolumesActionsTest-1859311328 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:45:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-13837bde-0c5b-48a5-af4b-4ca5fa90bb32 tempest-VolumesActionsTest-1859311328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1a93e941-b0d1-4d7d-ac60-22516c657946 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:51 devstack sudo[99694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1a93e941-b0d1-4d7d-ac60-22516c657946 1073741824 Jul 08 01:45:51 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:52 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-13837bde-0c5b-48a5-af4b-4ca5fa90bb32 tempest-VolumesActionsTest-1859311328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1a93e941-b0d1-4d7d-ac60-22516c657946 1073741824" returned: 0 in 0.864s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-13837bde-0c5b-48a5-af4b-4ca5fa90bb32 tempest-VolumesActionsTest-1859311328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1a93e941-b0d1-4d7d-ac60-22516c657946 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:52 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1a93e941-b0d1-4d7d-ac60-22516c657946 Jul 08 01:45:52 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:52 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-13837bde-0c5b-48a5-af4b-4ca5fa90bb32 tempest-VolumesActionsTest-1859311328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1a93e941-b0d1-4d7d-ac60-22516c657946" returned: 0 in 0.641s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-13837bde-0c5b-48a5-af4b-4ca5fa90bb32 tempest-VolumesActionsTest-1859311328 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:45:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-13837bde-0c5b-48a5-af4b-4ca5fa90bb32 tempest-VolumesActionsTest-1859311328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:52 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-13837bde-0c5b-48a5-af4b-4ca5fa90bb32 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb19d8b-004e-4618-969d-9443440fc836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a93e941-b0d1-4d7d-ac60-22516c657946', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:52 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-13837bde-0c5b-48a5-af4b-4ca5fa90bb32 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbecdf1b-f52a-47cb-96f8-7b46dc6f9af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:52 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-13837bde-0c5b-48a5-af4b-4ca5fa90bb32 tempest-VolumesActionsTest-1859311328 None] Volume volume-1a93e941-b0d1-4d7d-ac60-22516c657946 (1a93e941-b0d1-4d7d-ac60-22516c657946): created successfully Jul 08 01:45:52 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-13837bde-0c5b-48a5-af4b-4ca5fa90bb32 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbecdf1b-f52a-47cb-96f8-7b46dc6f9af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:52 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-13837bde-0c5b-48a5-af4b-4ca5fa90bb32 tempest-VolumesActionsTest-1859311328 None] Flow 'volume_create_manager' (16e4446e-13c1-401d-833b-5b44b60b172e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:45:52 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-13837bde-0c5b-48a5-af4b-4ca5fa90bb32 tempest-VolumesActionsTest-1859311328 None] Created volume successfully. Jul 08 01:45:53 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-8d93b582-d9f5-4112-9108-cbda8ead998f tempest-VolumesActionsTest-1984105427 None] Acquiring lock "cinder-1a93e941-b0d1-4d7d-ac60-22516c657946-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:53 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-8d93b582-d9f5-4112-9108-cbda8ead998f tempest-VolumesActionsTest-1984105427 None] Lock "cinder-1a93e941-b0d1-4d7d-ac60-22516c657946-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:53 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-8d93b582-d9f5-4112-9108-cbda8ead998f tempest-VolumesActionsTest-1984105427 None] Acquiring lock "cinder-quobyte-1a93e941-b0d1-4d7d-ac60-22516c657946" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:53 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-8d93b582-d9f5-4112-9108-cbda8ead998f tempest-VolumesActionsTest-1984105427 None] Lock "cinder-quobyte-1a93e941-b0d1-4d7d-ac60-22516c657946" acquired by "delete_volume" :: waited 0.025s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:53 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fc3094-1dcc-4e46-a22d-3d7d57470310]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:45:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8d93b582-d9f5-4112-9108-cbda8ead998f tempest-VolumesActionsTest-1984105427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1a93e941-b0d1-4d7d-ac60-22516c657946 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:53 devstack sudo[99702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1a93e941-b0d1-4d7d-ac60-22516c657946 Jul 08 01:45:53 devstack sudo[99702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:54 devstack sudo[99702]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8d93b582-d9f5-4112-9108-cbda8ead998f tempest-VolumesActionsTest-1984105427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1a93e941-b0d1-4d7d-ac60-22516c657946" returned: 0 in 0.817s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8d93b582-d9f5-4112-9108-cbda8ead998f tempest-VolumesActionsTest-1984105427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1a93e941-b0d1-4d7d-ac60-22516c657946 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:54 devstack sudo[99707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1a93e941-b0d1-4d7d-ac60-22516c657946 Jul 08 01:45:54 devstack sudo[99707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:54 devstack sudo[99707]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8d93b582-d9f5-4112-9108-cbda8ead998f tempest-VolumesActionsTest-1984105427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1a93e941-b0d1-4d7d-ac60-22516c657946" returned: 0 in 0.707s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:54 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-8d93b582-d9f5-4112-9108-cbda8ead998f tempest-VolumesActionsTest-1984105427 None] Lock "cinder-quobyte-1a93e941-b0d1-4d7d-ac60-22516c657946" released by "delete_volume" :: held 1.573s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:55 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-8d93b582-d9f5-4112-9108-cbda8ead998f tempest-VolumesActionsTest-1984105427 None] Created reservations ['d6fd1466-f8bc-41e6-ad03-ec1596c840b5', 'f661bfa0-075d-4023-aed2-cb03f99e690c', 'f33f33df-b0c8-4e13-81ae-06635174134a', 'b9bebb30-ca0c-4228-be05-a80204cca5f2'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:45:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8d93b582-d9f5-4112-9108-cbda8ead998f tempest-VolumesActionsTest-1984105427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8d93b582-d9f5-4112-9108-cbda8ead998f tempest-VolumesActionsTest-1984105427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-8d93b582-d9f5-4112-9108-cbda8ead998f tempest-VolumesActionsTest-1984105427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:45:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-8d93b582-d9f5-4112-9108-cbda8ead998f tempest-VolumesActionsTest-1984105427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:45:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8d93b582-d9f5-4112-9108-cbda8ead998f tempest-VolumesActionsTest-1984105427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8d93b582-d9f5-4112-9108-cbda8ead998f tempest-VolumesActionsTest-1984105427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:55 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:45:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:45:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:45:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:55 devstack sudo[99711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:45:55 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:55 devstack sudo[99713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:45:55 devstack sudo[99713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:56 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8d93b582-d9f5-4112-9108-cbda8ead998f tempest-VolumesActionsTest-1984105427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.008s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:56 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-8d93b582-d9f5-4112-9108-cbda8ead998f tempest-VolumesActionsTest-1984105427 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:45:56 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-8d93b582-d9f5-4112-9108-cbda8ead998f tempest-VolumesActionsTest-1984105427 None] Deleted volume successfully. Jul 08 01:45:56 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-8d93b582-d9f5-4112-9108-cbda8ead998f tempest-VolumesActionsTest-1984105427 None] Lock "cinder-1a93e941-b0d1-4d7d-ac60-22516c657946-delete_volume" released by "delete_volume" :: held 2.890s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:56 devstack sudo[99713]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.047s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:56 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:45:56 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager._thread_info {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:45:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread count: 29 {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:45:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread info: [<_MainThread(MainThread, started 127058402500736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:45:56 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-f23794c8-8684-4ba5-9dd2-296488c94f13 tempest-VolumesActionsTest-1859311328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:45:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f23794c8-8684-4ba5-9dd2-296488c94f13 tempest-VolumesActionsTest-1859311328 None] Flow 'volume_create_manager' (5f29915f-d124-45ec-ab8e-f545fc08f9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:45:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f23794c8-8684-4ba5-9dd2-296488c94f13 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5691e451-561e-40f7-a2d3-8d4496abc3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f23794c8-8684-4ba5-9dd2-296488c94f13 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5691e451-561e-40f7-a2d3-8d4496abc3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:45:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1281375762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e55c22-de73-4c34-bbd6-7f6c48cfa3b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e473aa21b6f49e7820aedf7019901f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:45:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:45:56Z,use_quota=True,user_id='d61bef3a50fe4493806c662def909a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f23794c8-8684-4ba5-9dd2-296488c94f13 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bacedac5-e108-4652-8047-166271f26adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f23794c8-8684-4ba5-9dd2-296488c94f13 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bacedac5-e108-4652-8047-166271f26adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f23794c8-8684-4ba5-9dd2-296488c94f13 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cb096bf-8e61-4562-9b16-6bad2f77c3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f23794c8-8684-4ba5-9dd2-296488c94f13 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cb096bf-8e61-4562-9b16-6bad2f77c3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2e55c22-de73-4c34-bbd6-7f6c48cfa3b4', 'volume_name': 'volume-a2e55c22-de73-4c34-bbd6-7f6c48cfa3b4', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f23794c8-8684-4ba5-9dd2-296488c94f13 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60278bcb-1d23-4e96-ac18-70fd269893f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f23794c8-8684-4ba5-9dd2-296488c94f13 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60278bcb-1d23-4e96-ac18-70fd269893f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f23794c8-8684-4ba5-9dd2-296488c94f13 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (744c266b-6ff5-4a1c-81d4-af21b29dec91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:56 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-f23794c8-8684-4ba5-9dd2-296488c94f13 tempest-VolumesActionsTest-1859311328 None] Volume a2e55c22-de73-4c34-bbd6-7f6c48cfa3b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2e55c22-de73-4c34-bbd6-7f6c48cfa3b4', 'volume_size': 1} Jul 08 01:45:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f23794c8-8684-4ba5-9dd2-296488c94f13 tempest-VolumesActionsTest-1859311328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f23794c8-8684-4ba5-9dd2-296488c94f13 tempest-VolumesActionsTest-1859311328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:56 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f23794c8-8684-4ba5-9dd2-296488c94f13 tempest-VolumesActionsTest-1859311328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:45:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1281375762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e55c22-de73-4c34-bbd6-7f6c48cfa3b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e473aa21b6f49e7820aedf7019901f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:45:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:45:56Z,use_quota=True,user_id='d61bef3a50fe4493806c662def909a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:45:56 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-f23794c8-8684-4ba5-9dd2-296488c94f13 tempest-VolumesActionsTest-1859311328 None] Creating volume a2e55c22-de73-4c34-bbd6-7f6c48cfa3b4 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:45:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f23794c8-8684-4ba5-9dd2-296488c94f13 tempest-VolumesActionsTest-1859311328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f23794c8-8684-4ba5-9dd2-296488c94f13 tempest-VolumesActionsTest-1859311328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:56 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f23794c8-8684-4ba5-9dd2-296488c94f13 tempest-VolumesActionsTest-1859311328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:45:56 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f23794c8-8684-4ba5-9dd2-296488c94f13 tempest-VolumesActionsTest-1859311328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:45:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f23794c8-8684-4ba5-9dd2-296488c94f13 tempest-VolumesActionsTest-1859311328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:56 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f23794c8-8684-4ba5-9dd2-296488c94f13 tempest-VolumesActionsTest-1859311328 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:45:56 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-f23794c8-8684-4ba5-9dd2-296488c94f13 tempest-VolumesActionsTest-1859311328 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:45:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f23794c8-8684-4ba5-9dd2-296488c94f13 tempest-VolumesActionsTest-1859311328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a2e55c22-de73-4c34-bbd6-7f6c48cfa3b4 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:56 devstack sudo[99753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a2e55c22-de73-4c34-bbd6-7f6c48cfa3b4 1073741824 Jul 08 01:45:56 devstack sudo[99753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:57 devstack sudo[99753]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f23794c8-8684-4ba5-9dd2-296488c94f13 tempest-VolumesActionsTest-1859311328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a2e55c22-de73-4c34-bbd6-7f6c48cfa3b4 1073741824" returned: 0 in 0.899s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f23794c8-8684-4ba5-9dd2-296488c94f13 tempest-VolumesActionsTest-1859311328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a2e55c22-de73-4c34-bbd6-7f6c48cfa3b4 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:57 devstack sudo[99759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a2e55c22-de73-4c34-bbd6-7f6c48cfa3b4 Jul 08 01:45:57 devstack sudo[99759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:58 devstack sudo[99759]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f23794c8-8684-4ba5-9dd2-296488c94f13 tempest-VolumesActionsTest-1859311328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a2e55c22-de73-4c34-bbd6-7f6c48cfa3b4" returned: 0 in 0.651s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:58 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f23794c8-8684-4ba5-9dd2-296488c94f13 tempest-VolumesActionsTest-1859311328 None] <== create_volume: return (1599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:45:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f23794c8-8684-4ba5-9dd2-296488c94f13 tempest-VolumesActionsTest-1859311328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f23794c8-8684-4ba5-9dd2-296488c94f13 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (744c266b-6ff5-4a1c-81d4-af21b29dec91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2e55c22-de73-4c34-bbd6-7f6c48cfa3b4', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f23794c8-8684-4ba5-9dd2-296488c94f13 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70729886-92a6-46f5-923e-882b90fe83c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:58 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-f23794c8-8684-4ba5-9dd2-296488c94f13 tempest-VolumesActionsTest-1859311328 None] Volume volume-a2e55c22-de73-4c34-bbd6-7f6c48cfa3b4 (a2e55c22-de73-4c34-bbd6-7f6c48cfa3b4): created successfully Jul 08 01:45:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f23794c8-8684-4ba5-9dd2-296488c94f13 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70729886-92a6-46f5-923e-882b90fe83c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f23794c8-8684-4ba5-9dd2-296488c94f13 tempest-VolumesActionsTest-1859311328 None] Flow 'volume_create_manager' (5f29915f-d124-45ec-ab8e-f545fc08f9ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:45:58 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-f23794c8-8684-4ba5-9dd2-296488c94f13 tempest-VolumesActionsTest-1859311328 None] Created volume successfully. Jul 08 01:45:58 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-091af309-ff5c-4890-94ac-989bf3a24977 tempest-VolumesActionsTest-1984105427 None] Acquiring lock "cinder-a2e55c22-de73-4c34-bbd6-7f6c48cfa3b4-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:58 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-091af309-ff5c-4890-94ac-989bf3a24977 tempest-VolumesActionsTest-1984105427 None] Lock "cinder-a2e55c22-de73-4c34-bbd6-7f6c48cfa3b4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:58 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-091af309-ff5c-4890-94ac-989bf3a24977 tempest-VolumesActionsTest-1984105427 None] Acquiring lock "cinder-quobyte-a2e55c22-de73-4c34-bbd6-7f6c48cfa3b4" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:58 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-091af309-ff5c-4890-94ac-989bf3a24977 tempest-VolumesActionsTest-1984105427 None] Lock "cinder-quobyte-a2e55c22-de73-4c34-bbd6-7f6c48cfa3b4" acquired by "delete_volume" :: waited 0.017s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:58 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[adebd7a9-c403-4f7b-9b7a-bfe1e167f973]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:45:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-091af309-ff5c-4890-94ac-989bf3a24977 tempest-VolumesActionsTest-1984105427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a2e55c22-de73-4c34-bbd6-7f6c48cfa3b4 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:58 devstack sudo[99764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a2e55c22-de73-4c34-bbd6-7f6c48cfa3b4 Jul 08 01:45:58 devstack sudo[99764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:59 devstack sudo[99764]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-091af309-ff5c-4890-94ac-989bf3a24977 tempest-VolumesActionsTest-1984105427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a2e55c22-de73-4c34-bbd6-7f6c48cfa3b4" returned: 0 in 0.789s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-091af309-ff5c-4890-94ac-989bf3a24977 tempest-VolumesActionsTest-1984105427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a2e55c22-de73-4c34-bbd6-7f6c48cfa3b4 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:59 devstack sudo[99769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a2e55c22-de73-4c34-bbd6-7f6c48cfa3b4 Jul 08 01:45:59 devstack sudo[99769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:00 devstack sudo[99769]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-091af309-ff5c-4890-94ac-989bf3a24977 tempest-VolumesActionsTest-1984105427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a2e55c22-de73-4c34-bbd6-7f6c48cfa3b4" returned: 0 in 0.733s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:00 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-091af309-ff5c-4890-94ac-989bf3a24977 tempest-VolumesActionsTest-1984105427 None] Lock "cinder-quobyte-a2e55c22-de73-4c34-bbd6-7f6c48cfa3b4" released by "delete_volume" :: held 1.562s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:00 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-091af309-ff5c-4890-94ac-989bf3a24977 tempest-VolumesActionsTest-1984105427 None] Created reservations ['beaec496-430a-43ee-8d19-83824a45829f', '496b56ad-91ad-45b0-8bf4-24f5e1fcd648', '62685b33-6f1a-412d-b668-ea8b6efa7d14', 'acb5a892-b31a-4786-8644-0e5ab489def0'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:46:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-091af309-ff5c-4890-94ac-989bf3a24977 tempest-VolumesActionsTest-1984105427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-091af309-ff5c-4890-94ac-989bf3a24977 tempest-VolumesActionsTest-1984105427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-091af309-ff5c-4890-94ac-989bf3a24977 tempest-VolumesActionsTest-1984105427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-091af309-ff5c-4890-94ac-989bf3a24977 tempest-VolumesActionsTest-1984105427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-091af309-ff5c-4890-94ac-989bf3a24977 tempest-VolumesActionsTest-1984105427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-091af309-ff5c-4890-94ac-989bf3a24977 tempest-VolumesActionsTest-1984105427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:00 devstack sudo[99772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:46:00 devstack sudo[99772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:01 devstack sudo[99772]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-091af309-ff5c-4890-94ac-989bf3a24977 tempest-VolumesActionsTest-1984105427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.670s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:01 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-091af309-ff5c-4890-94ac-989bf3a24977 tempest-VolumesActionsTest-1984105427 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:46:01 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-091af309-ff5c-4890-94ac-989bf3a24977 tempest-VolumesActionsTest-1984105427 None] Deleted volume successfully. Jul 08 01:46:01 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-091af309-ff5c-4890-94ac-989bf3a24977 tempest-VolumesActionsTest-1984105427 None] Lock "cinder-a2e55c22-de73-4c34-bbd6-7f6c48cfa3b4-delete_volume" released by "delete_volume" :: held 2.449s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:01 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf71f4d5-8ad9-4fbf-8984-57a2928f82d5 tempest-VolumesActionsTest-1859311328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:46:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-bf71f4d5-8ad9-4fbf-8984-57a2928f82d5 tempest-VolumesActionsTest-1859311328 None] Flow 'volume_create_manager' (62664d3c-6565-4537-9054-387f98b90afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-bf71f4d5-8ad9-4fbf-8984-57a2928f82d5 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57ea2df8-c738-4c1f-be4b-482159f96d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-bf71f4d5-8ad9-4fbf-8984-57a2928f82d5 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57ea2df8-c738-4c1f-be4b-482159f96d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2064056249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cd9319c-6d66-4c29-ae84-42ea06240a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e473aa21b6f49e7820aedf7019901f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:01Z,use_quota=True,user_id='d61bef3a50fe4493806c662def909a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-bf71f4d5-8ad9-4fbf-8984-57a2928f82d5 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18b043ec-b14a-405a-a4be-0dfa2fa6983c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-bf71f4d5-8ad9-4fbf-8984-57a2928f82d5 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18b043ec-b14a-405a-a4be-0dfa2fa6983c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-bf71f4d5-8ad9-4fbf-8984-57a2928f82d5 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adf1e37f-6677-4921-995d-7a863e67294f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-bf71f4d5-8ad9-4fbf-8984-57a2928f82d5 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adf1e37f-6677-4921-995d-7a863e67294f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cd9319c-6d66-4c29-ae84-42ea06240a58', 'volume_name': 'volume-5cd9319c-6d66-4c29-ae84-42ea06240a58', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-bf71f4d5-8ad9-4fbf-8984-57a2928f82d5 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b1b4c0f-4d69-4b91-8ef1-898987c2b2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-bf71f4d5-8ad9-4fbf-8984-57a2928f82d5 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b1b4c0f-4d69-4b91-8ef1-898987c2b2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-bf71f4d5-8ad9-4fbf-8984-57a2928f82d5 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbf9efb5-328a-4227-b1c8-c62f4be791da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:01 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-bf71f4d5-8ad9-4fbf-8984-57a2928f82d5 tempest-VolumesActionsTest-1859311328 None] Volume 5cd9319c-6d66-4c29-ae84-42ea06240a58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cd9319c-6d66-4c29-ae84-42ea06240a58', 'volume_size': 1} Jul 08 01:46:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-bf71f4d5-8ad9-4fbf-8984-57a2928f82d5 tempest-VolumesActionsTest-1859311328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-bf71f4d5-8ad9-4fbf-8984-57a2928f82d5 tempest-VolumesActionsTest-1859311328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:01 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-bf71f4d5-8ad9-4fbf-8984-57a2928f82d5 tempest-VolumesActionsTest-1859311328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2064056249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cd9319c-6d66-4c29-ae84-42ea06240a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e473aa21b6f49e7820aedf7019901f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:01Z,use_quota=True,user_id='d61bef3a50fe4493806c662def909a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:46:01 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-bf71f4d5-8ad9-4fbf-8984-57a2928f82d5 tempest-VolumesActionsTest-1859311328 None] Creating volume 5cd9319c-6d66-4c29-ae84-42ea06240a58 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:46:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-bf71f4d5-8ad9-4fbf-8984-57a2928f82d5 tempest-VolumesActionsTest-1859311328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-bf71f4d5-8ad9-4fbf-8984-57a2928f82d5 tempest-VolumesActionsTest-1859311328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:01 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-bf71f4d5-8ad9-4fbf-8984-57a2928f82d5 tempest-VolumesActionsTest-1859311328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:01 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-bf71f4d5-8ad9-4fbf-8984-57a2928f82d5 tempest-VolumesActionsTest-1859311328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-bf71f4d5-8ad9-4fbf-8984-57a2928f82d5 tempest-VolumesActionsTest-1859311328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:01 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-bf71f4d5-8ad9-4fbf-8984-57a2928f82d5 tempest-VolumesActionsTest-1859311328 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:46:01 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-bf71f4d5-8ad9-4fbf-8984-57a2928f82d5 tempest-VolumesActionsTest-1859311328 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:46:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-bf71f4d5-8ad9-4fbf-8984-57a2928f82d5 tempest-VolumesActionsTest-1859311328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5cd9319c-6d66-4c29-ae84-42ea06240a58 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:01 devstack sudo[99776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5cd9319c-6d66-4c29-ae84-42ea06240a58 1073741824 Jul 08 01:46:01 devstack sudo[99776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:02 devstack sudo[99776]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-bf71f4d5-8ad9-4fbf-8984-57a2928f82d5 tempest-VolumesActionsTest-1859311328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5cd9319c-6d66-4c29-ae84-42ea06240a58 1073741824" returned: 0 in 0.876s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-bf71f4d5-8ad9-4fbf-8984-57a2928f82d5 tempest-VolumesActionsTest-1859311328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5cd9319c-6d66-4c29-ae84-42ea06240a58 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:02 devstack sudo[99782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5cd9319c-6d66-4c29-ae84-42ea06240a58 Jul 08 01:46:02 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:03 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-bf71f4d5-8ad9-4fbf-8984-57a2928f82d5 tempest-VolumesActionsTest-1859311328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5cd9319c-6d66-4c29-ae84-42ea06240a58" returned: 0 in 0.713s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:03 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-bf71f4d5-8ad9-4fbf-8984-57a2928f82d5 tempest-VolumesActionsTest-1859311328 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:46:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-bf71f4d5-8ad9-4fbf-8984-57a2928f82d5 tempest-VolumesActionsTest-1859311328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-bf71f4d5-8ad9-4fbf-8984-57a2928f82d5 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbf9efb5-328a-4227-b1c8-c62f4be791da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cd9319c-6d66-4c29-ae84-42ea06240a58', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-bf71f4d5-8ad9-4fbf-8984-57a2928f82d5 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4953b4d5-a772-444a-aad1-5f27b369c34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:03 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-bf71f4d5-8ad9-4fbf-8984-57a2928f82d5 tempest-VolumesActionsTest-1859311328 None] Volume volume-5cd9319c-6d66-4c29-ae84-42ea06240a58 (5cd9319c-6d66-4c29-ae84-42ea06240a58): created successfully Jul 08 01:46:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-bf71f4d5-8ad9-4fbf-8984-57a2928f82d5 tempest-VolumesActionsTest-1859311328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4953b4d5-a772-444a-aad1-5f27b369c34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-bf71f4d5-8ad9-4fbf-8984-57a2928f82d5 tempest-VolumesActionsTest-1859311328 None] Flow 'volume_create_manager' (62664d3c-6565-4537-9054-387f98b90afe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:03 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-bf71f4d5-8ad9-4fbf-8984-57a2928f82d5 tempest-VolumesActionsTest-1859311328 None] Created volume successfully. Jul 08 01:46:04 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-fb84f36b-66b8-4d95-95ac-ae9e8384034b tempest-VolumesActionsTest-1859311328 None] Acquiring lock "cinder-5cd9319c-6d66-4c29-ae84-42ea06240a58-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:04 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-fb84f36b-66b8-4d95-95ac-ae9e8384034b tempest-VolumesActionsTest-1859311328 None] Lock "cinder-5cd9319c-6d66-4c29-ae84-42ea06240a58-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:04 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-fb84f36b-66b8-4d95-95ac-ae9e8384034b tempest-VolumesActionsTest-1859311328 None] Acquiring lock "cinder-quobyte-5cd9319c-6d66-4c29-ae84-42ea06240a58" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:04 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-fb84f36b-66b8-4d95-95ac-ae9e8384034b tempest-VolumesActionsTest-1859311328 None] Lock "cinder-quobyte-5cd9319c-6d66-4c29-ae84-42ea06240a58" acquired by "delete_volume" :: waited 0.017s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:04 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e0d86f-68c8-45f1-b5ae-c057d8b3463b]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-fb84f36b-66b8-4d95-95ac-ae9e8384034b tempest-VolumesActionsTest-1859311328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5cd9319c-6d66-4c29-ae84-42ea06240a58 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:04 devstack sudo[99785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5cd9319c-6d66-4c29-ae84-42ea06240a58 Jul 08 01:46:04 devstack sudo[99785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:05 devstack sudo[99785]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-fb84f36b-66b8-4d95-95ac-ae9e8384034b tempest-VolumesActionsTest-1859311328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5cd9319c-6d66-4c29-ae84-42ea06240a58" returned: 0 in 0.821s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-fb84f36b-66b8-4d95-95ac-ae9e8384034b tempest-VolumesActionsTest-1859311328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5cd9319c-6d66-4c29-ae84-42ea06240a58 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:05 devstack sudo[99791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5cd9319c-6d66-4c29-ae84-42ea06240a58 Jul 08 01:46:05 devstack sudo[99791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:05 devstack sudo[99791]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-fb84f36b-66b8-4d95-95ac-ae9e8384034b tempest-VolumesActionsTest-1859311328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-5cd9319c-6d66-4c29-ae84-42ea06240a58" returned: 0 in 0.737s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:05 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-fb84f36b-66b8-4d95-95ac-ae9e8384034b tempest-VolumesActionsTest-1859311328 None] Lock "cinder-quobyte-5cd9319c-6d66-4c29-ae84-42ea06240a58" released by "delete_volume" :: held 1.601s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:05 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-fb84f36b-66b8-4d95-95ac-ae9e8384034b tempest-VolumesActionsTest-1859311328 None] Created reservations ['7cff928a-c140-498e-8ad0-89eeb7e97113', '8bc8c2e9-427c-43e7-9051-964841bb1315', 'ed044c6e-eb81-4db0-b9d9-54f60b84e585', '9273ecb2-b783-483d-b5aa-a8c287c232f1'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:46:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-fb84f36b-66b8-4d95-95ac-ae9e8384034b tempest-VolumesActionsTest-1859311328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-fb84f36b-66b8-4d95-95ac-ae9e8384034b tempest-VolumesActionsTest-1859311328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:06 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-fb84f36b-66b8-4d95-95ac-ae9e8384034b tempest-VolumesActionsTest-1859311328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:06 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-fb84f36b-66b8-4d95-95ac-ae9e8384034b tempest-VolumesActionsTest-1859311328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-fb84f36b-66b8-4d95-95ac-ae9e8384034b tempest-VolumesActionsTest-1859311328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-fb84f36b-66b8-4d95-95ac-ae9e8384034b tempest-VolumesActionsTest-1859311328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:06 devstack sudo[99796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:46:06 devstack sudo[99796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:06 devstack sudo[99796]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-fb84f36b-66b8-4d95-95ac-ae9e8384034b tempest-VolumesActionsTest-1859311328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.716s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:06 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-fb84f36b-66b8-4d95-95ac-ae9e8384034b tempest-VolumesActionsTest-1859311328 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:46:06 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-fb84f36b-66b8-4d95-95ac-ae9e8384034b tempest-VolumesActionsTest-1859311328 None] Deleted volume successfully. Jul 08 01:46:06 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-fb84f36b-66b8-4d95-95ac-ae9e8384034b tempest-VolumesActionsTest-1859311328 None] Lock "cinder-5cd9319c-6d66-4c29-ae84-42ea06240a58-delete_volume" released by "delete_volume" :: held 2.614s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:07 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae99b0f1-c0dc-42c4-9188-7fc8bb630ad1 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:46:07 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ae99b0f1-c0dc-42c4-9188-7fc8bb630ad1 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Flow 'volume_create_manager' (0718726e-ce51-46bc-a2b0-76686b7dd41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:07 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ae99b0f1-c0dc-42c4-9188-7fc8bb630ad1 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8665eca2-e173-41ae-ad68-0089b14d0db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:07 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ae99b0f1-c0dc-42c4-9188-7fc8bb630ad1 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8665eca2-e173-41ae-ad68-0089b14d0db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-742620223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8691d08-95de-47f9-ba01-9a5e63bd459b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41df8118ebb1499588965fd0a8c0595d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:07Z,use_quota=True,user_id='cb53c44d43e44ec0acff923ed217e5f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:07 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ae99b0f1-c0dc-42c4-9188-7fc8bb630ad1 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (872dd745-9414-4cb7-ab38-de6475555fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:07 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ae99b0f1-c0dc-42c4-9188-7fc8bb630ad1 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (872dd745-9414-4cb7-ab38-de6475555fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:07 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ae99b0f1-c0dc-42c4-9188-7fc8bb630ad1 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f095c1d6-006c-4647-8e19-6d22ff95ef9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:07 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ae99b0f1-c0dc-42c4-9188-7fc8bb630ad1 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f095c1d6-006c-4647-8e19-6d22ff95ef9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8691d08-95de-47f9-ba01-9a5e63bd459b', 'volume_name': 'volume-a8691d08-95de-47f9-ba01-9a5e63bd459b', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:07 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ae99b0f1-c0dc-42c4-9188-7fc8bb630ad1 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84b9a4e8-3e40-440a-94c5-583054eeb176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:07 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ae99b0f1-c0dc-42c4-9188-7fc8bb630ad1 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84b9a4e8-3e40-440a-94c5-583054eeb176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:07 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ae99b0f1-c0dc-42c4-9188-7fc8bb630ad1 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df35614f-15f8-4c73-a20d-aff28a8f3ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:07 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-ae99b0f1-c0dc-42c4-9188-7fc8bb630ad1 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Volume a8691d08-95de-47f9-ba01-9a5e63bd459b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8691d08-95de-47f9-ba01-9a5e63bd459b', 'volume_size': 1} Jul 08 01:46:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ae99b0f1-c0dc-42c4-9188-7fc8bb630ad1 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ae99b0f1-c0dc-42c4-9188-7fc8bb630ad1 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:07 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-ae99b0f1-c0dc-42c4-9188-7fc8bb630ad1 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-742620223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8691d08-95de-47f9-ba01-9a5e63bd459b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41df8118ebb1499588965fd0a8c0595d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:07Z,use_quota=True,user_id='cb53c44d43e44ec0acff923ed217e5f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:46:07 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-ae99b0f1-c0dc-42c4-9188-7fc8bb630ad1 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Creating volume a8691d08-95de-47f9-ba01-9a5e63bd459b {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:46:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ae99b0f1-c0dc-42c4-9188-7fc8bb630ad1 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ae99b0f1-c0dc-42c4-9188-7fc8bb630ad1 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:07 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-ae99b0f1-c0dc-42c4-9188-7fc8bb630ad1 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:07 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-ae99b0f1-c0dc-42c4-9188-7fc8bb630ad1 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ae99b0f1-c0dc-42c4-9188-7fc8bb630ad1 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:07 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-ae99b0f1-c0dc-42c4-9188-7fc8bb630ad1 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:46:07 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-ae99b0f1-c0dc-42c4-9188-7fc8bb630ad1 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:46:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae99b0f1-c0dc-42c4-9188-7fc8bb630ad1 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8691d08-95de-47f9-ba01-9a5e63bd459b 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:07 devstack sudo[99801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8691d08-95de-47f9-ba01-9a5e63bd459b 1073741824 Jul 08 01:46:07 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:08 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae99b0f1-c0dc-42c4-9188-7fc8bb630ad1 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8691d08-95de-47f9-ba01-9a5e63bd459b 1073741824" returned: 0 in 0.936s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae99b0f1-c0dc-42c4-9188-7fc8bb630ad1 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8691d08-95de-47f9-ba01-9a5e63bd459b {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:08 devstack sudo[99808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8691d08-95de-47f9-ba01-9a5e63bd459b Jul 08 01:46:08 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:09 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae99b0f1-c0dc-42c4-9188-7fc8bb630ad1 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8691d08-95de-47f9-ba01-9a5e63bd459b" returned: 0 in 0.729s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:09 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-ae99b0f1-c0dc-42c4-9188-7fc8bb630ad1 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:46:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ae99b0f1-c0dc-42c4-9188-7fc8bb630ad1 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:09 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ae99b0f1-c0dc-42c4-9188-7fc8bb630ad1 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df35614f-15f8-4c73-a20d-aff28a8f3ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8691d08-95de-47f9-ba01-9a5e63bd459b', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:09 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ae99b0f1-c0dc-42c4-9188-7fc8bb630ad1 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (158a6988-4453-48bc-9fd9-e888b2d97592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:09 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-ae99b0f1-c0dc-42c4-9188-7fc8bb630ad1 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Volume volume-a8691d08-95de-47f9-ba01-9a5e63bd459b (a8691d08-95de-47f9-ba01-9a5e63bd459b): created successfully Jul 08 01:46:09 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ae99b0f1-c0dc-42c4-9188-7fc8bb630ad1 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (158a6988-4453-48bc-9fd9-e888b2d97592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:09 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ae99b0f1-c0dc-42c4-9188-7fc8bb630ad1 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Flow 'volume_create_manager' (0718726e-ce51-46bc-a2b0-76686b7dd41c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:09 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-ae99b0f1-c0dc-42c4-9188-7fc8bb630ad1 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Created volume successfully. Jul 08 01:46:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-1bfeca50-ea7a-4376-859d-181593b959f9 req-33f7ae13-3d49-466a-9ddb-7b0d11a39df5 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-1bfeca50-ea7a-4376-859d-181593b959f9 req-33f7ae13-3d49-466a-9ddb-7b0d11a39df5 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:12 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a34901-4ea0-4bed-a475-ae15de59d53b]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-1bfeca50-ea7a-4376-859d-181593b959f9 req-33f7ae13-3d49-466a-9ddb-7b0d11a39df5 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8691d08-95de-47f9-ba01-9a5e63bd459b {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:12 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8691d08-95de-47f9-ba01-9a5e63bd459b Jul 08 01:46:12 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:13 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-1bfeca50-ea7a-4376-859d-181593b959f9 req-33f7ae13-3d49-466a-9ddb-7b0d11a39df5 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8691d08-95de-47f9-ba01-9a5e63bd459b" returned: 0 in 0.876s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-1bfeca50-ea7a-4376-859d-181593b959f9 req-33f7ae13-3d49-466a-9ddb-7b0d11a39df5 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.905s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-1bfeca50-ea7a-4376-859d-181593b959f9 req-33f7ae13-3d49-466a-9ddb-7b0d11a39df5 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96', 'name': 'volume-a8691d08-95de-47f9-ba01-9a5e63bd459b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0eb4c028-c881-4eeb-b195-171f0b4f5480', 'enforce_multipath': True} {{(pid=87284) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:46:13 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-1bfeca50-ea7a-4376-859d-181593b959f9 req-33f7ae13-3d49-466a-9ddb-7b0d11a39df5 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] attachment_update completed successfully. Jul 08 01:46:19 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-6603d1cb-ca97-4fa0-9120-77a2ddb40ade tempest-VolumesListAdminTestJSON-1053362266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:46:19 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6603d1cb-ca97-4fa0-9120-77a2ddb40ade tempest-VolumesListAdminTestJSON-1053362266 None] Flow 'volume_create_manager' (0849c0af-ae0e-47e4-8468-0dbb3c610b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:19 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6603d1cb-ca97-4fa0-9120-77a2ddb40ade tempest-VolumesListAdminTestJSON-1053362266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70017712-385c-4fc6-8e2f-ffa6f7ab385a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:19 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6603d1cb-ca97-4fa0-9120-77a2ddb40ade tempest-VolumesListAdminTestJSON-1053362266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70017712-385c-4fc6-8e2f-ffa6f7ab385a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-97818833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=085bc72b-e949-4e86-a883-620f01fcc9b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='412f7ff509674e0380608aa3ddc95b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:19Z,use_quota=True,user_id='2751bfaca4da4f05aa92c68fae7c45c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:19 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6603d1cb-ca97-4fa0-9120-77a2ddb40ade tempest-VolumesListAdminTestJSON-1053362266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22b0af4d-0bec-4213-9a63-a9ea6d1d38bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:19 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6603d1cb-ca97-4fa0-9120-77a2ddb40ade tempest-VolumesListAdminTestJSON-1053362266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22b0af4d-0bec-4213-9a63-a9ea6d1d38bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:19 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6603d1cb-ca97-4fa0-9120-77a2ddb40ade tempest-VolumesListAdminTestJSON-1053362266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02ffc7e8-0c06-4770-a000-59fdb3ef3148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:19 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6603d1cb-ca97-4fa0-9120-77a2ddb40ade tempest-VolumesListAdminTestJSON-1053362266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02ffc7e8-0c06-4770-a000-59fdb3ef3148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '085bc72b-e949-4e86-a883-620f01fcc9b3', 'volume_name': 'volume-085bc72b-e949-4e86-a883-620f01fcc9b3', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:19 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6603d1cb-ca97-4fa0-9120-77a2ddb40ade tempest-VolumesListAdminTestJSON-1053362266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1c72a88-d8f5-4d67-a4d7-14f4e5e4d10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:19 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6603d1cb-ca97-4fa0-9120-77a2ddb40ade tempest-VolumesListAdminTestJSON-1053362266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1c72a88-d8f5-4d67-a4d7-14f4e5e4d10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:19 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6603d1cb-ca97-4fa0-9120-77a2ddb40ade tempest-VolumesListAdminTestJSON-1053362266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9beae1a7-9c9e-41c5-bf1a-9d8ace01d23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:19 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-6603d1cb-ca97-4fa0-9120-77a2ddb40ade tempest-VolumesListAdminTestJSON-1053362266 None] Volume 085bc72b-e949-4e86-a883-620f01fcc9b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-085bc72b-e949-4e86-a883-620f01fcc9b3', 'volume_size': 1} Jul 08 01:46:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6603d1cb-ca97-4fa0-9120-77a2ddb40ade tempest-VolumesListAdminTestJSON-1053362266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6603d1cb-ca97-4fa0-9120-77a2ddb40ade tempest-VolumesListAdminTestJSON-1053362266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:19 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-6603d1cb-ca97-4fa0-9120-77a2ddb40ade tempest-VolumesListAdminTestJSON-1053362266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-97818833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=085bc72b-e949-4e86-a883-620f01fcc9b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='412f7ff509674e0380608aa3ddc95b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:19Z,use_quota=True,user_id='2751bfaca4da4f05aa92c68fae7c45c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:46:19 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-6603d1cb-ca97-4fa0-9120-77a2ddb40ade tempest-VolumesListAdminTestJSON-1053362266 None] Creating volume 085bc72b-e949-4e86-a883-620f01fcc9b3 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:46:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6603d1cb-ca97-4fa0-9120-77a2ddb40ade tempest-VolumesListAdminTestJSON-1053362266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6603d1cb-ca97-4fa0-9120-77a2ddb40ade tempest-VolumesListAdminTestJSON-1053362266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:19 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-6603d1cb-ca97-4fa0-9120-77a2ddb40ade tempest-VolumesListAdminTestJSON-1053362266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:19 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-6603d1cb-ca97-4fa0-9120-77a2ddb40ade tempest-VolumesListAdminTestJSON-1053362266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6603d1cb-ca97-4fa0-9120-77a2ddb40ade tempest-VolumesListAdminTestJSON-1053362266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:19 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-6603d1cb-ca97-4fa0-9120-77a2ddb40ade tempest-VolumesListAdminTestJSON-1053362266 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:46:19 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-6603d1cb-ca97-4fa0-9120-77a2ddb40ade tempest-VolumesListAdminTestJSON-1053362266 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:46:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6603d1cb-ca97-4fa0-9120-77a2ddb40ade tempest-VolumesListAdminTestJSON-1053362266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-085bc72b-e949-4e86-a883-620f01fcc9b3 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:19 devstack sudo[100215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-085bc72b-e949-4e86-a883-620f01fcc9b3 1073741824 Jul 08 01:46:19 devstack sudo[100215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:20 devstack sudo[100215]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6603d1cb-ca97-4fa0-9120-77a2ddb40ade tempest-VolumesListAdminTestJSON-1053362266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-085bc72b-e949-4e86-a883-620f01fcc9b3 1073741824" returned: 0 in 0.941s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6603d1cb-ca97-4fa0-9120-77a2ddb40ade tempest-VolumesListAdminTestJSON-1053362266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-085bc72b-e949-4e86-a883-620f01fcc9b3 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:20 devstack sudo[100221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-085bc72b-e949-4e86-a883-620f01fcc9b3 Jul 08 01:46:20 devstack sudo[100221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:20 devstack sudo[100221]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6603d1cb-ca97-4fa0-9120-77a2ddb40ade tempest-VolumesListAdminTestJSON-1053362266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-085bc72b-e949-4e86-a883-620f01fcc9b3" returned: 0 in 0.669s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:20 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-6603d1cb-ca97-4fa0-9120-77a2ddb40ade tempest-VolumesListAdminTestJSON-1053362266 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:46:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6603d1cb-ca97-4fa0-9120-77a2ddb40ade tempest-VolumesListAdminTestJSON-1053362266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.656s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:20 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6603d1cb-ca97-4fa0-9120-77a2ddb40ade tempest-VolumesListAdminTestJSON-1053362266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9beae1a7-9c9e-41c5-bf1a-9d8ace01d23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-085bc72b-e949-4e86-a883-620f01fcc9b3', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:20 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6603d1cb-ca97-4fa0-9120-77a2ddb40ade tempest-VolumesListAdminTestJSON-1053362266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6225fddd-56c8-4de4-816c-7d867d1d2f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:20 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-6603d1cb-ca97-4fa0-9120-77a2ddb40ade tempest-VolumesListAdminTestJSON-1053362266 None] Volume volume-085bc72b-e949-4e86-a883-620f01fcc9b3 (085bc72b-e949-4e86-a883-620f01fcc9b3): created successfully Jul 08 01:46:20 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6603d1cb-ca97-4fa0-9120-77a2ddb40ade tempest-VolumesListAdminTestJSON-1053362266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6225fddd-56c8-4de4-816c-7d867d1d2f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:20 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-6603d1cb-ca97-4fa0-9120-77a2ddb40ade tempest-VolumesListAdminTestJSON-1053362266 None] Flow 'volume_create_manager' (0849c0af-ae0e-47e4-8468-0dbb3c610b52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:20 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-6603d1cb-ca97-4fa0-9120-77a2ddb40ade tempest-VolumesListAdminTestJSON-1053362266 None] Created volume successfully. Jul 08 01:46:21 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-e0f01015-1aca-41e7-9371-ebd3fb683dc5 req-fe03411c-24b8-4ca5-b3b1-25d4a065e758 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Terminate volume connection completed successfully. Jul 08 01:46:21 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-e0f01015-1aca-41e7-9371-ebd3fb683dc5 req-fe03411c-24b8-4ca5-b3b1-25d4a065e758 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Deleting attachment 0eb4c028-c881-4eeb-b195-171f0b4f5480. {{(pid=87284) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:46:21 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3c94471-e63f-4251-8076-987413e51573 tempest-VolumesListAdminTestJSON-1053362266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:46:21 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c3c94471-e63f-4251-8076-987413e51573 tempest-VolumesListAdminTestJSON-1053362266 None] Flow 'volume_create_manager' (a265efbe-3229-483b-9e18-2717bebb0af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:21 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c3c94471-e63f-4251-8076-987413e51573 tempest-VolumesListAdminTestJSON-1053362266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b0e5012-385b-4901-bd9e-3c3af4aa4609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:21 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c3c94471-e63f-4251-8076-987413e51573 tempest-VolumesListAdminTestJSON-1053362266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b0e5012-385b-4901-bd9e-3c3af4aa4609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1328090111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=791c0fc9-bcd6-47d3-80b5-8c70a4290c86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='412f7ff509674e0380608aa3ddc95b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:22Z,use_quota=True,user_id='2751bfaca4da4f05aa92c68fae7c45c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:21 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c3c94471-e63f-4251-8076-987413e51573 tempest-VolumesListAdminTestJSON-1053362266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423f4653-1f5c-4fb8-a9da-c0bbd6ff7f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:21 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c3c94471-e63f-4251-8076-987413e51573 tempest-VolumesListAdminTestJSON-1053362266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423f4653-1f5c-4fb8-a9da-c0bbd6ff7f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:21 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c3c94471-e63f-4251-8076-987413e51573 tempest-VolumesListAdminTestJSON-1053362266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcea7e18-bf8c-45f2-a690-b9693e93ae18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:21 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c3c94471-e63f-4251-8076-987413e51573 tempest-VolumesListAdminTestJSON-1053362266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcea7e18-bf8c-45f2-a690-b9693e93ae18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '791c0fc9-bcd6-47d3-80b5-8c70a4290c86', 'volume_name': 'volume-791c0fc9-bcd6-47d3-80b5-8c70a4290c86', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:21 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c3c94471-e63f-4251-8076-987413e51573 tempest-VolumesListAdminTestJSON-1053362266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b5651e-0e0d-4542-9886-0c6a0cb3d83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:21 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c3c94471-e63f-4251-8076-987413e51573 tempest-VolumesListAdminTestJSON-1053362266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b5651e-0e0d-4542-9886-0c6a0cb3d83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:21 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c3c94471-e63f-4251-8076-987413e51573 tempest-VolumesListAdminTestJSON-1053362266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d42d905-05b2-4e1f-937a-5411356d1a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:21 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-c3c94471-e63f-4251-8076-987413e51573 tempest-VolumesListAdminTestJSON-1053362266 None] Volume 791c0fc9-bcd6-47d3-80b5-8c70a4290c86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-791c0fc9-bcd6-47d3-80b5-8c70a4290c86', 'volume_size': 1} Jul 08 01:46:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c3c94471-e63f-4251-8076-987413e51573 tempest-VolumesListAdminTestJSON-1053362266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c3c94471-e63f-4251-8076-987413e51573 tempest-VolumesListAdminTestJSON-1053362266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:21 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c3c94471-e63f-4251-8076-987413e51573 tempest-VolumesListAdminTestJSON-1053362266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1328090111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=791c0fc9-bcd6-47d3-80b5-8c70a4290c86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='412f7ff509674e0380608aa3ddc95b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:22Z,use_quota=True,user_id='2751bfaca4da4f05aa92c68fae7c45c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:46:21 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-c3c94471-e63f-4251-8076-987413e51573 tempest-VolumesListAdminTestJSON-1053362266 None] Creating volume 791c0fc9-bcd6-47d3-80b5-8c70a4290c86 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:46:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c3c94471-e63f-4251-8076-987413e51573 tempest-VolumesListAdminTestJSON-1053362266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c3c94471-e63f-4251-8076-987413e51573 tempest-VolumesListAdminTestJSON-1053362266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:21 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c3c94471-e63f-4251-8076-987413e51573 tempest-VolumesListAdminTestJSON-1053362266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:21 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c3c94471-e63f-4251-8076-987413e51573 tempest-VolumesListAdminTestJSON-1053362266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c3c94471-e63f-4251-8076-987413e51573 tempest-VolumesListAdminTestJSON-1053362266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:21 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c3c94471-e63f-4251-8076-987413e51573 tempest-VolumesListAdminTestJSON-1053362266 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:46:21 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-c3c94471-e63f-4251-8076-987413e51573 tempest-VolumesListAdminTestJSON-1053362266 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:46:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c3c94471-e63f-4251-8076-987413e51573 tempest-VolumesListAdminTestJSON-1053362266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-791c0fc9-bcd6-47d3-80b5-8c70a4290c86 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:21 devstack sudo[100251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-791c0fc9-bcd6-47d3-80b5-8c70a4290c86 1073741824 Jul 08 01:46:21 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:22 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c3c94471-e63f-4251-8076-987413e51573 tempest-VolumesListAdminTestJSON-1053362266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-791c0fc9-bcd6-47d3-80b5-8c70a4290c86 1073741824" returned: 0 in 0.849s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c3c94471-e63f-4251-8076-987413e51573 tempest-VolumesListAdminTestJSON-1053362266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-791c0fc9-bcd6-47d3-80b5-8c70a4290c86 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:22 devstack sudo[100257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-791c0fc9-bcd6-47d3-80b5-8c70a4290c86 Jul 08 01:46:22 devstack sudo[100257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:23 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c6cfaefe-4232-4af0-a144-00607e5e1f97 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Acquiring lock "cinder-a8691d08-95de-47f9-ba01-9a5e63bd459b-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:23 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c6cfaefe-4232-4af0-a144-00607e5e1f97 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Lock "cinder-a8691d08-95de-47f9-ba01-9a5e63bd459b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:23 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c6cfaefe-4232-4af0-a144-00607e5e1f97 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Acquiring lock "cinder-quobyte-a8691d08-95de-47f9-ba01-9a5e63bd459b" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:23 devstack sudo[100257]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:23 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c6cfaefe-4232-4af0-a144-00607e5e1f97 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Lock "cinder-quobyte-a8691d08-95de-47f9-ba01-9a5e63bd459b" acquired by "delete_volume" :: waited 0.018s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c3c94471-e63f-4251-8076-987413e51573 tempest-VolumesListAdminTestJSON-1053362266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-791c0fc9-bcd6-47d3-80b5-8c70a4290c86" returned: 0 in 0.725s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:23 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c3c94471-e63f-4251-8076-987413e51573 tempest-VolumesListAdminTestJSON-1053362266 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:46:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c3c94471-e63f-4251-8076-987413e51573 tempest-VolumesListAdminTestJSON-1053362266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:23 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c3c94471-e63f-4251-8076-987413e51573 tempest-VolumesListAdminTestJSON-1053362266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d42d905-05b2-4e1f-937a-5411356d1a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-791c0fc9-bcd6-47d3-80b5-8c70a4290c86', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:23 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c3c94471-e63f-4251-8076-987413e51573 tempest-VolumesListAdminTestJSON-1053362266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c0633af-c4db-4be0-8ce3-00425d674ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:23 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14ba32d-17a6-4468-8668-f78e0813599e]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c6cfaefe-4232-4af0-a144-00607e5e1f97 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8691d08-95de-47f9-ba01-9a5e63bd459b {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:23 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-c3c94471-e63f-4251-8076-987413e51573 tempest-VolumesListAdminTestJSON-1053362266 None] Volume volume-791c0fc9-bcd6-47d3-80b5-8c70a4290c86 (791c0fc9-bcd6-47d3-80b5-8c70a4290c86): created successfully Jul 08 01:46:23 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c3c94471-e63f-4251-8076-987413e51573 tempest-VolumesListAdminTestJSON-1053362266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c0633af-c4db-4be0-8ce3-00425d674ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:23 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c3c94471-e63f-4251-8076-987413e51573 tempest-VolumesListAdminTestJSON-1053362266 None] Flow 'volume_create_manager' (a265efbe-3229-483b-9e18-2717bebb0af5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:23 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-c3c94471-e63f-4251-8076-987413e51573 tempest-VolumesListAdminTestJSON-1053362266 None] Created volume successfully. Jul 08 01:46:23 devstack sudo[100260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8691d08-95de-47f9-ba01-9a5e63bd459b Jul 08 01:46:23 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:24 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c6cfaefe-4232-4af0-a144-00607e5e1f97 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8691d08-95de-47f9-ba01-9a5e63bd459b" returned: 0 in 0.879s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c6cfaefe-4232-4af0-a144-00607e5e1f97 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8691d08-95de-47f9-ba01-9a5e63bd459b {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:24 devstack sudo[100265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8691d08-95de-47f9-ba01-9a5e63bd459b Jul 08 01:46:24 devstack sudo[100265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:24 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7bfd306-e6b5-4645-9a02-b049de622740 tempest-VolumesListAdminTestJSON-1053362266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:46:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d7bfd306-e6b5-4645-9a02-b049de622740 tempest-VolumesListAdminTestJSON-1053362266 None] Flow 'volume_create_manager' (de598ad7-7d02-4ba5-9bcc-79aa9fce838d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d7bfd306-e6b5-4645-9a02-b049de622740 tempest-VolumesListAdminTestJSON-1053362266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa7e096-a227-41db-a97d-3096193f7ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d7bfd306-e6b5-4645-9a02-b049de622740 tempest-VolumesListAdminTestJSON-1053362266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa7e096-a227-41db-a97d-3096193f7ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1731667426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b360396f-0461-4965-b70e-0bd035211f8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='412f7ff509674e0380608aa3ddc95b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:24Z,use_quota=True,user_id='2751bfaca4da4f05aa92c68fae7c45c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d7bfd306-e6b5-4645-9a02-b049de622740 tempest-VolumesListAdminTestJSON-1053362266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d60120-fe58-4557-885b-90921de1879f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d7bfd306-e6b5-4645-9a02-b049de622740 tempest-VolumesListAdminTestJSON-1053362266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d60120-fe58-4557-885b-90921de1879f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d7bfd306-e6b5-4645-9a02-b049de622740 tempest-VolumesListAdminTestJSON-1053362266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd33010a-0281-48d1-9335-a2de37424060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d7bfd306-e6b5-4645-9a02-b049de622740 tempest-VolumesListAdminTestJSON-1053362266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd33010a-0281-48d1-9335-a2de37424060) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b360396f-0461-4965-b70e-0bd035211f8d', 'volume_name': 'volume-b360396f-0461-4965-b70e-0bd035211f8d', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d7bfd306-e6b5-4645-9a02-b049de622740 tempest-VolumesListAdminTestJSON-1053362266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31e7a1da-21fe-441b-a069-ea8bf331298d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d7bfd306-e6b5-4645-9a02-b049de622740 tempest-VolumesListAdminTestJSON-1053362266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31e7a1da-21fe-441b-a069-ea8bf331298d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d7bfd306-e6b5-4645-9a02-b049de622740 tempest-VolumesListAdminTestJSON-1053362266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1df70608-abba-4561-8582-d2615d54a5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:24 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-d7bfd306-e6b5-4645-9a02-b049de622740 tempest-VolumesListAdminTestJSON-1053362266 None] Volume b360396f-0461-4965-b70e-0bd035211f8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b360396f-0461-4965-b70e-0bd035211f8d', 'volume_size': 1} Jul 08 01:46:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-d7bfd306-e6b5-4645-9a02-b049de622740 tempest-VolumesListAdminTestJSON-1053362266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-d7bfd306-e6b5-4645-9a02-b049de622740 tempest-VolumesListAdminTestJSON-1053362266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:24 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-d7bfd306-e6b5-4645-9a02-b049de622740 tempest-VolumesListAdminTestJSON-1053362266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1731667426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b360396f-0461-4965-b70e-0bd035211f8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='412f7ff509674e0380608aa3ddc95b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:24Z,use_quota=True,user_id='2751bfaca4da4f05aa92c68fae7c45c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:46:24 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-d7bfd306-e6b5-4645-9a02-b049de622740 tempest-VolumesListAdminTestJSON-1053362266 None] Creating volume b360396f-0461-4965-b70e-0bd035211f8d {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:46:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-d7bfd306-e6b5-4645-9a02-b049de622740 tempest-VolumesListAdminTestJSON-1053362266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-d7bfd306-e6b5-4645-9a02-b049de622740 tempest-VolumesListAdminTestJSON-1053362266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:24 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-d7bfd306-e6b5-4645-9a02-b049de622740 tempest-VolumesListAdminTestJSON-1053362266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:24 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-d7bfd306-e6b5-4645-9a02-b049de622740 tempest-VolumesListAdminTestJSON-1053362266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-d7bfd306-e6b5-4645-9a02-b049de622740 tempest-VolumesListAdminTestJSON-1053362266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:24 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-d7bfd306-e6b5-4645-9a02-b049de622740 tempest-VolumesListAdminTestJSON-1053362266 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:46:24 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-d7bfd306-e6b5-4645-9a02-b049de622740 tempest-VolumesListAdminTestJSON-1053362266 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:46:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d7bfd306-e6b5-4645-9a02-b049de622740 tempest-VolumesListAdminTestJSON-1053362266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b360396f-0461-4965-b70e-0bd035211f8d 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:24 devstack sudo[100269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b360396f-0461-4965-b70e-0bd035211f8d 1073741824 Jul 08 01:46:24 devstack sudo[100269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:25 devstack sudo[100265]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c6cfaefe-4232-4af0-a144-00607e5e1f97 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8691d08-95de-47f9-ba01-9a5e63bd459b" returned: 0 in 0.769s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:25 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c6cfaefe-4232-4af0-a144-00607e5e1f97 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Lock "cinder-quobyte-a8691d08-95de-47f9-ba01-9a5e63bd459b" released by "delete_volume" :: held 1.712s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:25 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-c6cfaefe-4232-4af0-a144-00607e5e1f97 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Created reservations ['d9cf077e-48c4-4623-83f7-7da0f099a694', 'f9f4441a-4601-4a00-908a-9bb997f5a969', 'd4fa699e-e727-4089-8114-3e3f338dbc51', '0fcec16f-41ef-4869-a6cc-dc5f7f16b960'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:46:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c6cfaefe-4232-4af0-a144-00607e5e1f97 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c6cfaefe-4232-4af0-a144-00607e5e1f97 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:25 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c6cfaefe-4232-4af0-a144-00607e5e1f97 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:25 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c6cfaefe-4232-4af0-a144-00607e5e1f97 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c6cfaefe-4232-4af0-a144-00607e5e1f97 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c6cfaefe-4232-4af0-a144-00607e5e1f97 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:25 devstack sudo[100282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:46:25 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:25 devstack sudo[100269]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d7bfd306-e6b5-4645-9a02-b049de622740 tempest-VolumesListAdminTestJSON-1053362266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b360396f-0461-4965-b70e-0bd035211f8d 1073741824" returned: 0 in 0.980s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d7bfd306-e6b5-4645-9a02-b049de622740 tempest-VolumesListAdminTestJSON-1053362266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b360396f-0461-4965-b70e-0bd035211f8d {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:25 devstack sudo[100284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b360396f-0461-4965-b70e-0bd035211f8d Jul 08 01:46:25 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:25 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c6cfaefe-4232-4af0-a144-00607e5e1f97 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.707s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:25 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-c6cfaefe-4232-4af0-a144-00607e5e1f97 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:46:25 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-c6cfaefe-4232-4af0-a144-00607e5e1f97 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Deleted volume successfully. Jul 08 01:46:26 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c6cfaefe-4232-4af0-a144-00607e5e1f97 tempest-TestServerVolumeAttachScenarioOldVersion-1255374526 None] Lock "cinder-a8691d08-95de-47f9-ba01-9a5e63bd459b-delete_volume" released by "delete_volume" :: held 2.687s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:26 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d7bfd306-e6b5-4645-9a02-b049de622740 tempest-VolumesListAdminTestJSON-1053362266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b360396f-0461-4965-b70e-0bd035211f8d" returned: 0 in 0.797s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:26 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-d7bfd306-e6b5-4645-9a02-b049de622740 tempest-VolumesListAdminTestJSON-1053362266 None] <== create_volume: return (1846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:46:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-d7bfd306-e6b5-4645-9a02-b049de622740 tempest-VolumesListAdminTestJSON-1053362266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.849s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d7bfd306-e6b5-4645-9a02-b049de622740 tempest-VolumesListAdminTestJSON-1053362266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1df70608-abba-4561-8582-d2615d54a5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b360396f-0461-4965-b70e-0bd035211f8d', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d7bfd306-e6b5-4645-9a02-b049de622740 tempest-VolumesListAdminTestJSON-1053362266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4de02427-06c8-47e3-9214-6dfe37d61df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:26 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-d7bfd306-e6b5-4645-9a02-b049de622740 tempest-VolumesListAdminTestJSON-1053362266 None] Volume volume-b360396f-0461-4965-b70e-0bd035211f8d (b360396f-0461-4965-b70e-0bd035211f8d): created successfully Jul 08 01:46:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d7bfd306-e6b5-4645-9a02-b049de622740 tempest-VolumesListAdminTestJSON-1053362266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4de02427-06c8-47e3-9214-6dfe37d61df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d7bfd306-e6b5-4645-9a02-b049de622740 tempest-VolumesListAdminTestJSON-1053362266 None] Flow 'volume_create_manager' (de598ad7-7d02-4ba5-9bcc-79aa9fce838d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:26 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-d7bfd306-e6b5-4645-9a02-b049de622740 tempest-VolumesListAdminTestJSON-1053362266 None] Created volume successfully. Jul 08 01:46:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-20d41f08-a2c2-46f0-ba85-9e6c03a084fc req-b032f59a-ea62-4054-89a9-65af3b764cad tempest-TestStampPattern-1873432706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-20d41f08-a2c2-46f0-ba85-9e6c03a084fc req-b032f59a-ea62-4054-89a9-65af3b764cad tempest-TestStampPattern-1873432706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:28 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b58aded-cf6d-48ab-ad42-3ce0dae20191]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-20d41f08-a2c2-46f0-ba85-9e6c03a084fc req-b032f59a-ea62-4054-89a9-65af3b764cad tempest-TestStampPattern-1873432706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64871dd3-7a1b-45f1-b847-c0ba3628df5c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:28 devstack sudo[100322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64871dd3-7a1b-45f1-b847-c0ba3628df5c Jul 08 01:46:28 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:28 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-c794ef8e-0167-49b7-b5cf-646dc91ced5e tempest-VolumesListAdminTestJSON-2067874950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:46:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c794ef8e-0167-49b7-b5cf-646dc91ced5e tempest-VolumesListAdminTestJSON-2067874950 None] Flow 'volume_create_manager' (8ed326b3-524b-42d9-ad1a-fac5b8323d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c794ef8e-0167-49b7-b5cf-646dc91ced5e tempest-VolumesListAdminTestJSON-2067874950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7841a555-f952-4035-bce2-97f8e8f10fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c794ef8e-0167-49b7-b5cf-646dc91ced5e tempest-VolumesListAdminTestJSON-2067874950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7841a555-f952-4035-bce2-97f8e8f10fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=755b44c8-f2d2-4549-a248-c2ad12eacbae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f7bd1b09a44b53bd16a7bc04bfe183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:28Z,use_quota=True,user_id='2dbada3acc4140e2a29071794642ff7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c794ef8e-0167-49b7-b5cf-646dc91ced5e tempest-VolumesListAdminTestJSON-2067874950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b75e47c-b2e4-47c2-8205-2f29a559e5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c794ef8e-0167-49b7-b5cf-646dc91ced5e tempest-VolumesListAdminTestJSON-2067874950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b75e47c-b2e4-47c2-8205-2f29a559e5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c794ef8e-0167-49b7-b5cf-646dc91ced5e tempest-VolumesListAdminTestJSON-2067874950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47b551c6-0057-400b-a437-45da87d24add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c794ef8e-0167-49b7-b5cf-646dc91ced5e tempest-VolumesListAdminTestJSON-2067874950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47b551c6-0057-400b-a437-45da87d24add) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '755b44c8-f2d2-4549-a248-c2ad12eacbae', 'volume_name': 'volume-755b44c8-f2d2-4549-a248-c2ad12eacbae', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c794ef8e-0167-49b7-b5cf-646dc91ced5e tempest-VolumesListAdminTestJSON-2067874950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ea15407-637c-4de5-ba89-d1c346149411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c794ef8e-0167-49b7-b5cf-646dc91ced5e tempest-VolumesListAdminTestJSON-2067874950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ea15407-637c-4de5-ba89-d1c346149411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c794ef8e-0167-49b7-b5cf-646dc91ced5e tempest-VolumesListAdminTestJSON-2067874950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (840649a9-d161-4c8c-9617-1c4a0cd26020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:28 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-c794ef8e-0167-49b7-b5cf-646dc91ced5e tempest-VolumesListAdminTestJSON-2067874950 None] Volume 755b44c8-f2d2-4549-a248-c2ad12eacbae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-755b44c8-f2d2-4549-a248-c2ad12eacbae', 'volume_size': 1} Jul 08 01:46:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c794ef8e-0167-49b7-b5cf-646dc91ced5e tempest-VolumesListAdminTestJSON-2067874950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:29 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-20d41f08-a2c2-46f0-ba85-9e6c03a084fc req-b032f59a-ea62-4054-89a9-65af3b764cad tempest-TestStampPattern-1873432706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64871dd3-7a1b-45f1-b847-c0ba3628df5c" returned: 0 in 1.015s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-20d41f08-a2c2-46f0-ba85-9e6c03a084fc req-b032f59a-ea62-4054-89a9-65af3b764cad tempest-TestStampPattern-1873432706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.041s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c794ef8e-0167-49b7-b5cf-646dc91ced5e tempest-VolumesListAdminTestJSON-2067874950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.542s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:29 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c794ef8e-0167-49b7-b5cf-646dc91ced5e tempest-VolumesListAdminTestJSON-2067874950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=755b44c8-f2d2-4549-a248-c2ad12eacbae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f7bd1b09a44b53bd16a7bc04bfe183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:28Z,use_quota=True,user_id='2dbada3acc4140e2a29071794642ff7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:46:29 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-c794ef8e-0167-49b7-b5cf-646dc91ced5e tempest-VolumesListAdminTestJSON-2067874950 None] Creating volume 755b44c8-f2d2-4549-a248-c2ad12eacbae {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:46:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c794ef8e-0167-49b7-b5cf-646dc91ced5e tempest-VolumesListAdminTestJSON-2067874950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c794ef8e-0167-49b7-b5cf-646dc91ced5e tempest-VolumesListAdminTestJSON-2067874950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:29 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c794ef8e-0167-49b7-b5cf-646dc91ced5e tempest-VolumesListAdminTestJSON-2067874950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:29 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c794ef8e-0167-49b7-b5cf-646dc91ced5e tempest-VolumesListAdminTestJSON-2067874950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c794ef8e-0167-49b7-b5cf-646dc91ced5e tempest-VolumesListAdminTestJSON-2067874950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:29 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c794ef8e-0167-49b7-b5cf-646dc91ced5e tempest-VolumesListAdminTestJSON-2067874950 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:46:29 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-c794ef8e-0167-49b7-b5cf-646dc91ced5e tempest-VolumesListAdminTestJSON-2067874950 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:46:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c794ef8e-0167-49b7-b5cf-646dc91ced5e tempest-VolumesListAdminTestJSON-2067874950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-755b44c8-f2d2-4549-a248-c2ad12eacbae 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:29 devstack sudo[100330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-755b44c8-f2d2-4549-a248-c2ad12eacbae 1073741824 Jul 08 01:46:29 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:29 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-20d41f08-a2c2-46f0-ba85-9e6c03a084fc req-b032f59a-ea62-4054-89a9-65af3b764cad tempest-TestStampPattern-1873432706 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96', 'name': 'volume-64871dd3-7a1b-45f1-b847-c0ba3628df5c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b568d8ca-a3e4-4840-bc48-e6e12588c64e', 'enforce_multipath': True} {{(pid=87284) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:46:29 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-20d41f08-a2c2-46f0-ba85-9e6c03a084fc req-b032f59a-ea62-4054-89a9-65af3b764cad tempest-TestStampPattern-1873432706 None] attachment_update completed successfully. Jul 08 01:46:29 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c794ef8e-0167-49b7-b5cf-646dc91ced5e tempest-VolumesListAdminTestJSON-2067874950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-755b44c8-f2d2-4549-a248-c2ad12eacbae 1073741824" returned: 0 in 0.955s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c794ef8e-0167-49b7-b5cf-646dc91ced5e tempest-VolumesListAdminTestJSON-2067874950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-755b44c8-f2d2-4549-a248-c2ad12eacbae {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:30 devstack sudo[100402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-755b44c8-f2d2-4549-a248-c2ad12eacbae Jul 08 01:46:30 devstack sudo[100402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:30 devstack sudo[100402]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c794ef8e-0167-49b7-b5cf-646dc91ced5e tempest-VolumesListAdminTestJSON-2067874950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-755b44c8-f2d2-4549-a248-c2ad12eacbae" returned: 0 in 0.655s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:30 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c794ef8e-0167-49b7-b5cf-646dc91ced5e tempest-VolumesListAdminTestJSON-2067874950 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:46:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c794ef8e-0167-49b7-b5cf-646dc91ced5e tempest-VolumesListAdminTestJSON-2067874950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:30 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c794ef8e-0167-49b7-b5cf-646dc91ced5e tempest-VolumesListAdminTestJSON-2067874950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (840649a9-d161-4c8c-9617-1c4a0cd26020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-755b44c8-f2d2-4549-a248-c2ad12eacbae', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:30 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c794ef8e-0167-49b7-b5cf-646dc91ced5e tempest-VolumesListAdminTestJSON-2067874950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (458cc970-062c-4f98-b3a7-cf26c1e43fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:30 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-c794ef8e-0167-49b7-b5cf-646dc91ced5e tempest-VolumesListAdminTestJSON-2067874950 None] Volume volume-755b44c8-f2d2-4549-a248-c2ad12eacbae (755b44c8-f2d2-4549-a248-c2ad12eacbae): created successfully Jul 08 01:46:30 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c794ef8e-0167-49b7-b5cf-646dc91ced5e tempest-VolumesListAdminTestJSON-2067874950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (458cc970-062c-4f98-b3a7-cf26c1e43fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:30 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c794ef8e-0167-49b7-b5cf-646dc91ced5e tempest-VolumesListAdminTestJSON-2067874950 None] Flow 'volume_create_manager' (8ed326b3-524b-42d9-ad1a-fac5b8323d04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:30 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-c794ef8e-0167-49b7-b5cf-646dc91ced5e tempest-VolumesListAdminTestJSON-2067874950 None] Created volume successfully. Jul 08 01:46:31 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-fbd8bedf-6b82-4498-8fa2-ddbedaacd497 tempest-VolumesListAdminTestJSON-2067874950 None] Acquiring lock "cinder-755b44c8-f2d2-4549-a248-c2ad12eacbae-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:31 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-fbd8bedf-6b82-4498-8fa2-ddbedaacd497 tempest-VolumesListAdminTestJSON-2067874950 None] Lock "cinder-755b44c8-f2d2-4549-a248-c2ad12eacbae-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:31 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-fbd8bedf-6b82-4498-8fa2-ddbedaacd497 tempest-VolumesListAdminTestJSON-2067874950 None] Acquiring lock "cinder-quobyte-755b44c8-f2d2-4549-a248-c2ad12eacbae" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:31 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-fbd8bedf-6b82-4498-8fa2-ddbedaacd497 tempest-VolumesListAdminTestJSON-2067874950 None] Lock "cinder-quobyte-755b44c8-f2d2-4549-a248-c2ad12eacbae" acquired by "delete_volume" :: waited 0.020s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:31 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9cf0244-595e-486e-90f1-e67817c6380c]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-fbd8bedf-6b82-4498-8fa2-ddbedaacd497 tempest-VolumesListAdminTestJSON-2067874950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-755b44c8-f2d2-4549-a248-c2ad12eacbae {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:31 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-780d5343-c39f-489d-b6e8-9996f1845d1b tempest-VolumesListAdminTestJSON-1053362266 None] Acquiring lock "cinder-b360396f-0461-4965-b70e-0bd035211f8d-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:31 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-780d5343-c39f-489d-b6e8-9996f1845d1b tempest-VolumesListAdminTestJSON-1053362266 None] Lock "cinder-b360396f-0461-4965-b70e-0bd035211f8d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:31 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-780d5343-c39f-489d-b6e8-9996f1845d1b tempest-VolumesListAdminTestJSON-1053362266 None] Acquiring lock "cinder-quobyte-b360396f-0461-4965-b70e-0bd035211f8d" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:31 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-780d5343-c39f-489d-b6e8-9996f1845d1b tempest-VolumesListAdminTestJSON-1053362266 None] Lock "cinder-quobyte-b360396f-0461-4965-b70e-0bd035211f8d" acquired by "delete_volume" :: waited 0.015s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:31 devstack sudo[100720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-755b44c8-f2d2-4549-a248-c2ad12eacbae Jul 08 01:46:31 devstack sudo[100720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:31 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8cc557-f15e-48bf-88a2-06ab914eb307]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-780d5343-c39f-489d-b6e8-9996f1845d1b tempest-VolumesListAdminTestJSON-1053362266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b360396f-0461-4965-b70e-0bd035211f8d {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:32 devstack sudo[100722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b360396f-0461-4965-b70e-0bd035211f8d Jul 08 01:46:32 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:32 devstack sudo[100720]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-fbd8bedf-6b82-4498-8fa2-ddbedaacd497 tempest-VolumesListAdminTestJSON-2067874950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-755b44c8-f2d2-4549-a248-c2ad12eacbae" returned: 0 in 0.797s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-fbd8bedf-6b82-4498-8fa2-ddbedaacd497 tempest-VolumesListAdminTestJSON-2067874950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-755b44c8-f2d2-4549-a248-c2ad12eacbae {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:32 devstack sudo[100727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-755b44c8-f2d2-4549-a248-c2ad12eacbae Jul 08 01:46:32 devstack sudo[100727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:32 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-780d5343-c39f-489d-b6e8-9996f1845d1b tempest-VolumesListAdminTestJSON-1053362266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b360396f-0461-4965-b70e-0bd035211f8d" returned: 0 in 0.894s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-780d5343-c39f-489d-b6e8-9996f1845d1b tempest-VolumesListAdminTestJSON-1053362266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b360396f-0461-4965-b70e-0bd035211f8d {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:32 devstack sudo[100732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b360396f-0461-4965-b70e-0bd035211f8d Jul 08 01:46:32 devstack sudo[100732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:33 devstack sudo[100727]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-fbd8bedf-6b82-4498-8fa2-ddbedaacd497 tempest-VolumesListAdminTestJSON-2067874950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-755b44c8-f2d2-4549-a248-c2ad12eacbae" returned: 0 in 0.763s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:33 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-fbd8bedf-6b82-4498-8fa2-ddbedaacd497 tempest-VolumesListAdminTestJSON-2067874950 None] Lock "cinder-quobyte-755b44c8-f2d2-4549-a248-c2ad12eacbae" released by "delete_volume" :: held 1.631s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:33 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-fbd8bedf-6b82-4498-8fa2-ddbedaacd497 tempest-VolumesListAdminTestJSON-2067874950 None] Created reservations ['9bd51747-4738-4f71-823a-c7868fc45073', '99fd82b8-40a6-493c-87e8-072d436d78cb', 'a56d09c7-27e4-48fe-950a-e0f759d875ff', '90fcf6d6-3a4d-4098-9c8d-765305508bd2'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:46:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-fbd8bedf-6b82-4498-8fa2-ddbedaacd497 tempest-VolumesListAdminTestJSON-2067874950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-fbd8bedf-6b82-4498-8fa2-ddbedaacd497 tempest-VolumesListAdminTestJSON-2067874950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:33 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-fbd8bedf-6b82-4498-8fa2-ddbedaacd497 tempest-VolumesListAdminTestJSON-2067874950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:33 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-fbd8bedf-6b82-4498-8fa2-ddbedaacd497 tempest-VolumesListAdminTestJSON-2067874950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-fbd8bedf-6b82-4498-8fa2-ddbedaacd497 tempest-VolumesListAdminTestJSON-2067874950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-fbd8bedf-6b82-4498-8fa2-ddbedaacd497 tempest-VolumesListAdminTestJSON-2067874950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:33 devstack sudo[100736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:46:33 devstack sudo[100736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:33 devstack sudo[100732]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-780d5343-c39f-489d-b6e8-9996f1845d1b tempest-VolumesListAdminTestJSON-1053362266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b360396f-0461-4965-b70e-0bd035211f8d" returned: 0 in 0.934s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:33 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-780d5343-c39f-489d-b6e8-9996f1845d1b tempest-VolumesListAdminTestJSON-1053362266 None] Lock "cinder-quobyte-b360396f-0461-4965-b70e-0bd035211f8d" released by "delete_volume" :: held 1.880s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:33 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-780d5343-c39f-489d-b6e8-9996f1845d1b tempest-VolumesListAdminTestJSON-1053362266 None] Created reservations ['52340c0b-b1b5-4c09-a517-91cf26b0446b', '255ec52f-fd85-4505-b9a8-e9dc07ab5fac', 'b87c5f21-1a35-4c29-a25b-afec4c288094', '296769f6-714f-424c-90ee-1762a30d72be'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:46:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-780d5343-c39f-489d-b6e8-9996f1845d1b tempest-VolumesListAdminTestJSON-1053362266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-780d5343-c39f-489d-b6e8-9996f1845d1b tempest-VolumesListAdminTestJSON-1053362266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:33 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-780d5343-c39f-489d-b6e8-9996f1845d1b tempest-VolumesListAdminTestJSON-1053362266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:33 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-780d5343-c39f-489d-b6e8-9996f1845d1b tempest-VolumesListAdminTestJSON-1053362266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-780d5343-c39f-489d-b6e8-9996f1845d1b tempest-VolumesListAdminTestJSON-1053362266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-780d5343-c39f-489d-b6e8-9996f1845d1b tempest-VolumesListAdminTestJSON-1053362266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:34 devstack sudo[100738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:46:34 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:34 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-23b0a1e5-cb9e-493d-a23b-63f57c4f8e79 tempest-VolumesListAdminTestJSON-1053362266 None] Acquiring lock "cinder-791c0fc9-bcd6-47d3-80b5-8c70a4290c86-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:34 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-23b0a1e5-cb9e-493d-a23b-63f57c4f8e79 tempest-VolumesListAdminTestJSON-1053362266 None] Lock "cinder-791c0fc9-bcd6-47d3-80b5-8c70a4290c86-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:34 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-23b0a1e5-cb9e-493d-a23b-63f57c4f8e79 tempest-VolumesListAdminTestJSON-1053362266 None] Acquiring lock "cinder-quobyte-791c0fc9-bcd6-47d3-80b5-8c70a4290c86" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:34 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-23b0a1e5-cb9e-493d-a23b-63f57c4f8e79 tempest-VolumesListAdminTestJSON-1053362266 None] Lock "cinder-quobyte-791c0fc9-bcd6-47d3-80b5-8c70a4290c86" acquired by "delete_volume" :: waited 0.042s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:34 devstack sudo[100736]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-fbd8bedf-6b82-4498-8fa2-ddbedaacd497 tempest-VolumesListAdminTestJSON-2067874950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.077s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:34 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-fbd8bedf-6b82-4498-8fa2-ddbedaacd497 tempest-VolumesListAdminTestJSON-2067874950 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:46:34 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[796086e1-5521-4b16-8cea-c77b4ca77a99]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-23b0a1e5-cb9e-493d-a23b-63f57c4f8e79 tempest-VolumesListAdminTestJSON-1053362266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-791c0fc9-bcd6-47d3-80b5-8c70a4290c86 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:34 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-fbd8bedf-6b82-4498-8fa2-ddbedaacd497 tempest-VolumesListAdminTestJSON-2067874950 None] Deleted volume successfully. Jul 08 01:46:34 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-fbd8bedf-6b82-4498-8fa2-ddbedaacd497 tempest-VolumesListAdminTestJSON-2067874950 None] Lock "cinder-755b44c8-f2d2-4549-a248-c2ad12eacbae-delete_volume" released by "delete_volume" :: held 3.065s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:34 devstack sudo[100787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-791c0fc9-bcd6-47d3-80b5-8c70a4290c86 Jul 08 01:46:34 devstack sudo[100787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:35 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-780d5343-c39f-489d-b6e8-9996f1845d1b tempest-VolumesListAdminTestJSON-1053362266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.259s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:35 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-780d5343-c39f-489d-b6e8-9996f1845d1b tempest-VolumesListAdminTestJSON-1053362266 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:46:35 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-780d5343-c39f-489d-b6e8-9996f1845d1b tempest-VolumesListAdminTestJSON-1053362266 None] Deleted volume successfully. Jul 08 01:46:35 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-780d5343-c39f-489d-b6e8-9996f1845d1b tempest-VolumesListAdminTestJSON-1053362266 None] Lock "cinder-b360396f-0461-4965-b70e-0bd035211f8d-delete_volume" released by "delete_volume" :: held 3.442s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:35 devstack sudo[100787]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-23b0a1e5-cb9e-493d-a23b-63f57c4f8e79 tempest-VolumesListAdminTestJSON-1053362266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-791c0fc9-bcd6-47d3-80b5-8c70a4290c86" returned: 0 in 1.317s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-23b0a1e5-cb9e-493d-a23b-63f57c4f8e79 tempest-VolumesListAdminTestJSON-1053362266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-791c0fc9-bcd6-47d3-80b5-8c70a4290c86 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:35 devstack sudo[100800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-791c0fc9-bcd6-47d3-80b5-8c70a4290c86 Jul 08 01:46:35 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:36 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-23b0a1e5-cb9e-493d-a23b-63f57c4f8e79 tempest-VolumesListAdminTestJSON-1053362266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-791c0fc9-bcd6-47d3-80b5-8c70a4290c86" returned: 0 in 0.793s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:36 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-23b0a1e5-cb9e-493d-a23b-63f57c4f8e79 tempest-VolumesListAdminTestJSON-1053362266 None] Lock "cinder-quobyte-791c0fc9-bcd6-47d3-80b5-8c70a4290c86" released by "delete_volume" :: held 2.259s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:36 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-23b0a1e5-cb9e-493d-a23b-63f57c4f8e79 tempest-VolumesListAdminTestJSON-1053362266 None] Created reservations ['98bc7b43-bec3-4bb0-9b27-0ffa36534267', '2630faca-1267-4bdc-9f87-58c54f47601e', '02b3aeff-f1bb-419a-bb16-178928db6cfc', '1fc9b061-6214-4957-989d-e2af8d22931c'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:46:37 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-79f6f6c1-07ef-48ef-8a5f-ab463cc5c20b req-eabb11d9-c967-49d7-a159-18e6b561f823 tempest-TestStampPattern-1873432706 None] Terminate volume connection completed successfully. Jul 08 01:46:37 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-79f6f6c1-07ef-48ef-8a5f-ab463cc5c20b req-eabb11d9-c967-49d7-a159-18e6b561f823 tempest-TestStampPattern-1873432706 None] Deleting attachment b568d8ca-a3e4-4840-bc48-e6e12588c64e. {{(pid=87284) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:46:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-23b0a1e5-cb9e-493d-a23b-63f57c4f8e79 tempest-VolumesListAdminTestJSON-1053362266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-23b0a1e5-cb9e-493d-a23b-63f57c4f8e79 tempest-VolumesListAdminTestJSON-1053362266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:37 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-23b0a1e5-cb9e-493d-a23b-63f57c4f8e79 tempest-VolumesListAdminTestJSON-1053362266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:37 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-23b0a1e5-cb9e-493d-a23b-63f57c4f8e79 tempest-VolumesListAdminTestJSON-1053362266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-23b0a1e5-cb9e-493d-a23b-63f57c4f8e79 tempest-VolumesListAdminTestJSON-1053362266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-23b0a1e5-cb9e-493d-a23b-63f57c4f8e79 tempest-VolumesListAdminTestJSON-1053362266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:37 devstack sudo[100831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:46:37 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:37 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1976d666-e4f0-4def-86fb-6db27f3225f2 tempest-VolumesListAdminTestJSON-1053362266 None] Acquiring lock "cinder-085bc72b-e949-4e86-a883-620f01fcc9b3-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:37 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-23b0a1e5-cb9e-493d-a23b-63f57c4f8e79 tempest-VolumesListAdminTestJSON-1053362266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.787s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:37 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-23b0a1e5-cb9e-493d-a23b-63f57c4f8e79 tempest-VolumesListAdminTestJSON-1053362266 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:46:37 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1976d666-e4f0-4def-86fb-6db27f3225f2 tempest-VolumesListAdminTestJSON-1053362266 None] Lock "cinder-085bc72b-e949-4e86-a883-620f01fcc9b3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:37 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-23b0a1e5-cb9e-493d-a23b-63f57c4f8e79 tempest-VolumesListAdminTestJSON-1053362266 None] Deleted volume successfully. Jul 08 01:46:37 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-23b0a1e5-cb9e-493d-a23b-63f57c4f8e79 tempest-VolumesListAdminTestJSON-1053362266 None] Lock "cinder-791c0fc9-bcd6-47d3-80b5-8c70a4290c86-delete_volume" released by "delete_volume" :: held 3.577s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:38 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1976d666-e4f0-4def-86fb-6db27f3225f2 tempest-VolumesListAdminTestJSON-1053362266 None] Acquiring lock "cinder-quobyte-085bc72b-e949-4e86-a883-620f01fcc9b3" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:38 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1976d666-e4f0-4def-86fb-6db27f3225f2 tempest-VolumesListAdminTestJSON-1053362266 None] Lock "cinder-quobyte-085bc72b-e949-4e86-a883-620f01fcc9b3" acquired by "delete_volume" :: waited 0.020s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:38 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdb700c-36f3-45a0-b1eb-ebf423688cee]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1976d666-e4f0-4def-86fb-6db27f3225f2 tempest-VolumesListAdminTestJSON-1053362266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-085bc72b-e949-4e86-a883-620f01fcc9b3 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:38 devstack sudo[100834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-085bc72b-e949-4e86-a883-620f01fcc9b3 Jul 08 01:46:38 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:38 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1976d666-e4f0-4def-86fb-6db27f3225f2 tempest-VolumesListAdminTestJSON-1053362266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-085bc72b-e949-4e86-a883-620f01fcc9b3" returned: 0 in 0.904s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1976d666-e4f0-4def-86fb-6db27f3225f2 tempest-VolumesListAdminTestJSON-1053362266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-085bc72b-e949-4e86-a883-620f01fcc9b3 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:38 devstack sudo[100840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-085bc72b-e949-4e86-a883-620f01fcc9b3 Jul 08 01:46:38 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:39 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1976d666-e4f0-4def-86fb-6db27f3225f2 tempest-VolumesListAdminTestJSON-1053362266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-085bc72b-e949-4e86-a883-620f01fcc9b3" returned: 0 in 0.758s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:39 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1976d666-e4f0-4def-86fb-6db27f3225f2 tempest-VolumesListAdminTestJSON-1053362266 None] Lock "cinder-quobyte-085bc72b-e949-4e86-a883-620f01fcc9b3" released by "delete_volume" :: held 1.714s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:39 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-1976d666-e4f0-4def-86fb-6db27f3225f2 tempest-VolumesListAdminTestJSON-1053362266 None] Created reservations ['7981b578-5c32-4964-9e62-24c4eddf9cee', 'be796bd7-9a0c-4270-afac-3e7f17ff1629', '30b39a7f-7765-4ae6-9365-9e7dafda256a', 'c27183dd-9823-42e1-b50b-25d583f3674b'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:46:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-1976d666-e4f0-4def-86fb-6db27f3225f2 tempest-VolumesListAdminTestJSON-1053362266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-1976d666-e4f0-4def-86fb-6db27f3225f2 tempest-VolumesListAdminTestJSON-1053362266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:39 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-1976d666-e4f0-4def-86fb-6db27f3225f2 tempest-VolumesListAdminTestJSON-1053362266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:39 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-1976d666-e4f0-4def-86fb-6db27f3225f2 tempest-VolumesListAdminTestJSON-1053362266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-1976d666-e4f0-4def-86fb-6db27f3225f2 tempest-VolumesListAdminTestJSON-1053362266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1976d666-e4f0-4def-86fb-6db27f3225f2 tempest-VolumesListAdminTestJSON-1053362266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:39 devstack sudo[100844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:46:39 devstack sudo[100844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:40 devstack sudo[100844]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1976d666-e4f0-4def-86fb-6db27f3225f2 tempest-VolumesListAdminTestJSON-1053362266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.044s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:40 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-1976d666-e4f0-4def-86fb-6db27f3225f2 tempest-VolumesListAdminTestJSON-1053362266 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:46:41 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-1976d666-e4f0-4def-86fb-6db27f3225f2 tempest-VolumesListAdminTestJSON-1053362266 None] Deleted volume successfully. Jul 08 01:46:41 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1976d666-e4f0-4def-86fb-6db27f3225f2 tempest-VolumesListAdminTestJSON-1053362266 None] Lock "cinder-085bc72b-e949-4e86-a883-620f01fcc9b3-delete_volume" released by "delete_volume" :: held 3.094s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:46 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:46:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Flow 'volume_create_manager' (675bb90e-b1fd-420c-96af-af3206ea06a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfa38912-a578-4801-a7d2-417e92dbda19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfa38912-a578-4801-a7d2-417e92dbda19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1981093092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdbf65c1-7214-4ef7-bc3e-1404d9cf6054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b3bdfa726dc4bddb3ea9181010a79ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:47Z,use_quota=True,user_id='75cb858484644a8fa57f17e734e2918b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6c63d78-d0ac-4a0e-b1d6-b0218ad478eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6c63d78-d0ac-4a0e-b1d6-b0218ad478eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db95c6b8-df04-4075-9fdb-96c65537d498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:46 devstack cinder-volume[87284]: DEBUG cinder.image.glance [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Creating Keystone auth plugin from conf {{(pid=87284) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:46:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db95c6b8-df04-4075-9fdb-96c65537d498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fdbf65c1-7214-4ef7-bc3e-1404d9cf6054', 'volume_name': 'volume-fdbf65c1-7214-4ef7-bc3e-1404d9cf6054', 'volume_size': 1, 'image_id': '24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '083157d49fd649eb95508535e9c547e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'created_at': datetime.datetime(2026, 7, 7, 23, 23, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 23, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24b75d01-af4a-40ff-909b-cfbb4c8e9193/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06d052fb-dcf6-47ce-9790-dfd7967e6477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06d052fb-dcf6-47ce-9790-dfd7967e6477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b03a7387-94c5-4b58-b2d1-12be03fc9a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:47 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Volume fdbf65c1-7214-4ef7-bc3e-1404d9cf6054: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fdbf65c1-7214-4ef7-bc3e-1404d9cf6054', 'volume_size': 1, 'image_id': '24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '083157d49fd649eb95508535e9c547e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'created_at': datetime.datetime(2026, 7, 7, 23, 23, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 23, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24b75d01-af4a-40ff-909b-cfbb4c8e9193/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 01:46:47 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Trying to clone fdbf65c1-7214-4ef7-bc3e-1404d9cf6054 from image 24b75d01-af4a-40ff-909b-cfbb4c8e9193 at location (None, [{'url': 'file:///opt/stack/data/glance/images/24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'metadata': {}}]). {{(pid=87284) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:46:47 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193__nx8dhxkdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87284) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:46:47 devstack cinder-volume[87284]: INFO cinder.image.image_utils [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Image download 20.69 MB at 20.69 MB/s Jul 08 01:46:47 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c83d55-005f-4331-bb6d-db84a6692b4f]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193__nx8dhxkdevstack@QuobyteHD {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:47 devstack sudo[100887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193__nx8dhxkdevstack@QuobyteHD Jul 08 01:46:47 devstack sudo[100887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:48 devstack sudo[100887]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193__nx8dhxkdevstack@QuobyteHD" returned: 0 in 0.834s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:48 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Temporary image 24b75d01-af4a-40ff-909b-cfbb4c8e9193 is fetched for user 75cb858484644a8fa57f17e734e2918b. {{(pid=87284) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:46:48 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=70,cinder:INSERT=27,cinder:UPDATE=101,cinder:DELETE=7 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:46:48 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=82,cinder:INSERT=17,cinder:UPDATE=98,cinder:DELETE=10 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:46:48 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8a97a2-9778-4e32-8c17-d5eb73497829]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193__nx8dhxkdevstack@QuobyteHD {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:48 devstack sudo[100892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193__nx8dhxkdevstack@QuobyteHD Jul 08 01:46:48 devstack sudo[100892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:48 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aced0c6-cafb-432c-920e-393254a7269b tempest-CreateVolumesFromSnapshotTest-1626199979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:46:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4aced0c6-cafb-432c-920e-393254a7269b tempest-CreateVolumesFromSnapshotTest-1626199979 None] Flow 'volume_create_manager' (8b5a5405-5c2c-4288-8219-3c87a064e090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4aced0c6-cafb-432c-920e-393254a7269b tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf04d654-9882-42fc-b139-85fe5aed7896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4aced0c6-cafb-432c-920e-393254a7269b tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf04d654-9882-42fc-b139-85fe5aed7896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1370664691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8039d91-533b-41af-9ca6-07507d2cbd35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c77f57973f68414e9b5d00a77b2bdcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:49Z,use_quota=True,user_id='672ae680094b4dcf8f4f13359086ab72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4aced0c6-cafb-432c-920e-393254a7269b tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0911045d-a872-4139-b968-adb34155085e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4aced0c6-cafb-432c-920e-393254a7269b tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0911045d-a872-4139-b968-adb34155085e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4aced0c6-cafb-432c-920e-393254a7269b tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ed720a-931a-4129-89f8-bd979d9a7dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4aced0c6-cafb-432c-920e-393254a7269b tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ed720a-931a-4129-89f8-bd979d9a7dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8039d91-533b-41af-9ca6-07507d2cbd35', 'volume_name': 'volume-d8039d91-533b-41af-9ca6-07507d2cbd35', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4aced0c6-cafb-432c-920e-393254a7269b tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e91a92f-8c95-4c23-8dd4-902c3e694d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4aced0c6-cafb-432c-920e-393254a7269b tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e91a92f-8c95-4c23-8dd4-902c3e694d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4aced0c6-cafb-432c-920e-393254a7269b tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7939c7b9-2493-4f6a-b8f4-7b725c1c860a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:49 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-4aced0c6-cafb-432c-920e-393254a7269b tempest-CreateVolumesFromSnapshotTest-1626199979 None] Volume d8039d91-533b-41af-9ca6-07507d2cbd35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8039d91-533b-41af-9ca6-07507d2cbd35', 'volume_size': 1} Jul 08 01:46:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4aced0c6-cafb-432c-920e-393254a7269b tempest-CreateVolumesFromSnapshotTest-1626199979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4aced0c6-cafb-432c-920e-393254a7269b tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:49 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-4aced0c6-cafb-432c-920e-393254a7269b tempest-CreateVolumesFromSnapshotTest-1626199979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1370664691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8039d91-533b-41af-9ca6-07507d2cbd35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c77f57973f68414e9b5d00a77b2bdcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:49Z,use_quota=True,user_id='672ae680094b4dcf8f4f13359086ab72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:46:49 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-4aced0c6-cafb-432c-920e-393254a7269b tempest-CreateVolumesFromSnapshotTest-1626199979 None] Creating volume d8039d91-533b-41af-9ca6-07507d2cbd35 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:46:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4aced0c6-cafb-432c-920e-393254a7269b tempest-CreateVolumesFromSnapshotTest-1626199979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4aced0c6-cafb-432c-920e-393254a7269b tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:49 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-4aced0c6-cafb-432c-920e-393254a7269b tempest-CreateVolumesFromSnapshotTest-1626199979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:49 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-4aced0c6-cafb-432c-920e-393254a7269b tempest-CreateVolumesFromSnapshotTest-1626199979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4aced0c6-cafb-432c-920e-393254a7269b tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:49 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-4aced0c6-cafb-432c-920e-393254a7269b tempest-CreateVolumesFromSnapshotTest-1626199979 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:46:49 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-4aced0c6-cafb-432c-920e-393254a7269b tempest-CreateVolumesFromSnapshotTest-1626199979 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:46:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4aced0c6-cafb-432c-920e-393254a7269b tempest-CreateVolumesFromSnapshotTest-1626199979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:49 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6d9c6048-7c68-47e9-93b0-e82de4564f26 tempest-TestStampPattern-1873432706 None] Acquiring lock "cinder-64871dd3-7a1b-45f1-b847-c0ba3628df5c-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:49 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6d9c6048-7c68-47e9-93b0-e82de4564f26 tempest-TestStampPattern-1873432706 None] Lock "cinder-64871dd3-7a1b-45f1-b847-c0ba3628df5c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:49 devstack sudo[100894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35 1073741824 Jul 08 01:46:49 devstack sudo[100894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:49 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6d9c6048-7c68-47e9-93b0-e82de4564f26 tempest-TestStampPattern-1873432706 None] Acquiring lock "cinder-quobyte-64871dd3-7a1b-45f1-b847-c0ba3628df5c" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:49 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6d9c6048-7c68-47e9-93b0-e82de4564f26 tempest-TestStampPattern-1873432706 None] Lock "cinder-quobyte-64871dd3-7a1b-45f1-b847-c0ba3628df5c" acquired by "delete_volume" :: waited 0.020s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:49 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[828a80c3-6d61-464c-bbad-24bfc91237c5]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6d9c6048-7c68-47e9-93b0-e82de4564f26 tempest-TestStampPattern-1873432706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64871dd3-7a1b-45f1-b847-c0ba3628df5c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:49 devstack sudo[100896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64871dd3-7a1b-45f1-b847-c0ba3628df5c Jul 08 01:46:49 devstack sudo[100896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:49 devstack sudo[100892]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193__nx8dhxkdevstack@QuobyteHD" returned: 0 in 0.884s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:50 devstack sudo[100896]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6d9c6048-7c68-47e9-93b0-e82de4564f26 tempest-TestStampPattern-1873432706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64871dd3-7a1b-45f1-b847-c0ba3628df5c" returned: 0 in 0.793s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6d9c6048-7c68-47e9-93b0-e82de4564f26 tempest-TestStampPattern-1873432706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64871dd3-7a1b-45f1-b847-c0ba3628df5c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:50 devstack sudo[100894]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4aced0c6-cafb-432c-920e-393254a7269b tempest-CreateVolumesFromSnapshotTest-1626199979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35 1073741824" returned: 0 in 0.923s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:50 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64871dd3-7a1b-45f1-b847-c0ba3628df5c Jul 08 01:46:50 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4aced0c6-cafb-432c-920e-393254a7269b tempest-CreateVolumesFromSnapshotTest-1626199979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:50 devstack sudo[100910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35 Jul 08 01:46:50 devstack sudo[100910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:50 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6d9c6048-7c68-47e9-93b0-e82de4564f26 tempest-TestStampPattern-1873432706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64871dd3-7a1b-45f1-b847-c0ba3628df5c" returned: 0 in 0.649s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:50 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6d9c6048-7c68-47e9-93b0-e82de4564f26 tempest-TestStampPattern-1873432706 None] Lock "cinder-quobyte-64871dd3-7a1b-45f1-b847-c0ba3628df5c" released by "delete_volume" :: held 1.492s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:50 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-6d9c6048-7c68-47e9-93b0-e82de4564f26 tempest-TestStampPattern-1873432706 None] Created reservations ['e37d148d-24bc-4368-a6c6-2716977ed7ac', '916f4e92-5718-40e2-a028-b5907f725d6d', '6e24facd-5034-411a-9d26-2eecc99d7eca', '406877e0-7032-49f5-82af-34a56fedd33e'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:46:50 devstack sudo[100910]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4aced0c6-cafb-432c-920e-393254a7269b tempest-CreateVolumesFromSnapshotTest-1626199979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35" returned: 0 in 0.732s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-4aced0c6-cafb-432c-920e-393254a7269b tempest-CreateVolumesFromSnapshotTest-1626199979 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:46:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4aced0c6-cafb-432c-920e-393254a7269b tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.224s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1981093092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdbf65c1-7214-4ef7-bc3e-1404d9cf6054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b3bdfa726dc4bddb3ea9181010a79ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:47Z,use_quota=True,user_id='75cb858484644a8fa57f17e734e2918b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:46:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Creating volume fdbf65c1-7214-4ef7-bc3e-1404d9cf6054 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:46:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:46:50 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:46:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fdbf65c1-7214-4ef7-bc3e-1404d9cf6054 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:50 devstack sudo[100914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fdbf65c1-7214-4ef7-bc3e-1404d9cf6054 1073741824 Jul 08 01:46:50 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4aced0c6-cafb-432c-920e-393254a7269b tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7939c7b9-2493-4f6a-b8f4-7b725c1c860a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8039d91-533b-41af-9ca6-07507d2cbd35', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4aced0c6-cafb-432c-920e-393254a7269b tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0e1e132-3074-4bf7-afc2-03e640ed05b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:50 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-4aced0c6-cafb-432c-920e-393254a7269b tempest-CreateVolumesFromSnapshotTest-1626199979 None] Volume volume-d8039d91-533b-41af-9ca6-07507d2cbd35 (d8039d91-533b-41af-9ca6-07507d2cbd35): created successfully Jul 08 01:46:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4aced0c6-cafb-432c-920e-393254a7269b tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0e1e132-3074-4bf7-afc2-03e640ed05b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4aced0c6-cafb-432c-920e-393254a7269b tempest-CreateVolumesFromSnapshotTest-1626199979 None] Flow 'volume_create_manager' (8b5a5405-5c2c-4288-8219-3c87a064e090) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6d9c6048-7c68-47e9-93b0-e82de4564f26 tempest-TestStampPattern-1873432706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6d9c6048-7c68-47e9-93b0-e82de4564f26 tempest-TestStampPattern-1873432706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-6d9c6048-7c68-47e9-93b0-e82de4564f26 tempest-TestStampPattern-1873432706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-6d9c6048-7c68-47e9-93b0-e82de4564f26 tempest-TestStampPattern-1873432706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6d9c6048-7c68-47e9-93b0-e82de4564f26 tempest-TestStampPattern-1873432706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6d9c6048-7c68-47e9-93b0-e82de4564f26 tempest-TestStampPattern-1873432706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:50 devstack sudo[100916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:46:50 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-4aced0c6-cafb-432c-920e-393254a7269b tempest-CreateVolumesFromSnapshotTest-1626199979 None] Created volume successfully. Jul 08 01:46:50 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f2c04859-6a30-44dd-9d6c-711f7a5db6af tempest-CreateVolumesFromSnapshotTest-1626199979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:51 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6d9c6048-7c68-47e9-93b0-e82de4564f26 tempest-TestStampPattern-1873432706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.753s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:51 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-6d9c6048-7c68-47e9-93b0-e82de4564f26 tempest-TestStampPattern-1873432706 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:46:51 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-6d9c6048-7c68-47e9-93b0-e82de4564f26 tempest-TestStampPattern-1873432706 None] Deleted volume successfully. Jul 08 01:46:51 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6d9c6048-7c68-47e9-93b0-e82de4564f26 tempest-TestStampPattern-1873432706 None] Lock "cinder-64871dd3-7a1b-45f1-b847-c0ba3628df5c-delete_volume" released by "delete_volume" :: held 2.574s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:51 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-466e9c14-6ef2-4f67-bc3e-84a02a991e53 tempest-TestStampPattern-1873432706 None] Acquiring lock "cinder-46b1eecb-2227-4fc6-b94e-3f4bc503947e-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:51 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-466e9c14-6ef2-4f67-bc3e-84a02a991e53 tempest-TestStampPattern-1873432706 None] Lock "cinder-46b1eecb-2227-4fc6-b94e-3f4bc503947e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:51 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-466e9c14-6ef2-4f67-bc3e-84a02a991e53 tempest-TestStampPattern-1873432706 None] Acquiring lock "cinder-quobyte-d254098a-3644-4edf-a91a-f89e94d9c147" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:51 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-466e9c14-6ef2-4f67-bc3e-84a02a991e53 tempest-TestStampPattern-1873432706 None] Lock "cinder-quobyte-d254098a-3644-4edf-a91a-f89e94d9c147" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:51 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-466e9c14-6ef2-4f67-bc3e-84a02a991e53 tempest-TestStampPattern-1873432706 None] Acquiring lock "cinder-quobyte-46b1eecb-2227-4fc6-b94e-3f4bc503947e" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:51 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-466e9c14-6ef2-4f67-bc3e-84a02a991e53 tempest-TestStampPattern-1873432706 None] Lock "cinder-quobyte-46b1eecb-2227-4fc6-b94e-3f4bc503947e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:51 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-466e9c14-6ef2-4f67-bc3e-84a02a991e53 tempest-TestStampPattern-1873432706 None] Deleting offline snapshot 46b1eecb-2227-4fc6-b94e-3f4bc503947e of volume d254098a-3644-4edf-a91a-f89e94d9c147 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:46:51 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-466e9c14-6ef2-4f67-bc3e-84a02a991e53 tempest-TestStampPattern-1873432706 None] snapshot_file for this snap is: volume-d254098a-3644-4edf-a91a-f89e94d9c147.46b1eecb-2227-4fc6-b94e-3f4bc503947e {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:46:51 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cd8e75-dbd0-47c0-9fc2-4f5183c78bba]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-466e9c14-6ef2-4f67-bc3e-84a02a991e53 tempest-TestStampPattern-1873432706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147.46b1eecb-2227-4fc6-b94e-3f4bc503947e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:51 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fdbf65c1-7214-4ef7-bc3e-1404d9cf6054 1073741824" returned: 0 in 1.074s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fdbf65c1-7214-4ef7-bc3e-1404d9cf6054 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:51 devstack sudo[100923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147.46b1eecb-2227-4fc6-b94e-3f4bc503947e Jul 08 01:46:51 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:51 devstack sudo[100924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fdbf65c1-7214-4ef7-bc3e-1404d9cf6054 Jul 08 01:46:51 devstack sudo[100924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:52 devstack sudo[100924]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fdbf65c1-7214-4ef7-bc3e-1404d9cf6054" returned: 0 in 0.661s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] <== create_volume: return (1784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:46:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.788s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f2c04859-6a30-44dd-9d6c-711f7a5db6af tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.350s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-f2c04859-6a30-44dd-9d6c-711f7a5db6af tempest-CreateVolumesFromSnapshotTest-1626199979 None] Creating offline snapshot 6dfe6f34-0656-4704-bf0b-a9a97da8fa98 of volume d8039d91-533b-41af-9ca6-07507d2cbd35 {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:46:52 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-466e9c14-6ef2-4f67-bc3e-84a02a991e53 tempest-TestStampPattern-1873432706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147.46b1eecb-2227-4fc6-b94e-3f4bc503947e" returned: 0 in 0.802s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-466e9c14-6ef2-4f67-bc3e-84a02a991e53 tempest-TestStampPattern-1873432706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d254098a-3644-4edf-a91a-f89e94d9c147(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:46:52 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa21793-96f3-421e-836c-f78ad066d5b4]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f2c04859-6a30-44dd-9d6c-711f7a5db6af tempest-CreateVolumesFromSnapshotTest-1626199979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:52 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddab1ad3-46e3-428c-b878-f5750e140f9f]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-466e9c14-6ef2-4f67-bc3e-84a02a991e53 tempest-TestStampPattern-1873432706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:52 devstack cinder-volume[87284]: DEBUG cinder.volume.volume_utils [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Attempting download of 24b75d01-af4a-40ff-909b-cfbb4c8e9193 ((None, [{'url': 'file:///opt/stack/data/glance/images/24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'metadata': {}}])) to volume fdbf65c1-7214-4ef7-bc3e-1404d9cf6054. {{(pid=87284) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:46:52 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[852712dc-28c0-4ebf-86c9-b03e0beed436]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24b75d01-af4a-40ff-909b-cfbb4c8e9193_i6z4vhv_ {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:52 devstack sudo[100931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35 Jul 08 01:46:52 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:52 devstack sudo[100932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147 Jul 08 01:46:52 devstack sudo[100932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:52 devstack sudo[100933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24b75d01-af4a-40ff-909b-cfbb4c8e9193_i6z4vhv_ Jul 08 01:46:52 devstack sudo[100933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:53 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f2c04859-6a30-44dd-9d6c-711f7a5db6af tempest-CreateVolumesFromSnapshotTest-1626199979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35" returned: 0 in 0.824s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f2c04859-6a30-44dd-9d6c-711f7a5db6af tempest-CreateVolumesFromSnapshotTest-1626199979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35.6dfe6f34-0656-4704-bf0b-a9a97da8fa98 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:53 devstack sudo[100945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35.6dfe6f34-0656-4704-bf0b-a9a97da8fa98 1G Jul 08 01:46:53 devstack sudo[100945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:53 devstack sudo[100932]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-466e9c14-6ef2-4f67-bc3e-84a02a991e53 tempest-TestStampPattern-1873432706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147" returned: 0 in 0.850s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-466e9c14-6ef2-4f67-bc3e-84a02a991e53 tempest-TestStampPattern-1873432706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147.46b1eecb-2227-4fc6-b94e-3f4bc503947e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:53 devstack sudo[100947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147.46b1eecb-2227-4fc6-b94e-3f4bc503947e Jul 08 01:46:53 devstack sudo[100947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:53 devstack sudo[100933]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24b75d01-af4a-40ff-909b-cfbb4c8e9193_i6z4vhv_" returned: 0 in 0.815s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24b75d01-af4a-40ff-909b-cfbb4c8e9193_i6z4vhv_ {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:53 devstack sudo[100949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24b75d01-af4a-40ff-909b-cfbb4c8e9193_i6z4vhv_ Jul 08 01:46:53 devstack sudo[100949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:54 devstack sudo[100947]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-466e9c14-6ef2-4f67-bc3e-84a02a991e53 tempest-TestStampPattern-1873432706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147.46b1eecb-2227-4fc6-b94e-3f4bc503947e" returned: 0 in 0.787s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-466e9c14-6ef2-4f67-bc3e-84a02a991e53 tempest-TestStampPattern-1873432706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147.46b1eecb-2227-4fc6-b94e-3f4bc503947e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:54 devstack sudo[100945]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f2c04859-6a30-44dd-9d6c-711f7a5db6af tempest-CreateVolumesFromSnapshotTest-1626199979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35.6dfe6f34-0656-4704-bf0b-a9a97da8fa98 1G" returned: 0 in 0.858s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f2c04859-6a30-44dd-9d6c-711f7a5db6af tempest-CreateVolumesFromSnapshotTest-1626199979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8039d91-533b-41af-9ca6-07507d2cbd35 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35.6dfe6f34-0656-4704-bf0b-a9a97da8fa98 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:54 devstack sudo[100960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147.46b1eecb-2227-4fc6-b94e-3f4bc503947e Jul 08 01:46:54 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:54 devstack sudo[100949]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24b75d01-af4a-40ff-909b-cfbb4c8e9193_i6z4vhv_" returned: 1 in 0.807s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:54 devstack sudo[100961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8039d91-533b-41af-9ca6-07507d2cbd35 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35.6dfe6f34-0656-4704-bf0b-a9a97da8fa98 Jul 08 01:46:54 devstack sudo[100961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24b75d01-af4a-40ff-909b-cfbb4c8e9193_i6z4vhv_' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:46:54 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dce934-7396-41f7-8ea7-a2628089b8ad]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193__nx8dhxkdevstack@QuobyteHD {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:54 devstack sudo[100964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193__nx8dhxkdevstack@QuobyteHD Jul 08 01:46:54 devstack sudo[100964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:55 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-466e9c14-6ef2-4f67-bc3e-84a02a991e53 tempest-TestStampPattern-1873432706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147.46b1eecb-2227-4fc6-b94e-3f4bc503947e" returned: 0 in 0.728s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:55 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-466e9c14-6ef2-4f67-bc3e-84a02a991e53 tempest-TestStampPattern-1873432706 None] Lock "cinder-quobyte-46b1eecb-2227-4fc6-b94e-3f4bc503947e" released by "_delete_snapshot" :: held 3.310s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:55 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-466e9c14-6ef2-4f67-bc3e-84a02a991e53 tempest-TestStampPattern-1873432706 None] Lock "cinder-quobyte-d254098a-3644-4edf-a91a-f89e94d9c147" released by "delete_snapshot" :: held 3.345s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:55 devstack sudo[100961]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f2c04859-6a30-44dd-9d6c-711f7a5db6af tempest-CreateVolumesFromSnapshotTest-1626199979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8039d91-533b-41af-9ca6-07507d2cbd35 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35.6dfe6f34-0656-4704-bf0b-a9a97da8fa98" returned: 0 in 0.772s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:55 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-f2c04859-6a30-44dd-9d6c-711f7a5db6af tempest-CreateVolumesFromSnapshotTest-1626199979 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35.6dfe6f34-0656-4704-bf0b-a9a97da8fa98 is being set with open permissions: ugo+rw Jul 08 01:46:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f2c04859-6a30-44dd-9d6c-711f7a5db6af tempest-CreateVolumesFromSnapshotTest-1626199979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35.6dfe6f34-0656-4704-bf0b-a9a97da8fa98 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:55 devstack sudo[100964]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193__nx8dhxkdevstack@QuobyteHD" returned: 0 in 0.768s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:55 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] 24b75d01-af4a-40ff-909b-cfbb4c8e9193 was qcow2, converting to raw {{(pid=87284) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:46:55 devstack sudo[100973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35.6dfe6f34-0656-4704-bf0b-a9a97da8fa98 Jul 08 01:46:55 devstack sudo[100973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193__nx8dhxkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fdbf65c1-7214-4ef7-bc3e-1404d9cf6054 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:55 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193__nx8dhxkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fdbf65c1-7214-4ef7-bc3e-1404d9cf6054 Jul 08 01:46:55 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:55 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:46:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:55 devstack sudo[100978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:46:55 devstack sudo[100978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:55 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-466e9c14-6ef2-4f67-bc3e-84a02a991e53 tempest-TestStampPattern-1873432706 None] Created reservations ['ce08a272-e8b2-425c-b693-88ccb39967ff', 'a2ed87b0-cc42-4689-b8d1-aae5e97ae1ab', '59292215-e723-4afa-be8f-d19aeb574751', '37720320-f9fb-4c71-bc76-2b2215074bb8'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:46:55 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-466e9c14-6ef2-4f67-bc3e-84a02a991e53 tempest-TestStampPattern-1873432706 None] Delete snapshot completed successfully. Jul 08 01:46:55 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-466e9c14-6ef2-4f67-bc3e-84a02a991e53 tempest-TestStampPattern-1873432706 None] Lock "cinder-46b1eecb-2227-4fc6-b94e-3f4bc503947e-delete_snapshot" released by "delete_snapshot" :: held 3.566s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:55 devstack sudo[100973]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f2c04859-6a30-44dd-9d6c-711f7a5db6af tempest-CreateVolumesFromSnapshotTest-1626199979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35.6dfe6f34-0656-4704-bf0b-a9a97da8fa98" returned: 0 in 0.756s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:55 devstack sudo[100978]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.697s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:55 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:46:55 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager._thread_info {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:46:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread count: 29 {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:46:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread info: [<_MainThread(MainThread, started 127058402500736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:46:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f2c04859-6a30-44dd-9d6c-711f7a5db6af tempest-CreateVolumesFromSnapshotTest-1626199979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:55 devstack sudo[100990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35.info Jul 08 01:46:55 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:56 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f2c04859-6a30-44dd-9d6c-711f7a5db6af tempest-CreateVolumesFromSnapshotTest-1626199979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35.info" returned: 0 in 0.758s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:56 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-f2c04859-6a30-44dd-9d6c-711f7a5db6af tempest-CreateVolumesFromSnapshotTest-1626199979 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35.info is being set with open permissions: ugo+rw Jul 08 01:46:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f2c04859-6a30-44dd-9d6c-711f7a5db6af tempest-CreateVolumesFromSnapshotTest-1626199979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:56 devstack sudo[100993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35.info Jul 08 01:46:56 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:57 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193__nx8dhxkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fdbf65c1-7214-4ef7-bc3e-1404d9cf6054" returned: 0 in 2.255s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:57 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193__nx8dhxkdevstack@QuobyteHD, size 112.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fdbf65c1-7214-4ef7-bc3e-1404d9cf6054 {{(pid=87284) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:46:57 devstack cinder-volume[87284]: INFO cinder.image.image_utils [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Converted 112.00 MB image at 49.64 MB/s Jul 08 01:46:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fdbf65c1-7214-4ef7-bc3e-1404d9cf6054 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:57 devstack sudo[100998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fdbf65c1-7214-4ef7-bc3e-1404d9cf6054 1G Jul 08 01:46:57 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:57 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f2c04859-6a30-44dd-9d6c-711f7a5db6af tempest-CreateVolumesFromSnapshotTest-1626199979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35.info" returned: 0 in 0.865s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f2c04859-6a30-44dd-9d6c-711f7a5db6af tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.966s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:57 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-f2c04859-6a30-44dd-9d6c-711f7a5db6af tempest-CreateVolumesFromSnapshotTest-1626199979 None] Create snapshot completed successfully Jul 08 01:46:58 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fdbf65c1-7214-4ef7-bc3e-1404d9cf6054 1G" returned: 0 in 0.811s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:58 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bccf5d-d5ca-45c5-82bd-8e0e08227052]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fdbf65c1-7214-4ef7-bc3e-1404d9cf6054 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:58 devstack sudo[101007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fdbf65c1-7214-4ef7-bc3e-1404d9cf6054 Jul 08 01:46:58 devstack sudo[101007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:59 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-38107c25-66cf-4bd4-8ea2-0860a0412dac tempest-CreateVolumesFromSnapshotTest-1626199979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:46:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-38107c25-66cf-4bd4-8ea2-0860a0412dac tempest-CreateVolumesFromSnapshotTest-1626199979 None] Flow 'volume_create_manager' (aca61305-701a-443e-9e46-72c0d76cd768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-38107c25-66cf-4bd4-8ea2-0860a0412dac tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d09c571-54d9-4469-a004-5bd28cdb967f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:59 devstack sudo[101007]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-38107c25-66cf-4bd4-8ea2-0860a0412dac tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d09c571-54d9-4469-a004-5bd28cdb967f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1098913967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed314c3-f4d9-437f-af53-aba85e12618f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c77f57973f68414e9b5d00a77b2bdcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:59Z,use_quota=True,user_id='672ae680094b4dcf8f4f13359086ab72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-38107c25-66cf-4bd4-8ea2-0860a0412dac tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61e7ddac-0f87-493d-b09b-5b7ab7f3a549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-38107c25-66cf-4bd4-8ea2-0860a0412dac tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61e7ddac-0f87-493d-b09b-5b7ab7f3a549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-38107c25-66cf-4bd4-8ea2-0860a0412dac tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (326da17a-bf6a-4c6b-a08c-b1100d831d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-38107c25-66cf-4bd4-8ea2-0860a0412dac tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (326da17a-bf6a-4c6b-a08c-b1100d831d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eed314c3-f4d9-437f-af53-aba85e12618f', 'volume_name': 'volume-eed314c3-f4d9-437f-af53-aba85e12618f', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-38107c25-66cf-4bd4-8ea2-0860a0412dac tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11fb5e13-19d7-4ef3-867a-6d6d8efe6973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-38107c25-66cf-4bd4-8ea2-0860a0412dac tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11fb5e13-19d7-4ef3-867a-6d6d8efe6973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-38107c25-66cf-4bd4-8ea2-0860a0412dac tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdec46bb-2f4c-472d-8f41-6fd112dbe443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:59 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-38107c25-66cf-4bd4-8ea2-0860a0412dac tempest-CreateVolumesFromSnapshotTest-1626199979 None] Volume eed314c3-f4d9-437f-af53-aba85e12618f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eed314c3-f4d9-437f-af53-aba85e12618f', 'volume_size': 1} Jul 08 01:46:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-38107c25-66cf-4bd4-8ea2-0860a0412dac tempest-CreateVolumesFromSnapshotTest-1626199979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-38107c25-66cf-4bd4-8ea2-0860a0412dac tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:59 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-38107c25-66cf-4bd4-8ea2-0860a0412dac tempest-CreateVolumesFromSnapshotTest-1626199979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1098913967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed314c3-f4d9-437f-af53-aba85e12618f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c77f57973f68414e9b5d00a77b2bdcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:59Z,use_quota=True,user_id='672ae680094b4dcf8f4f13359086ab72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:46:59 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-38107c25-66cf-4bd4-8ea2-0860a0412dac tempest-CreateVolumesFromSnapshotTest-1626199979 None] Creating volume eed314c3-f4d9-437f-af53-aba85e12618f {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:46:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-38107c25-66cf-4bd4-8ea2-0860a0412dac tempest-CreateVolumesFromSnapshotTest-1626199979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-38107c25-66cf-4bd4-8ea2-0860a0412dac tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:59 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-38107c25-66cf-4bd4-8ea2-0860a0412dac tempest-CreateVolumesFromSnapshotTest-1626199979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:59 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-38107c25-66cf-4bd4-8ea2-0860a0412dac tempest-CreateVolumesFromSnapshotTest-1626199979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-38107c25-66cf-4bd4-8ea2-0860a0412dac tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:59 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-38107c25-66cf-4bd4-8ea2-0860a0412dac tempest-CreateVolumesFromSnapshotTest-1626199979 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:46:59 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-38107c25-66cf-4bd4-8ea2-0860a0412dac tempest-CreateVolumesFromSnapshotTest-1626199979 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:46:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-38107c25-66cf-4bd4-8ea2-0860a0412dac tempest-CreateVolumesFromSnapshotTest-1626199979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eed314c3-f4d9-437f-af53-aba85e12618f 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fdbf65c1-7214-4ef7-bc3e-1404d9cf6054" returned: 0 in 1.102s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fdbf65c1-7214-4ef7-bc3e-1404d9cf6054 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:59 devstack sudo[101030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eed314c3-f4d9-437f-af53-aba85e12618f 1073741824 Jul 08 01:46:59 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:59 devstack sudo[101031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fdbf65c1-7214-4ef7-bc3e-1404d9cf6054 Jul 08 01:46:59 devstack sudo[101031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:59 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f239100-90d1-4053-8854-106112aa8f1f tempest-CreateVolumesFromSnapshotTest-1626199979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:46:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8f239100-90d1-4053-8854-106112aa8f1f tempest-CreateVolumesFromSnapshotTest-1626199979 None] Flow 'volume_create_manager' (69db120f-21ce-4d6d-91f2-7d094adca4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8f239100-90d1-4053-8854-106112aa8f1f tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23bccfc3-92e2-4c65-95d2-0f63c7bc7f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8f239100-90d1-4053-8854-106112aa8f1f tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23bccfc3-92e2-4c65-95d2-0f63c7bc7f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-947823094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62b9e3a1-237a-4d98-a842-c11abff1df61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c77f57973f68414e9b5d00a77b2bdcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:00Z,use_quota=True,user_id='672ae680094b4dcf8f4f13359086ab72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8f239100-90d1-4053-8854-106112aa8f1f tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af467103-7d23-425c-ae14-536b7009a766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8f239100-90d1-4053-8854-106112aa8f1f tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af467103-7d23-425c-ae14-536b7009a766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8f239100-90d1-4053-8854-106112aa8f1f tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b1cdfc1-0fbd-4252-8f0e-cc9ec13b16cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8f239100-90d1-4053-8854-106112aa8f1f tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b1cdfc1-0fbd-4252-8f0e-cc9ec13b16cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62b9e3a1-237a-4d98-a842-c11abff1df61', 'volume_name': 'volume-62b9e3a1-237a-4d98-a842-c11abff1df61', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8f239100-90d1-4053-8854-106112aa8f1f tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbb70131-7a0a-4f92-8fa0-749c89b52939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8f239100-90d1-4053-8854-106112aa8f1f tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbb70131-7a0a-4f92-8fa0-749c89b52939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8f239100-90d1-4053-8854-106112aa8f1f tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (659e0ff2-7d58-47df-986c-b239a25417f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:00 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-8f239100-90d1-4053-8854-106112aa8f1f tempest-CreateVolumesFromSnapshotTest-1626199979 None] Volume 62b9e3a1-237a-4d98-a842-c11abff1df61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62b9e3a1-237a-4d98-a842-c11abff1df61', 'volume_size': 1} Jul 08 01:47:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8f239100-90d1-4053-8854-106112aa8f1f tempest-CreateVolumesFromSnapshotTest-1626199979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:00 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-992bfe9e-5a21-4b0a-9cd2-7124b7338032 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:47:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-992bfe9e-5a21-4b0a-9cd2-7124b7338032 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Flow 'volume_create_manager' (cc02632f-b8a6-4bbd-a72b-040b7c903234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-992bfe9e-5a21-4b0a-9cd2-7124b7338032 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dc93fe9-7718-495d-bb9e-eda74c5d8f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-992bfe9e-5a21-4b0a-9cd2-7124b7338032 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dc93fe9-7718-495d-bb9e-eda74c5d8f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-95025614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce08e368-1e27-453f-8140-f5c963448ee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c77f57973f68414e9b5d00a77b2bdcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:01Z,use_quota=True,user_id='672ae680094b4dcf8f4f13359086ab72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-992bfe9e-5a21-4b0a-9cd2-7124b7338032 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17733bd8-3421-4219-8702-6337f4684849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-992bfe9e-5a21-4b0a-9cd2-7124b7338032 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17733bd8-3421-4219-8702-6337f4684849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-992bfe9e-5a21-4b0a-9cd2-7124b7338032 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87677944-67f2-46df-8619-857a8b5244bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-992bfe9e-5a21-4b0a-9cd2-7124b7338032 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87677944-67f2-46df-8619-857a8b5244bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce08e368-1e27-453f-8140-f5c963448ee1', 'volume_name': 'volume-ce08e368-1e27-453f-8140-f5c963448ee1', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-992bfe9e-5a21-4b0a-9cd2-7124b7338032 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d526938b-97ce-4e22-a528-47b245d5c098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-992bfe9e-5a21-4b0a-9cd2-7124b7338032 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d526938b-97ce-4e22-a528-47b245d5c098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-992bfe9e-5a21-4b0a-9cd2-7124b7338032 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (900c5851-810a-4e90-8c31-b412764d7f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:00 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-992bfe9e-5a21-4b0a-9cd2-7124b7338032 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Volume ce08e368-1e27-453f-8140-f5c963448ee1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce08e368-1e27-453f-8140-f5c963448ee1', 'volume_size': 1} Jul 08 01:47:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-992bfe9e-5a21-4b0a-9cd2-7124b7338032 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:00 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:00 devstack sudo[101031]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-38107c25-66cf-4bd4-8ea2-0860a0412dac tempest-CreateVolumesFromSnapshotTest-1626199979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eed314c3-f4d9-437f-af53-aba85e12618f 1073741824" returned: 0 in 1.406s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fdbf65c1-7214-4ef7-bc3e-1404d9cf6054" returned: 1 in 1.392s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fdbf65c1-7214-4ef7-bc3e-1404d9cf6054' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:47:00 devstack cinder-volume[87284]: DEBUG cinder.volume.volume_utils [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Downloaded image 24b75d01-af4a-40ff-909b-cfbb4c8e9193 ((None, [{'url': 'file:///opt/stack/data/glance/images/24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'metadata': {}}])) to volume fdbf65c1-7214-4ef7-bc3e-1404d9cf6054 successfully. {{(pid=87284) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:47:00 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Temporary image 24b75d01-af4a-40ff-909b-cfbb4c8e9193 for user 75cb858484644a8fa57f17e734e2918b is deleted. {{(pid=87284) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:47:00 devstack cinder-volume[87284]: DEBUG cinder.volume.volume_utils [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Marking volume fdbf65c1-7214-4ef7-bc3e-1404d9cf6054 as bootable. {{(pid=87284) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:47:00 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Copying metadata from image 24b75d01-af4a-40ff-909b-cfbb4c8e9193 to fdbf65c1-7214-4ef7-bc3e-1404d9cf6054. {{(pid=87284) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:47:00 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Creating volume glance metadata for volume fdbf65c1-7214-4ef7-bc3e-1404d9cf6054 backed by image 24b75d01-af4a-40ff-909b-cfbb4c8e9193 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87284) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:47:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-38107c25-66cf-4bd4-8ea2-0860a0412dac tempest-CreateVolumesFromSnapshotTest-1626199979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eed314c3-f4d9-437f-af53-aba85e12618f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:00 devstack sudo[101044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eed314c3-f4d9-437f-af53-aba85e12618f Jul 08 01:47:00 devstack sudo[101044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b03a7387-94c5-4b58-b2d1-12be03fc9a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdbf65c1-7214-4ef7-bc3e-1404d9cf6054', 'volume_size': 1, 'image_id': '24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '083157d49fd649eb95508535e9c547e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'created_at': datetime.datetime(2026, 7, 7, 23, 23, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 23, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24b75d01-af4a-40ff-909b-cfbb4c8e9193/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5905473-ef80-4492-a2d6-8dd95b73dd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:00 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Volume volume-fdbf65c1-7214-4ef7-bc3e-1404d9cf6054 (fdbf65c1-7214-4ef7-bc3e-1404d9cf6054): created successfully Jul 08 01:47:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5905473-ef80-4492-a2d6-8dd95b73dd7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Flow 'volume_create_manager' (675bb90e-b1fd-420c-96af-af3206ea06a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:00 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-03654ef4-35d2-406a-8b0e-12d611fbb83b tempest-VolumesImageMetadata-98566585 None] Created volume successfully. Jul 08 01:47:01 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb874cfe-d44c-48bb-b0ae-08c75a39132e tempest-CreateVolumesFromSnapshotTest-1626199979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:47:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fb874cfe-d44c-48bb-b0ae-08c75a39132e tempest-CreateVolumesFromSnapshotTest-1626199979 None] Flow 'volume_create_manager' (9c482def-cf67-4f3c-919b-7c91ef8aca2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fb874cfe-d44c-48bb-b0ae-08c75a39132e tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e93029f-0035-439c-9182-f22866b9c172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fb874cfe-d44c-48bb-b0ae-08c75a39132e tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e93029f-0035-439c-9182-f22866b9c172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-240195216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ade0ccb-ac1d-4ccf-bacb-c76635c18814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c77f57973f68414e9b5d00a77b2bdcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:01Z,use_quota=True,user_id='672ae680094b4dcf8f4f13359086ab72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fb874cfe-d44c-48bb-b0ae-08c75a39132e tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (688649ee-d279-4729-8773-0bfc12f243ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fb874cfe-d44c-48bb-b0ae-08c75a39132e tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (688649ee-d279-4729-8773-0bfc12f243ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fb874cfe-d44c-48bb-b0ae-08c75a39132e tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31c404f2-da22-4e4a-a52f-e8f6f81cdd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fb874cfe-d44c-48bb-b0ae-08c75a39132e tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31c404f2-da22-4e4a-a52f-e8f6f81cdd0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ade0ccb-ac1d-4ccf-bacb-c76635c18814', 'volume_name': 'volume-1ade0ccb-ac1d-4ccf-bacb-c76635c18814', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fb874cfe-d44c-48bb-b0ae-08c75a39132e tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98938800-e0b0-4ca2-8f1d-ee6968e192f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fb874cfe-d44c-48bb-b0ae-08c75a39132e tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98938800-e0b0-4ca2-8f1d-ee6968e192f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fb874cfe-d44c-48bb-b0ae-08c75a39132e tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0480bfe-6e61-4bdf-b954-e8963d651b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:01 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-fb874cfe-d44c-48bb-b0ae-08c75a39132e tempest-CreateVolumesFromSnapshotTest-1626199979 None] Volume 1ade0ccb-ac1d-4ccf-bacb-c76635c18814: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ade0ccb-ac1d-4ccf-bacb-c76635c18814', 'volume_size': 1} Jul 08 01:47:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-fb874cfe-d44c-48bb-b0ae-08c75a39132e tempest-CreateVolumesFromSnapshotTest-1626199979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:01 devstack sudo[101044]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-38107c25-66cf-4bd4-8ea2-0860a0412dac tempest-CreateVolumesFromSnapshotTest-1626199979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eed314c3-f4d9-437f-af53-aba85e12618f" returned: 0 in 0.780s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:01 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-38107c25-66cf-4bd4-8ea2-0860a0412dac tempest-CreateVolumesFromSnapshotTest-1626199979 None] <== create_volume: return (2246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:47:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-38107c25-66cf-4bd4-8ea2-0860a0412dac tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.248s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8f239100-90d1-4053-8854-106112aa8f1f tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.441s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:01 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-8f239100-90d1-4053-8854-106112aa8f1f tempest-CreateVolumesFromSnapshotTest-1626199979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-947823094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62b9e3a1-237a-4d98-a842-c11abff1df61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c77f57973f68414e9b5d00a77b2bdcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:00Z,use_quota=True,user_id='672ae680094b4dcf8f4f13359086ab72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:47:01 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-8f239100-90d1-4053-8854-106112aa8f1f tempest-CreateVolumesFromSnapshotTest-1626199979 None] Creating volume 62b9e3a1-237a-4d98-a842-c11abff1df61 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:47:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8f239100-90d1-4053-8854-106112aa8f1f tempest-CreateVolumesFromSnapshotTest-1626199979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8f239100-90d1-4053-8854-106112aa8f1f tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:01 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-8f239100-90d1-4053-8854-106112aa8f1f tempest-CreateVolumesFromSnapshotTest-1626199979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:01 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-8f239100-90d1-4053-8854-106112aa8f1f tempest-CreateVolumesFromSnapshotTest-1626199979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8f239100-90d1-4053-8854-106112aa8f1f tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:01 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-8f239100-90d1-4053-8854-106112aa8f1f tempest-CreateVolumesFromSnapshotTest-1626199979 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:47:01 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-8f239100-90d1-4053-8854-106112aa8f1f tempest-CreateVolumesFromSnapshotTest-1626199979 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:47:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8f239100-90d1-4053-8854-106112aa8f1f tempest-CreateVolumesFromSnapshotTest-1626199979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-62b9e3a1-237a-4d98-a842-c11abff1df61 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:01 devstack sudo[101048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-62b9e3a1-237a-4d98-a842-c11abff1df61 1073741824 Jul 08 01:47:01 devstack sudo[101048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-38107c25-66cf-4bd4-8ea2-0860a0412dac tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdec46bb-2f4c-472d-8f41-6fd112dbe443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eed314c3-f4d9-437f-af53-aba85e12618f', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-38107c25-66cf-4bd4-8ea2-0860a0412dac tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc09337-830e-47da-bc57-451335819197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:01 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-06df51c8-9bbc-4a08-9820-5cfd3758c93d tempest-CreateVolumesFromSnapshotTest-1626199979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:47:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-06df51c8-9bbc-4a08-9820-5cfd3758c93d tempest-CreateVolumesFromSnapshotTest-1626199979 None] Flow 'volume_create_manager' (9daf8796-9463-4268-9da4-69a64f5e8d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-06df51c8-9bbc-4a08-9820-5cfd3758c93d tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf0634f-04d3-4c16-9054-067869e22a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-06df51c8-9bbc-4a08-9820-5cfd3758c93d tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf0634f-04d3-4c16-9054-067869e22a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1363921416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c86350a-f9df-45a5-92f5-0b8ed1c120f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c77f57973f68414e9b5d00a77b2bdcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:02Z,use_quota=True,user_id='672ae680094b4dcf8f4f13359086ab72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-06df51c8-9bbc-4a08-9820-5cfd3758c93d tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85a1e26b-8a40-4a42-945f-f18a339d31b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-06df51c8-9bbc-4a08-9820-5cfd3758c93d tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85a1e26b-8a40-4a42-945f-f18a339d31b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-06df51c8-9bbc-4a08-9820-5cfd3758c93d tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fd6148a-53e9-4152-a2c0-b0d47924b1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-06df51c8-9bbc-4a08-9820-5cfd3758c93d tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fd6148a-53e9-4152-a2c0-b0d47924b1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c86350a-f9df-45a5-92f5-0b8ed1c120f4', 'volume_name': 'volume-1c86350a-f9df-45a5-92f5-0b8ed1c120f4', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-06df51c8-9bbc-4a08-9820-5cfd3758c93d tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (596164c9-f5ff-4aea-a77f-ba9f010a7700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-06df51c8-9bbc-4a08-9820-5cfd3758c93d tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (596164c9-f5ff-4aea-a77f-ba9f010a7700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-06df51c8-9bbc-4a08-9820-5cfd3758c93d tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11776b4d-d4e8-4e69-af66-88220ee2fa86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:01 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-06df51c8-9bbc-4a08-9820-5cfd3758c93d tempest-CreateVolumesFromSnapshotTest-1626199979 None] Volume 1c86350a-f9df-45a5-92f5-0b8ed1c120f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c86350a-f9df-45a5-92f5-0b8ed1c120f4', 'volume_size': 1} Jul 08 01:47:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-06df51c8-9bbc-4a08-9820-5cfd3758c93d tempest-CreateVolumesFromSnapshotTest-1626199979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:01 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-38107c25-66cf-4bd4-8ea2-0860a0412dac tempest-CreateVolumesFromSnapshotTest-1626199979 None] Volume volume-eed314c3-f4d9-437f-af53-aba85e12618f (eed314c3-f4d9-437f-af53-aba85e12618f): created successfully Jul 08 01:47:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-38107c25-66cf-4bd4-8ea2-0860a0412dac tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc09337-830e-47da-bc57-451335819197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-38107c25-66cf-4bd4-8ea2-0860a0412dac tempest-CreateVolumesFromSnapshotTest-1626199979 None] Flow 'volume_create_manager' (aca61305-701a-443e-9e46-72c0d76cd768) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:01 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-38107c25-66cf-4bd4-8ea2-0860a0412dac tempest-CreateVolumesFromSnapshotTest-1626199979 None] Created volume successfully. Jul 08 01:47:02 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5604e34c-fcb0-40a4-9678-4e60c5f9a110 tempest-VolumesImageMetadata-98566585 None] Acquiring lock "cinder-fdbf65c1-7214-4ef7-bc3e-1404d9cf6054-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:02 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5604e34c-fcb0-40a4-9678-4e60c5f9a110 tempest-VolumesImageMetadata-98566585 None] Lock "cinder-fdbf65c1-7214-4ef7-bc3e-1404d9cf6054-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:02 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5604e34c-fcb0-40a4-9678-4e60c5f9a110 tempest-VolumesImageMetadata-98566585 None] Acquiring lock "cinder-quobyte-fdbf65c1-7214-4ef7-bc3e-1404d9cf6054" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:02 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5604e34c-fcb0-40a4-9678-4e60c5f9a110 tempest-VolumesImageMetadata-98566585 None] Lock "cinder-quobyte-fdbf65c1-7214-4ef7-bc3e-1404d9cf6054" acquired by "delete_volume" :: waited 0.017s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:02 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a977f6-ea9b-43be-a506-25c0b0efc1a1]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5604e34c-fcb0-40a4-9678-4e60c5f9a110 tempest-VolumesImageMetadata-98566585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fdbf65c1-7214-4ef7-bc3e-1404d9cf6054 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:02 devstack sudo[101053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fdbf65c1-7214-4ef7-bc3e-1404d9cf6054 Jul 08 01:47:02 devstack sudo[101053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:02 devstack sudo[101048]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8f239100-90d1-4053-8854-106112aa8f1f tempest-CreateVolumesFromSnapshotTest-1626199979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-62b9e3a1-237a-4d98-a842-c11abff1df61 1073741824" returned: 0 in 0.970s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8f239100-90d1-4053-8854-106112aa8f1f tempest-CreateVolumesFromSnapshotTest-1626199979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-62b9e3a1-237a-4d98-a842-c11abff1df61 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:02 devstack sudo[101056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-62b9e3a1-237a-4d98-a842-c11abff1df61 Jul 08 01:47:02 devstack sudo[101056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:03 devstack sudo[101053]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5604e34c-fcb0-40a4-9678-4e60c5f9a110 tempest-VolumesImageMetadata-98566585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fdbf65c1-7214-4ef7-bc3e-1404d9cf6054" returned: 0 in 0.875s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5604e34c-fcb0-40a4-9678-4e60c5f9a110 tempest-VolumesImageMetadata-98566585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fdbf65c1-7214-4ef7-bc3e-1404d9cf6054 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:03 devstack sudo[101056]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8f239100-90d1-4053-8854-106112aa8f1f tempest-CreateVolumesFromSnapshotTest-1626199979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-62b9e3a1-237a-4d98-a842-c11abff1df61" returned: 0 in 0.699s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:03 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-8f239100-90d1-4053-8854-106112aa8f1f tempest-CreateVolumesFromSnapshotTest-1626199979 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:47:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8f239100-90d1-4053-8854-106112aa8f1f tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-992bfe9e-5a21-4b0a-9cd2-7124b7338032 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.620s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:03 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-992bfe9e-5a21-4b0a-9cd2-7124b7338032 tempest-CreateVolumesFromSnapshotTest-1626199979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-95025614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce08e368-1e27-453f-8140-f5c963448ee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c77f57973f68414e9b5d00a77b2bdcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:01Z,use_quota=True,user_id='672ae680094b4dcf8f4f13359086ab72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:47:03 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-992bfe9e-5a21-4b0a-9cd2-7124b7338032 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Creating volume ce08e368-1e27-453f-8140-f5c963448ee1 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:47:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-992bfe9e-5a21-4b0a-9cd2-7124b7338032 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-992bfe9e-5a21-4b0a-9cd2-7124b7338032 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:03 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-992bfe9e-5a21-4b0a-9cd2-7124b7338032 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:03 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-992bfe9e-5a21-4b0a-9cd2-7124b7338032 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-992bfe9e-5a21-4b0a-9cd2-7124b7338032 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:03 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-992bfe9e-5a21-4b0a-9cd2-7124b7338032 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:47:03 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-992bfe9e-5a21-4b0a-9cd2-7124b7338032 tempest-CreateVolumesFromSnapshotTest-1626199979 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:47:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-992bfe9e-5a21-4b0a-9cd2-7124b7338032 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ce08e368-1e27-453f-8140-f5c963448ee1 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8f239100-90d1-4053-8854-106112aa8f1f tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (659e0ff2-7d58-47df-986c-b239a25417f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62b9e3a1-237a-4d98-a842-c11abff1df61', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:03 devstack sudo[101061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fdbf65c1-7214-4ef7-bc3e-1404d9cf6054 Jul 08 01:47:03 devstack sudo[101061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:03 devstack sudo[101062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ce08e368-1e27-453f-8140-f5c963448ee1 1073741824 Jul 08 01:47:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8f239100-90d1-4053-8854-106112aa8f1f tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8364f0d9-ac04-48a7-9243-04d2f4cb77a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:03 devstack sudo[101062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:03 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-8f239100-90d1-4053-8854-106112aa8f1f tempest-CreateVolumesFromSnapshotTest-1626199979 None] Volume volume-62b9e3a1-237a-4d98-a842-c11abff1df61 (62b9e3a1-237a-4d98-a842-c11abff1df61): created successfully Jul 08 01:47:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8f239100-90d1-4053-8854-106112aa8f1f tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8364f0d9-ac04-48a7-9243-04d2f4cb77a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8f239100-90d1-4053-8854-106112aa8f1f tempest-CreateVolumesFromSnapshotTest-1626199979 None] Flow 'volume_create_manager' (69db120f-21ce-4d6d-91f2-7d094adca4e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:03 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-8f239100-90d1-4053-8854-106112aa8f1f tempest-CreateVolumesFromSnapshotTest-1626199979 None] Created volume successfully. Jul 08 01:47:04 devstack sudo[101061]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5604e34c-fcb0-40a4-9678-4e60c5f9a110 tempest-VolumesImageMetadata-98566585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fdbf65c1-7214-4ef7-bc3e-1404d9cf6054" returned: 1 in 0.857s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5604e34c-fcb0-40a4-9678-4e60c5f9a110 tempest-VolumesImageMetadata-98566585 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fdbf65c1-7214-4ef7-bc3e-1404d9cf6054' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:47:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5604e34c-fcb0-40a4-9678-4e60c5f9a110 tempest-VolumesImageMetadata-98566585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fdbf65c1-7214-4ef7-bc3e-1404d9cf6054 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:04 devstack sudo[101071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fdbf65c1-7214-4ef7-bc3e-1404d9cf6054 Jul 08 01:47:04 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:04 devstack sudo[101062]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-992bfe9e-5a21-4b0a-9cd2-7124b7338032 tempest-CreateVolumesFromSnapshotTest-1626199979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ce08e368-1e27-453f-8140-f5c963448ee1 1073741824" returned: 0 in 0.926s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-992bfe9e-5a21-4b0a-9cd2-7124b7338032 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ce08e368-1e27-453f-8140-f5c963448ee1 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:04 devstack sudo[101074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ce08e368-1e27-453f-8140-f5c963448ee1 Jul 08 01:47:04 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:04 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5604e34c-fcb0-40a4-9678-4e60c5f9a110 tempest-VolumesImageMetadata-98566585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-fdbf65c1-7214-4ef7-bc3e-1404d9cf6054" returned: 0 in 0.682s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:04 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5604e34c-fcb0-40a4-9678-4e60c5f9a110 tempest-VolumesImageMetadata-98566585 None] Lock "cinder-quobyte-fdbf65c1-7214-4ef7-bc3e-1404d9cf6054" released by "delete_volume" :: held 2.481s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:04 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-5604e34c-fcb0-40a4-9678-4e60c5f9a110 tempest-VolumesImageMetadata-98566585 None] Created reservations ['b2d755e8-3d9b-4a4a-94ce-ae132e32e14d', '823c145c-c3c1-4361-853f-2a0859cae3ee', 'f9a2a22a-79a5-42bb-a358-15da86f7994e', '8f879a70-eb1f-46e4-8d9d-171146eac9ce'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5604e34c-fcb0-40a4-9678-4e60c5f9a110 tempest-VolumesImageMetadata-98566585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5604e34c-fcb0-40a4-9678-4e60c5f9a110 tempest-VolumesImageMetadata-98566585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:04 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5604e34c-fcb0-40a4-9678-4e60c5f9a110 tempest-VolumesImageMetadata-98566585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:04 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5604e34c-fcb0-40a4-9678-4e60c5f9a110 tempest-VolumesImageMetadata-98566585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5604e34c-fcb0-40a4-9678-4e60c5f9a110 tempest-VolumesImageMetadata-98566585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5604e34c-fcb0-40a4-9678-4e60c5f9a110 tempest-VolumesImageMetadata-98566585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:04 devstack sudo[101078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:47:04 devstack sudo[101078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:04 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-992bfe9e-5a21-4b0a-9cd2-7124b7338032 tempest-CreateVolumesFromSnapshotTest-1626199979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ce08e368-1e27-453f-8140-f5c963448ee1" returned: 0 in 0.696s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:04 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-992bfe9e-5a21-4b0a-9cd2-7124b7338032 tempest-CreateVolumesFromSnapshotTest-1626199979 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:47:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-992bfe9e-5a21-4b0a-9cd2-7124b7338032 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-fb874cfe-d44c-48bb-b0ae-08c75a39132e tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.767s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:05 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-fb874cfe-d44c-48bb-b0ae-08c75a39132e tempest-CreateVolumesFromSnapshotTest-1626199979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-240195216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ade0ccb-ac1d-4ccf-bacb-c76635c18814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c77f57973f68414e9b5d00a77b2bdcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:01Z,use_quota=True,user_id='672ae680094b4dcf8f4f13359086ab72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:47:05 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-fb874cfe-d44c-48bb-b0ae-08c75a39132e tempest-CreateVolumesFromSnapshotTest-1626199979 None] Creating volume 1ade0ccb-ac1d-4ccf-bacb-c76635c18814 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:47:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-fb874cfe-d44c-48bb-b0ae-08c75a39132e tempest-CreateVolumesFromSnapshotTest-1626199979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-fb874cfe-d44c-48bb-b0ae-08c75a39132e tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:05 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-fb874cfe-d44c-48bb-b0ae-08c75a39132e tempest-CreateVolumesFromSnapshotTest-1626199979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:05 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-fb874cfe-d44c-48bb-b0ae-08c75a39132e tempest-CreateVolumesFromSnapshotTest-1626199979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-fb874cfe-d44c-48bb-b0ae-08c75a39132e tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:05 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-fb874cfe-d44c-48bb-b0ae-08c75a39132e tempest-CreateVolumesFromSnapshotTest-1626199979 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:47:05 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-fb874cfe-d44c-48bb-b0ae-08c75a39132e tempest-CreateVolumesFromSnapshotTest-1626199979 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:47:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-fb874cfe-d44c-48bb-b0ae-08c75a39132e tempest-CreateVolumesFromSnapshotTest-1626199979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1ade0ccb-ac1d-4ccf-bacb-c76635c18814 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:05 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-992bfe9e-5a21-4b0a-9cd2-7124b7338032 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (900c5851-810a-4e90-8c31-b412764d7f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce08e368-1e27-453f-8140-f5c963448ee1', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:05 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-992bfe9e-5a21-4b0a-9cd2-7124b7338032 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3fd6df5-e4dc-4559-a70d-7b7079384cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:05 devstack sudo[101080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1ade0ccb-ac1d-4ccf-bacb-c76635c18814 1073741824 Jul 08 01:47:05 devstack sudo[101080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:05 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-53d462b0-fbe9-4f47-a052-31a0087f2eff tempest-TestStampPattern-1873432706 None] Acquiring lock "cinder-d254098a-3644-4edf-a91a-f89e94d9c147-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:05 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-992bfe9e-5a21-4b0a-9cd2-7124b7338032 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Volume volume-ce08e368-1e27-453f-8140-f5c963448ee1 (ce08e368-1e27-453f-8140-f5c963448ee1): created successfully Jul 08 01:47:05 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-992bfe9e-5a21-4b0a-9cd2-7124b7338032 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3fd6df5-e4dc-4559-a70d-7b7079384cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:05 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-992bfe9e-5a21-4b0a-9cd2-7124b7338032 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Flow 'volume_create_manager' (cc02632f-b8a6-4bbd-a72b-040b7c903234) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:05 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-53d462b0-fbe9-4f47-a052-31a0087f2eff tempest-TestStampPattern-1873432706 None] Lock "cinder-d254098a-3644-4edf-a91a-f89e94d9c147-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:05 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-992bfe9e-5a21-4b0a-9cd2-7124b7338032 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Created volume successfully. Jul 08 01:47:05 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-53d462b0-fbe9-4f47-a052-31a0087f2eff tempest-TestStampPattern-1873432706 None] Acquiring lock "cinder-quobyte-d254098a-3644-4edf-a91a-f89e94d9c147" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:05 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-53d462b0-fbe9-4f47-a052-31a0087f2eff tempest-TestStampPattern-1873432706 None] Lock "cinder-quobyte-d254098a-3644-4edf-a91a-f89e94d9c147" acquired by "delete_volume" :: waited 0.017s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:05 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fff033-5bc5-44ef-9bf9-b9b3bddaaaa4]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-53d462b0-fbe9-4f47-a052-31a0087f2eff tempest-TestStampPattern-1873432706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:05 devstack sudo[101083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147 Jul 08 01:47:05 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:05 devstack sudo[101078]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5604e34c-fcb0-40a4-9678-4e60c5f9a110 tempest-VolumesImageMetadata-98566585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.828s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:05 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-5604e34c-fcb0-40a4-9678-4e60c5f9a110 tempest-VolumesImageMetadata-98566585 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:47:05 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-5604e34c-fcb0-40a4-9678-4e60c5f9a110 tempest-VolumesImageMetadata-98566585 None] Deleted volume successfully. Jul 08 01:47:05 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5604e34c-fcb0-40a4-9678-4e60c5f9a110 tempest-VolumesImageMetadata-98566585 None] Lock "cinder-fdbf65c1-7214-4ef7-bc3e-1404d9cf6054-delete_volume" released by "delete_volume" :: held 3.573s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:06 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-53d462b0-fbe9-4f47-a052-31a0087f2eff tempest-TestStampPattern-1873432706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147" returned: 0 in 0.940s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-53d462b0-fbe9-4f47-a052-31a0087f2eff tempest-TestStampPattern-1873432706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:06 devstack sudo[101080]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-fb874cfe-d44c-48bb-b0ae-08c75a39132e tempest-CreateVolumesFromSnapshotTest-1626199979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1ade0ccb-ac1d-4ccf-bacb-c76635c18814 1073741824" returned: 0 in 1.185s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:06 devstack sudo[101094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147 Jul 08 01:47:06 devstack sudo[101094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-fb874cfe-d44c-48bb-b0ae-08c75a39132e tempest-CreateVolumesFromSnapshotTest-1626199979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1ade0ccb-ac1d-4ccf-bacb-c76635c18814 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:06 devstack sudo[101096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1ade0ccb-ac1d-4ccf-bacb-c76635c18814 Jul 08 01:47:06 devstack sudo[101096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:06 devstack sudo[101094]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-53d462b0-fbe9-4f47-a052-31a0087f2eff tempest-TestStampPattern-1873432706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d254098a-3644-4edf-a91a-f89e94d9c147" returned: 0 in 0.784s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:06 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-53d462b0-fbe9-4f47-a052-31a0087f2eff tempest-TestStampPattern-1873432706 None] Lock "cinder-quobyte-d254098a-3644-4edf-a91a-f89e94d9c147" released by "delete_volume" :: held 1.797s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:07 devstack sudo[101096]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-fb874cfe-d44c-48bb-b0ae-08c75a39132e tempest-CreateVolumesFromSnapshotTest-1626199979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1ade0ccb-ac1d-4ccf-bacb-c76635c18814" returned: 0 in 0.759s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:07 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-fb874cfe-d44c-48bb-b0ae-08c75a39132e tempest-CreateVolumesFromSnapshotTest-1626199979 None] <== create_volume: return (2009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:47:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-fb874cfe-d44c-48bb-b0ae-08c75a39132e tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.013s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-06df51c8-9bbc-4a08-9820-5cfd3758c93d tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.259s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:07 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-06df51c8-9bbc-4a08-9820-5cfd3758c93d tempest-CreateVolumesFromSnapshotTest-1626199979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1363921416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c86350a-f9df-45a5-92f5-0b8ed1c120f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c77f57973f68414e9b5d00a77b2bdcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:02Z,use_quota=True,user_id='672ae680094b4dcf8f4f13359086ab72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:47:07 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-06df51c8-9bbc-4a08-9820-5cfd3758c93d tempest-CreateVolumesFromSnapshotTest-1626199979 None] Creating volume 1c86350a-f9df-45a5-92f5-0b8ed1c120f4 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:47:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-06df51c8-9bbc-4a08-9820-5cfd3758c93d tempest-CreateVolumesFromSnapshotTest-1626199979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-06df51c8-9bbc-4a08-9820-5cfd3758c93d tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:07 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-06df51c8-9bbc-4a08-9820-5cfd3758c93d tempest-CreateVolumesFromSnapshotTest-1626199979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:07 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-06df51c8-9bbc-4a08-9820-5cfd3758c93d tempest-CreateVolumesFromSnapshotTest-1626199979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-06df51c8-9bbc-4a08-9820-5cfd3758c93d tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:07 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-06df51c8-9bbc-4a08-9820-5cfd3758c93d tempest-CreateVolumesFromSnapshotTest-1626199979 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:47:07 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-06df51c8-9bbc-4a08-9820-5cfd3758c93d tempest-CreateVolumesFromSnapshotTest-1626199979 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:47:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-06df51c8-9bbc-4a08-9820-5cfd3758c93d tempest-CreateVolumesFromSnapshotTest-1626199979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1c86350a-f9df-45a5-92f5-0b8ed1c120f4 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:07 devstack sudo[101100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1c86350a-f9df-45a5-92f5-0b8ed1c120f4 1073741824 Jul 08 01:47:07 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:07 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fb874cfe-d44c-48bb-b0ae-08c75a39132e tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0480bfe-6e61-4bdf-b954-e8963d651b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ade0ccb-ac1d-4ccf-bacb-c76635c18814', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:07 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fb874cfe-d44c-48bb-b0ae-08c75a39132e tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d854c394-ac27-422f-8806-29d85ea499ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:07 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-fb874cfe-d44c-48bb-b0ae-08c75a39132e tempest-CreateVolumesFromSnapshotTest-1626199979 None] Volume volume-1ade0ccb-ac1d-4ccf-bacb-c76635c18814 (1ade0ccb-ac1d-4ccf-bacb-c76635c18814): created successfully Jul 08 01:47:07 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fb874cfe-d44c-48bb-b0ae-08c75a39132e tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d854c394-ac27-422f-8806-29d85ea499ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:07 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fb874cfe-d44c-48bb-b0ae-08c75a39132e tempest-CreateVolumesFromSnapshotTest-1626199979 None] Flow 'volume_create_manager' (9c482def-cf67-4f3c-919b-7c91ef8aca2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:07 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-53d462b0-fbe9-4f47-a052-31a0087f2eff tempest-TestStampPattern-1873432706 None] Created reservations ['7486714a-5d88-4d93-95a8-b460882628e8', 'f54c4645-0308-461e-a36e-19b3f611663f', 'da82be37-1928-4c8b-992d-dd31815436b3', '81996764-ec06-433e-bbfa-76eadf6c7c74'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:07 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-fb874cfe-d44c-48bb-b0ae-08c75a39132e tempest-CreateVolumesFromSnapshotTest-1626199979 None] Created volume successfully. Jul 08 01:47:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-53d462b0-fbe9-4f47-a052-31a0087f2eff tempest-TestStampPattern-1873432706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-53d462b0-fbe9-4f47-a052-31a0087f2eff tempest-TestStampPattern-1873432706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:07 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-53d462b0-fbe9-4f47-a052-31a0087f2eff tempest-TestStampPattern-1873432706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:07 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-53d462b0-fbe9-4f47-a052-31a0087f2eff tempest-TestStampPattern-1873432706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-53d462b0-fbe9-4f47-a052-31a0087f2eff tempest-TestStampPattern-1873432706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-53d462b0-fbe9-4f47-a052-31a0087f2eff tempest-TestStampPattern-1873432706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:07 devstack sudo[101102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:47:07 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:08 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-53d462b0-fbe9-4f47-a052-31a0087f2eff tempest-TestStampPattern-1873432706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.892s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:08 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-53d462b0-fbe9-4f47-a052-31a0087f2eff tempest-TestStampPattern-1873432706 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:47:08 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-53d462b0-fbe9-4f47-a052-31a0087f2eff tempest-TestStampPattern-1873432706 None] Deleted volume successfully. Jul 08 01:47:08 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-53d462b0-fbe9-4f47-a052-31a0087f2eff tempest-TestStampPattern-1873432706 None] Lock "cinder-d254098a-3644-4edf-a91a-f89e94d9c147-delete_volume" released by "delete_volume" :: held 3.081s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:08 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-06df51c8-9bbc-4a08-9820-5cfd3758c93d tempest-CreateVolumesFromSnapshotTest-1626199979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1c86350a-f9df-45a5-92f5-0b8ed1c120f4 1073741824" returned: 0 in 1.258s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-06df51c8-9bbc-4a08-9820-5cfd3758c93d tempest-CreateVolumesFromSnapshotTest-1626199979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1c86350a-f9df-45a5-92f5-0b8ed1c120f4 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:08 devstack sudo[101108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1c86350a-f9df-45a5-92f5-0b8ed1c120f4 Jul 08 01:47:08 devstack sudo[101108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:09 devstack sudo[101108]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-06df51c8-9bbc-4a08-9820-5cfd3758c93d tempest-CreateVolumesFromSnapshotTest-1626199979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1c86350a-f9df-45a5-92f5-0b8ed1c120f4" returned: 0 in 0.825s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:09 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-06df51c8-9bbc-4a08-9820-5cfd3758c93d tempest-CreateVolumesFromSnapshotTest-1626199979 None] <== create_volume: return (2131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:47:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-06df51c8-9bbc-4a08-9820-5cfd3758c93d tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.133s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:09 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-06df51c8-9bbc-4a08-9820-5cfd3758c93d tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11776b4d-d4e8-4e69-af66-88220ee2fa86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c86350a-f9df-45a5-92f5-0b8ed1c120f4', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:09 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-06df51c8-9bbc-4a08-9820-5cfd3758c93d tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3390019-6311-4e3b-bdbb-31234c2d7283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:09 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-06df51c8-9bbc-4a08-9820-5cfd3758c93d tempest-CreateVolumesFromSnapshotTest-1626199979 None] Volume volume-1c86350a-f9df-45a5-92f5-0b8ed1c120f4 (1c86350a-f9df-45a5-92f5-0b8ed1c120f4): created successfully Jul 08 01:47:09 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-06df51c8-9bbc-4a08-9820-5cfd3758c93d tempest-CreateVolumesFromSnapshotTest-1626199979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3390019-6311-4e3b-bdbb-31234c2d7283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:09 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-06df51c8-9bbc-4a08-9820-5cfd3758c93d tempest-CreateVolumesFromSnapshotTest-1626199979 None] Flow 'volume_create_manager' (9daf8796-9463-4268-9da4-69a64f5e8d9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:09 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-06df51c8-9bbc-4a08-9820-5cfd3758c93d tempest-CreateVolumesFromSnapshotTest-1626199979 None] Created volume successfully. Jul 08 01:47:09 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3227a4a-a624-45b3-a0d7-e6f6b9580048 tempest-VolumesDeleteCascade-526616262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:47:09 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b3227a4a-a624-45b3-a0d7-e6f6b9580048 tempest-VolumesDeleteCascade-526616262 None] Flow 'volume_create_manager' (1f997909-ed5d-479c-9216-d78097239883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:09 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b3227a4a-a624-45b3-a0d7-e6f6b9580048 tempest-VolumesDeleteCascade-526616262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00fcf1e4-6456-47ae-9baf-f2d9c241cbfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:09 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b3227a4a-a624-45b3-a0d7-e6f6b9580048 tempest-VolumesDeleteCascade-526616262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00fcf1e4-6456-47ae-9baf-f2d9c241cbfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-643187549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a458e374-53eb-4f25-b055-5d671dd5d9c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6995ed3e2f04dd68148c0f75f811baa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:09Z,use_quota=True,user_id='dfcbc3f82d6d4b47b3131da8027188be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:09 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b3227a4a-a624-45b3-a0d7-e6f6b9580048 tempest-VolumesDeleteCascade-526616262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (935a6b0c-080d-4643-9cb2-29f69af21a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:09 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b3227a4a-a624-45b3-a0d7-e6f6b9580048 tempest-VolumesDeleteCascade-526616262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (935a6b0c-080d-4643-9cb2-29f69af21a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:09 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b3227a4a-a624-45b3-a0d7-e6f6b9580048 tempest-VolumesDeleteCascade-526616262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a91486d-3c20-4ce8-8748-5681494869d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:09 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b3227a4a-a624-45b3-a0d7-e6f6b9580048 tempest-VolumesDeleteCascade-526616262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a91486d-3c20-4ce8-8748-5681494869d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a458e374-53eb-4f25-b055-5d671dd5d9c0', 'volume_name': 'volume-a458e374-53eb-4f25-b055-5d671dd5d9c0', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:09 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b3227a4a-a624-45b3-a0d7-e6f6b9580048 tempest-VolumesDeleteCascade-526616262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c0e833d-e76f-4e20-8c96-43439a46315d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:09 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b3227a4a-a624-45b3-a0d7-e6f6b9580048 tempest-VolumesDeleteCascade-526616262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c0e833d-e76f-4e20-8c96-43439a46315d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:09 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b3227a4a-a624-45b3-a0d7-e6f6b9580048 tempest-VolumesDeleteCascade-526616262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac588137-85b6-4931-ae74-232c848efc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:09 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-b3227a4a-a624-45b3-a0d7-e6f6b9580048 tempest-VolumesDeleteCascade-526616262 None] Volume a458e374-53eb-4f25-b055-5d671dd5d9c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a458e374-53eb-4f25-b055-5d671dd5d9c0', 'volume_size': 1} Jul 08 01:47:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b3227a4a-a624-45b3-a0d7-e6f6b9580048 tempest-VolumesDeleteCascade-526616262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b3227a4a-a624-45b3-a0d7-e6f6b9580048 tempest-VolumesDeleteCascade-526616262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:09 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b3227a4a-a624-45b3-a0d7-e6f6b9580048 tempest-VolumesDeleteCascade-526616262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-643187549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a458e374-53eb-4f25-b055-5d671dd5d9c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6995ed3e2f04dd68148c0f75f811baa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:09Z,use_quota=True,user_id='dfcbc3f82d6d4b47b3131da8027188be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:47:09 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-b3227a4a-a624-45b3-a0d7-e6f6b9580048 tempest-VolumesDeleteCascade-526616262 None] Creating volume a458e374-53eb-4f25-b055-5d671dd5d9c0 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:47:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b3227a4a-a624-45b3-a0d7-e6f6b9580048 tempest-VolumesDeleteCascade-526616262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b3227a4a-a624-45b3-a0d7-e6f6b9580048 tempest-VolumesDeleteCascade-526616262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:09 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b3227a4a-a624-45b3-a0d7-e6f6b9580048 tempest-VolumesDeleteCascade-526616262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:09 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b3227a4a-a624-45b3-a0d7-e6f6b9580048 tempest-VolumesDeleteCascade-526616262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b3227a4a-a624-45b3-a0d7-e6f6b9580048 tempest-VolumesDeleteCascade-526616262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:09 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b3227a4a-a624-45b3-a0d7-e6f6b9580048 tempest-VolumesDeleteCascade-526616262 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:47:09 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-b3227a4a-a624-45b3-a0d7-e6f6b9580048 tempest-VolumesDeleteCascade-526616262 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:47:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b3227a4a-a624-45b3-a0d7-e6f6b9580048 tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:09 devstack sudo[101112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0 1073741824 Jul 08 01:47:09 devstack sudo[101112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:09 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-cc3a6047-5fc8-4e47-a80d-8b1f3a833531 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Acquiring lock "cinder-1c86350a-f9df-45a5-92f5-0b8ed1c120f4-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:09 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-cc3a6047-5fc8-4e47-a80d-8b1f3a833531 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "cinder-1c86350a-f9df-45a5-92f5-0b8ed1c120f4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:09 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-cc3a6047-5fc8-4e47-a80d-8b1f3a833531 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Acquiring lock "cinder-quobyte-1c86350a-f9df-45a5-92f5-0b8ed1c120f4" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:09 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-cc3a6047-5fc8-4e47-a80d-8b1f3a833531 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "cinder-quobyte-1c86350a-f9df-45a5-92f5-0b8ed1c120f4" acquired by "delete_volume" :: waited 0.025s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:09 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fa8bdd-be0d-4b8f-b994-04e405d71c56]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc3a6047-5fc8-4e47-a80d-8b1f3a833531 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1c86350a-f9df-45a5-92f5-0b8ed1c120f4 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:09 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1c86350a-f9df-45a5-92f5-0b8ed1c120f4 Jul 08 01:47:09 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:10 devstack sudo[101112]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b3227a4a-a624-45b3-a0d7-e6f6b9580048 tempest-VolumesDeleteCascade-526616262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0 1073741824" returned: 0 in 1.051s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:10 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc3a6047-5fc8-4e47-a80d-8b1f3a833531 tempest-CreateVolumesFromSnapshotTest-1626199979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1c86350a-f9df-45a5-92f5-0b8ed1c120f4" returned: 0 in 0.917s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc3a6047-5fc8-4e47-a80d-8b1f3a833531 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1c86350a-f9df-45a5-92f5-0b8ed1c120f4 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b3227a4a-a624-45b3-a0d7-e6f6b9580048 tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:10 devstack sudo[101124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1c86350a-f9df-45a5-92f5-0b8ed1c120f4 Jul 08 01:47:10 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:10 devstack sudo[101125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0 Jul 08 01:47:10 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:11 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc3a6047-5fc8-4e47-a80d-8b1f3a833531 tempest-CreateVolumesFromSnapshotTest-1626199979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1c86350a-f9df-45a5-92f5-0b8ed1c120f4" returned: 0 in 0.790s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:11 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-cc3a6047-5fc8-4e47-a80d-8b1f3a833531 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "cinder-quobyte-1c86350a-f9df-45a5-92f5-0b8ed1c120f4" released by "delete_volume" :: held 1.760s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:11 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b3227a4a-a624-45b3-a0d7-e6f6b9580048 tempest-VolumesDeleteCascade-526616262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0" returned: 0 in 0.802s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:11 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b3227a4a-a624-45b3-a0d7-e6f6b9580048 tempest-VolumesDeleteCascade-526616262 None] <== create_volume: return (1927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:47:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b3227a4a-a624-45b3-a0d7-e6f6b9580048 tempest-VolumesDeleteCascade-526616262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.930s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:11 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b3227a4a-a624-45b3-a0d7-e6f6b9580048 tempest-VolumesDeleteCascade-526616262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac588137-85b6-4931-ae74-232c848efc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a458e374-53eb-4f25-b055-5d671dd5d9c0', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:11 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b3227a4a-a624-45b3-a0d7-e6f6b9580048 tempest-VolumesDeleteCascade-526616262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e877edee-7e55-49ae-b3d3-57a407e5f96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:11 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-b3227a4a-a624-45b3-a0d7-e6f6b9580048 tempest-VolumesDeleteCascade-526616262 None] Volume volume-a458e374-53eb-4f25-b055-5d671dd5d9c0 (a458e374-53eb-4f25-b055-5d671dd5d9c0): created successfully Jul 08 01:47:11 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b3227a4a-a624-45b3-a0d7-e6f6b9580048 tempest-VolumesDeleteCascade-526616262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e877edee-7e55-49ae-b3d3-57a407e5f96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:11 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b3227a4a-a624-45b3-a0d7-e6f6b9580048 tempest-VolumesDeleteCascade-526616262 None] Flow 'volume_create_manager' (1f997909-ed5d-479c-9216-d78097239883) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:11 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-b3227a4a-a624-45b3-a0d7-e6f6b9580048 tempest-VolumesDeleteCascade-526616262 None] Created volume successfully. Jul 08 01:47:11 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-cc3a6047-5fc8-4e47-a80d-8b1f3a833531 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Created reservations ['81f8fe1a-d6df-4af3-926e-18d3e5ba8db8', '285370f3-dca9-4466-977c-585d412a9b3c', 'b07e67dd-5fa9-4237-9000-7f428a7e83a2', '26569434-e997-4ff1-a3c3-290960bdcb83'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-cc3a6047-5fc8-4e47-a80d-8b1f3a833531 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-cc3a6047-5fc8-4e47-a80d-8b1f3a833531 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:11 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-cc3a6047-5fc8-4e47-a80d-8b1f3a833531 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:11 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-cc3a6047-5fc8-4e47-a80d-8b1f3a833531 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-cc3a6047-5fc8-4e47-a80d-8b1f3a833531 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc3a6047-5fc8-4e47-a80d-8b1f3a833531 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:11 devstack sudo[101130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:47:11 devstack sudo[101130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:11 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-977584e3-872a-45e4-8834-1bd823dde037 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Acquiring lock "cinder-1ade0ccb-ac1d-4ccf-bacb-c76635c18814-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:11 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-977584e3-872a-45e4-8834-1bd823dde037 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "cinder-1ade0ccb-ac1d-4ccf-bacb-c76635c18814-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:11 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-977584e3-872a-45e4-8834-1bd823dde037 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Acquiring lock "cinder-quobyte-1ade0ccb-ac1d-4ccf-bacb-c76635c18814" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:11 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-977584e3-872a-45e4-8834-1bd823dde037 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "cinder-quobyte-1ade0ccb-ac1d-4ccf-bacb-c76635c18814" acquired by "delete_volume" :: waited 0.022s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:11 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[981d3379-7361-4216-9b5c-44657647616e]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-977584e3-872a-45e4-8834-1bd823dde037 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1ade0ccb-ac1d-4ccf-bacb-c76635c18814 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:11 devstack sudo[101132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1ade0ccb-ac1d-4ccf-bacb-c76635c18814 Jul 08 01:47:11 devstack sudo[101132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:12 devstack sudo[101130]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc3a6047-5fc8-4e47-a80d-8b1f3a833531 tempest-CreateVolumesFromSnapshotTest-1626199979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.828s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:12 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-cc3a6047-5fc8-4e47-a80d-8b1f3a833531 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:47:12 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-cc3a6047-5fc8-4e47-a80d-8b1f3a833531 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Deleted volume successfully. Jul 08 01:47:12 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-cc3a6047-5fc8-4e47-a80d-8b1f3a833531 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "cinder-1c86350a-f9df-45a5-92f5-0b8ed1c120f4-delete_volume" released by "delete_volume" :: held 2.910s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5b6e3f82-0ab1-482f-b2bf-2c0de3cb6c09 tempest-VolumesDeleteCascade-526616262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5b6e3f82-0ab1-482f-b2bf-2c0de3cb6c09 tempest-VolumesDeleteCascade-526616262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:12 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-5b6e3f82-0ab1-482f-b2bf-2c0de3cb6c09 tempest-VolumesDeleteCascade-526616262 None] Creating offline snapshot 0cc12b99-ffd1-4abc-915b-3c14d18e55d9 of volume a458e374-53eb-4f25-b055-5d671dd5d9c0 {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:47:12 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[a349b632-2def-4bfe-84ae-0511bcd00507]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5b6e3f82-0ab1-482f-b2bf-2c0de3cb6c09 tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:12 devstack sudo[101132]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-977584e3-872a-45e4-8834-1bd823dde037 tempest-CreateVolumesFromSnapshotTest-1626199979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1ade0ccb-ac1d-4ccf-bacb-c76635c18814" returned: 0 in 0.996s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-977584e3-872a-45e4-8834-1bd823dde037 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1ade0ccb-ac1d-4ccf-bacb-c76635c18814 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:12 devstack sudo[101140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1ade0ccb-ac1d-4ccf-bacb-c76635c18814 Jul 08 01:47:12 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:12 devstack sudo[101139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0 Jul 08 01:47:12 devstack sudo[101139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:13 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-977584e3-872a-45e4-8834-1bd823dde037 tempest-CreateVolumesFromSnapshotTest-1626199979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1ade0ccb-ac1d-4ccf-bacb-c76635c18814" returned: 0 in 0.739s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:13 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-977584e3-872a-45e4-8834-1bd823dde037 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "cinder-quobyte-1ade0ccb-ac1d-4ccf-bacb-c76635c18814" released by "delete_volume" :: held 1.829s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:13 devstack sudo[101139]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5b6e3f82-0ab1-482f-b2bf-2c0de3cb6c09 tempest-VolumesDeleteCascade-526616262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0" returned: 0 in 0.884s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5b6e3f82-0ab1-482f-b2bf-2c0de3cb6c09 tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.0cc12b99-ffd1-4abc-915b-3c14d18e55d9 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:13 devstack sudo[101147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.0cc12b99-ffd1-4abc-915b-3c14d18e55d9 1G Jul 08 01:47:13 devstack sudo[101147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:13 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-977584e3-872a-45e4-8834-1bd823dde037 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Created reservations ['9227dbe4-a4b7-4754-b223-e6323c88fd6f', '25594cf1-f7c9-4d27-b368-1c83dfff167a', '8fc690a8-1964-4a4e-9baf-4bfb6edc85c3', 'ca7e51ba-6fb1-4cc1-af04-1f2e88077445'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-977584e3-872a-45e4-8834-1bd823dde037 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-977584e3-872a-45e4-8834-1bd823dde037 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:13 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-977584e3-872a-45e4-8834-1bd823dde037 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:13 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-977584e3-872a-45e4-8834-1bd823dde037 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-977584e3-872a-45e4-8834-1bd823dde037 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-977584e3-872a-45e4-8834-1bd823dde037 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:13 devstack sudo[101149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:47:13 devstack sudo[101149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:13 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-4afdf22f-91c3-4630-8098-b0c0ffaea2ef tempest-CreateVolumesFromSnapshotTest-1626199979 None] Acquiring lock "cinder-ce08e368-1e27-453f-8140-f5c963448ee1-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:14 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-4afdf22f-91c3-4630-8098-b0c0ffaea2ef tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "cinder-ce08e368-1e27-453f-8140-f5c963448ee1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:14 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-4afdf22f-91c3-4630-8098-b0c0ffaea2ef tempest-CreateVolumesFromSnapshotTest-1626199979 None] Acquiring lock "cinder-quobyte-ce08e368-1e27-453f-8140-f5c963448ee1" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:14 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-4afdf22f-91c3-4630-8098-b0c0ffaea2ef tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "cinder-quobyte-ce08e368-1e27-453f-8140-f5c963448ee1" acquired by "delete_volume" :: waited 0.023s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:14 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadd7fb3-bd36-4be4-9c65-69cb2361f93e]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4afdf22f-91c3-4630-8098-b0c0ffaea2ef tempest-CreateVolumesFromSnapshotTest-1626199979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ce08e368-1e27-453f-8140-f5c963448ee1 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:14 devstack sudo[101151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ce08e368-1e27-453f-8140-f5c963448ee1 Jul 08 01:47:14 devstack sudo[101151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:14 devstack sudo[101149]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-977584e3-872a-45e4-8834-1bd823dde037 tempest-CreateVolumesFromSnapshotTest-1626199979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.890s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:14 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-977584e3-872a-45e4-8834-1bd823dde037 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:47:14 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-977584e3-872a-45e4-8834-1bd823dde037 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Deleted volume successfully. Jul 08 01:47:14 devstack sudo[101147]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5b6e3f82-0ab1-482f-b2bf-2c0de3cb6c09 tempest-VolumesDeleteCascade-526616262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.0cc12b99-ffd1-4abc-915b-3c14d18e55d9 1G" returned: 0 in 1.076s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5b6e3f82-0ab1-482f-b2bf-2c0de3cb6c09 tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a458e374-53eb-4f25-b055-5d671dd5d9c0 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.0cc12b99-ffd1-4abc-915b-3c14d18e55d9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:14 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-977584e3-872a-45e4-8834-1bd823dde037 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "cinder-1ade0ccb-ac1d-4ccf-bacb-c76635c18814-delete_volume" released by "delete_volume" :: held 3.013s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:14 devstack sudo[101159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a458e374-53eb-4f25-b055-5d671dd5d9c0 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.0cc12b99-ffd1-4abc-915b-3c14d18e55d9 Jul 08 01:47:14 devstack sudo[101159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:15 devstack sudo[101151]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4afdf22f-91c3-4630-8098-b0c0ffaea2ef tempest-CreateVolumesFromSnapshotTest-1626199979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ce08e368-1e27-453f-8140-f5c963448ee1" returned: 0 in 0.950s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4afdf22f-91c3-4630-8098-b0c0ffaea2ef tempest-CreateVolumesFromSnapshotTest-1626199979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ce08e368-1e27-453f-8140-f5c963448ee1 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:15 devstack sudo[101164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ce08e368-1e27-453f-8140-f5c963448ee1 Jul 08 01:47:15 devstack sudo[101164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:15 devstack sudo[101159]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5b6e3f82-0ab1-482f-b2bf-2c0de3cb6c09 tempest-VolumesDeleteCascade-526616262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a458e374-53eb-4f25-b055-5d671dd5d9c0 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.0cc12b99-ffd1-4abc-915b-3c14d18e55d9" returned: 0 in 0.858s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:15 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-5b6e3f82-0ab1-482f-b2bf-2c0de3cb6c09 tempest-VolumesDeleteCascade-526616262 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.0cc12b99-ffd1-4abc-915b-3c14d18e55d9 is being set with open permissions: ugo+rw Jul 08 01:47:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5b6e3f82-0ab1-482f-b2bf-2c0de3cb6c09 tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.0cc12b99-ffd1-4abc-915b-3c14d18e55d9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:15 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.0cc12b99-ffd1-4abc-915b-3c14d18e55d9 Jul 08 01:47:15 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:15 devstack sudo[101164]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4afdf22f-91c3-4630-8098-b0c0ffaea2ef tempest-CreateVolumesFromSnapshotTest-1626199979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ce08e368-1e27-453f-8140-f5c963448ee1" returned: 0 in 0.706s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:15 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-4afdf22f-91c3-4630-8098-b0c0ffaea2ef tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "cinder-quobyte-ce08e368-1e27-453f-8140-f5c963448ee1" released by "delete_volume" :: held 1.726s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:15 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-4afdf22f-91c3-4630-8098-b0c0ffaea2ef tempest-CreateVolumesFromSnapshotTest-1626199979 None] Created reservations ['8f38561b-bbdd-4347-b94a-0f69d2056df4', '0e6abe56-1528-4c5b-a3ed-1600f21e7361', 'a2820aef-5d42-43bd-99ea-040377ed433a', '12da7d21-9d82-4dc5-9542-264e92457528'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4afdf22f-91c3-4630-8098-b0c0ffaea2ef tempest-CreateVolumesFromSnapshotTest-1626199979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4afdf22f-91c3-4630-8098-b0c0ffaea2ef tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:16 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-4afdf22f-91c3-4630-8098-b0c0ffaea2ef tempest-CreateVolumesFromSnapshotTest-1626199979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:16 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-4afdf22f-91c3-4630-8098-b0c0ffaea2ef tempest-CreateVolumesFromSnapshotTest-1626199979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4afdf22f-91c3-4630-8098-b0c0ffaea2ef tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4afdf22f-91c3-4630-8098-b0c0ffaea2ef tempest-CreateVolumesFromSnapshotTest-1626199979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:16 devstack sudo[101174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:47:16 devstack sudo[101174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:16 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-df28cd17-883a-456b-8897-7b3c010eefe9 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Acquiring lock "cinder-62b9e3a1-237a-4d98-a842-c11abff1df61-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:16 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:16 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-df28cd17-883a-456b-8897-7b3c010eefe9 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "cinder-62b9e3a1-237a-4d98-a842-c11abff1df61-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5b6e3f82-0ab1-482f-b2bf-2c0de3cb6c09 tempest-VolumesDeleteCascade-526616262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.0cc12b99-ffd1-4abc-915b-3c14d18e55d9" returned: 0 in 0.831s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5b6e3f82-0ab1-482f-b2bf-2c0de3cb6c09 tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:16 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-df28cd17-883a-456b-8897-7b3c010eefe9 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Acquiring lock "cinder-quobyte-62b9e3a1-237a-4d98-a842-c11abff1df61" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:16 devstack sudo[101177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.info Jul 08 01:47:16 devstack sudo[101177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:16 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-df28cd17-883a-456b-8897-7b3c010eefe9 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "cinder-quobyte-62b9e3a1-237a-4d98-a842-c11abff1df61" acquired by "delete_volume" :: waited 0.024s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:16 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e392ae1-b115-4081-825d-f0bcc39587fe]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-df28cd17-883a-456b-8897-7b3c010eefe9 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-62b9e3a1-237a-4d98-a842-c11abff1df61 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:16 devstack sudo[101179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-62b9e3a1-237a-4d98-a842-c11abff1df61 Jul 08 01:47:16 devstack sudo[101179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:16 devstack sudo[101174]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4afdf22f-91c3-4630-8098-b0c0ffaea2ef tempest-CreateVolumesFromSnapshotTest-1626199979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.898s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:16 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-4afdf22f-91c3-4630-8098-b0c0ffaea2ef tempest-CreateVolumesFromSnapshotTest-1626199979 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:47:16 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-4afdf22f-91c3-4630-8098-b0c0ffaea2ef tempest-CreateVolumesFromSnapshotTest-1626199979 None] Deleted volume successfully. Jul 08 01:47:17 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-4afdf22f-91c3-4630-8098-b0c0ffaea2ef tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "cinder-ce08e368-1e27-453f-8140-f5c963448ee1-delete_volume" released by "delete_volume" :: held 2.982s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:17 devstack sudo[101177]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5b6e3f82-0ab1-482f-b2bf-2c0de3cb6c09 tempest-VolumesDeleteCascade-526616262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.info" returned: 0 in 0.827s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:17 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-5b6e3f82-0ab1-482f-b2bf-2c0de3cb6c09 tempest-VolumesDeleteCascade-526616262 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.info is being set with open permissions: ugo+rw Jul 08 01:47:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5b6e3f82-0ab1-482f-b2bf-2c0de3cb6c09 tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:17 devstack sudo[101184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.info Jul 08 01:47:17 devstack sudo[101184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:17 devstack sudo[101179]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-df28cd17-883a-456b-8897-7b3c010eefe9 tempest-CreateVolumesFromSnapshotTest-1626199979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-62b9e3a1-237a-4d98-a842-c11abff1df61" returned: 0 in 0.988s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-df28cd17-883a-456b-8897-7b3c010eefe9 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-62b9e3a1-237a-4d98-a842-c11abff1df61 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:17 devstack sudo[101190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-62b9e3a1-237a-4d98-a842-c11abff1df61 Jul 08 01:47:17 devstack sudo[101190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:18 devstack sudo[101184]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5b6e3f82-0ab1-482f-b2bf-2c0de3cb6c09 tempest-VolumesDeleteCascade-526616262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.info" returned: 0 in 0.781s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5b6e3f82-0ab1-482f-b2bf-2c0de3cb6c09 tempest-VolumesDeleteCascade-526616262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.401s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:18 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-5b6e3f82-0ab1-482f-b2bf-2c0de3cb6c09 tempest-VolumesDeleteCascade-526616262 None] Create snapshot completed successfully Jul 08 01:47:18 devstack sudo[101190]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-df28cd17-883a-456b-8897-7b3c010eefe9 tempest-CreateVolumesFromSnapshotTest-1626199979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-62b9e3a1-237a-4d98-a842-c11abff1df61" returned: 0 in 0.788s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:18 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-df28cd17-883a-456b-8897-7b3c010eefe9 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "cinder-quobyte-62b9e3a1-237a-4d98-a842-c11abff1df61" released by "delete_volume" :: held 1.838s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:18 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-df28cd17-883a-456b-8897-7b3c010eefe9 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Created reservations ['1b871dcb-6cb9-4cac-b131-d9f48e290502', 'c58f10c1-4289-4ff4-b6ee-dc63bc2de7dd', 'd9a95519-594e-4e2c-8532-65ec2a3c7d89', '02d420c8-24ca-420d-bfc6-deaa1962cef9'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-df28cd17-883a-456b-8897-7b3c010eefe9 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-df28cd17-883a-456b-8897-7b3c010eefe9 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:18 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-df28cd17-883a-456b-8897-7b3c010eefe9 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:18 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-df28cd17-883a-456b-8897-7b3c010eefe9 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-df28cd17-883a-456b-8897-7b3c010eefe9 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-df28cd17-883a-456b-8897-7b3c010eefe9 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:18 devstack sudo[101194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:47:18 devstack sudo[101194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:18 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-165de2ed-42af-4fe0-afda-bf8cbe0f4cbe tempest-CreateVolumesFromSnapshotTest-1626199979 None] Acquiring lock "cinder-eed314c3-f4d9-437f-af53-aba85e12618f-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:18 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-165de2ed-42af-4fe0-afda-bf8cbe0f4cbe tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "cinder-eed314c3-f4d9-437f-af53-aba85e12618f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:18 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-165de2ed-42af-4fe0-afda-bf8cbe0f4cbe tempest-CreateVolumesFromSnapshotTest-1626199979 None] Acquiring lock "cinder-quobyte-eed314c3-f4d9-437f-af53-aba85e12618f" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:18 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-165de2ed-42af-4fe0-afda-bf8cbe0f4cbe tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "cinder-quobyte-eed314c3-f4d9-437f-af53-aba85e12618f" acquired by "delete_volume" :: waited 0.045s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:18 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab0a02d-3bb1-4385-938e-8b412d49dbe5]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-165de2ed-42af-4fe0-afda-bf8cbe0f4cbe tempest-CreateVolumesFromSnapshotTest-1626199979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eed314c3-f4d9-437f-af53-aba85e12618f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:18 devstack sudo[101196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eed314c3-f4d9-437f-af53-aba85e12618f Jul 08 01:47:18 devstack sudo[101196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8a1b9354-ec02-4ff7-a649-d8688e7e46ac tempest-VolumesDeleteCascade-526616262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8a1b9354-ec02-4ff7-a649-d8688e7e46ac tempest-VolumesDeleteCascade-526616262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:19 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-8a1b9354-ec02-4ff7-a649-d8688e7e46ac tempest-VolumesDeleteCascade-526616262 None] Creating offline snapshot 7e3612ba-aabc-435e-9f56-faf5bd0fa177 of volume a458e374-53eb-4f25-b055-5d671dd5d9c0 {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:47:19 devstack sudo[101194]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-df28cd17-883a-456b-8897-7b3c010eefe9 tempest-CreateVolumesFromSnapshotTest-1626199979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.897s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:19 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-df28cd17-883a-456b-8897-7b3c010eefe9 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:47:19 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbac41d-0abb-4a59-9aae-3817e237e63d]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8a1b9354-ec02-4ff7-a649-d8688e7e46ac tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.0cc12b99-ffd1-4abc-915b-3c14d18e55d9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:19 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-df28cd17-883a-456b-8897-7b3c010eefe9 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Deleted volume successfully. Jul 08 01:47:19 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-df28cd17-883a-456b-8897-7b3c010eefe9 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "cinder-62b9e3a1-237a-4d98-a842-c11abff1df61-delete_volume" released by "delete_volume" :: held 3.054s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:19 devstack sudo[101199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.0cc12b99-ffd1-4abc-915b-3c14d18e55d9 Jul 08 01:47:19 devstack sudo[101199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:19 devstack sudo[101196]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-165de2ed-42af-4fe0-afda-bf8cbe0f4cbe tempest-CreateVolumesFromSnapshotTest-1626199979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eed314c3-f4d9-437f-af53-aba85e12618f" returned: 0 in 1.103s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-165de2ed-42af-4fe0-afda-bf8cbe0f4cbe tempest-CreateVolumesFromSnapshotTest-1626199979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eed314c3-f4d9-437f-af53-aba85e12618f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:19 devstack sudo[101204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eed314c3-f4d9-437f-af53-aba85e12618f Jul 08 01:47:19 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:20 devstack sudo[101199]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8a1b9354-ec02-4ff7-a649-d8688e7e46ac tempest-VolumesDeleteCascade-526616262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.0cc12b99-ffd1-4abc-915b-3c14d18e55d9" returned: 0 in 0.889s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:20 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-8a1b9354-ec02-4ff7-a649-d8688e7e46ac tempest-VolumesDeleteCascade-526616262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a458e374-53eb-4f25-b055-5d671dd5d9c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:47:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8a1b9354-ec02-4ff7-a649-d8688e7e46ac tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.0cc12b99-ffd1-4abc-915b-3c14d18e55d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.7e3612ba-aabc-435e-9f56-faf5bd0fa177 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:20 devstack sudo[101209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.0cc12b99-ffd1-4abc-915b-3c14d18e55d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.7e3612ba-aabc-435e-9f56-faf5bd0fa177 1G Jul 08 01:47:20 devstack sudo[101209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:20 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-165de2ed-42af-4fe0-afda-bf8cbe0f4cbe tempest-CreateVolumesFromSnapshotTest-1626199979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eed314c3-f4d9-437f-af53-aba85e12618f" returned: 0 in 0.711s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:20 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-165de2ed-42af-4fe0-afda-bf8cbe0f4cbe tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "cinder-quobyte-eed314c3-f4d9-437f-af53-aba85e12618f" released by "delete_volume" :: held 1.894s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:20 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-165de2ed-42af-4fe0-afda-bf8cbe0f4cbe tempest-CreateVolumesFromSnapshotTest-1626199979 None] Created reservations ['55f5e5b8-7fcf-4d78-9b15-d5fa9260fe96', '591021fd-ba9f-4ac0-b6bd-06196e440d51', '50dfacee-7804-4545-ae2c-6fca8a8a225d', 'b0be5a87-fc46-481b-9a2a-441bc153e2d6'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-165de2ed-42af-4fe0-afda-bf8cbe0f4cbe tempest-CreateVolumesFromSnapshotTest-1626199979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-165de2ed-42af-4fe0-afda-bf8cbe0f4cbe tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:20 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-165de2ed-42af-4fe0-afda-bf8cbe0f4cbe tempest-CreateVolumesFromSnapshotTest-1626199979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:20 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-165de2ed-42af-4fe0-afda-bf8cbe0f4cbe tempest-CreateVolumesFromSnapshotTest-1626199979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-165de2ed-42af-4fe0-afda-bf8cbe0f4cbe tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-165de2ed-42af-4fe0-afda-bf8cbe0f4cbe tempest-CreateVolumesFromSnapshotTest-1626199979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:20 devstack sudo[101212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:47:20 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:20 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5afcfb5f-d73c-4c88-bfaa-79bf653c1ca2 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Acquiring lock "cinder-6dfe6f34-0656-4704-bf0b-a9a97da8fa98-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:20 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5afcfb5f-d73c-4c88-bfaa-79bf653c1ca2 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "cinder-6dfe6f34-0656-4704-bf0b-a9a97da8fa98-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:20 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5afcfb5f-d73c-4c88-bfaa-79bf653c1ca2 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Acquiring lock "cinder-quobyte-d8039d91-533b-41af-9ca6-07507d2cbd35" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:21 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5afcfb5f-d73c-4c88-bfaa-79bf653c1ca2 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "cinder-quobyte-d8039d91-533b-41af-9ca6-07507d2cbd35" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:21 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5afcfb5f-d73c-4c88-bfaa-79bf653c1ca2 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Acquiring lock "cinder-quobyte-6dfe6f34-0656-4704-bf0b-a9a97da8fa98" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:21 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5afcfb5f-d73c-4c88-bfaa-79bf653c1ca2 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "cinder-quobyte-6dfe6f34-0656-4704-bf0b-a9a97da8fa98" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:21 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-5afcfb5f-d73c-4c88-bfaa-79bf653c1ca2 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Deleting offline snapshot 6dfe6f34-0656-4704-bf0b-a9a97da8fa98 of volume d8039d91-533b-41af-9ca6-07507d2cbd35 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:47:21 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-5afcfb5f-d73c-4c88-bfaa-79bf653c1ca2 tempest-CreateVolumesFromSnapshotTest-1626199979 None] snapshot_file for this snap is: volume-d8039d91-533b-41af-9ca6-07507d2cbd35.6dfe6f34-0656-4704-bf0b-a9a97da8fa98 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:47:21 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2a9d27-6c56-437a-8019-cb7d54b86485]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5afcfb5f-d73c-4c88-bfaa-79bf653c1ca2 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35.6dfe6f34-0656-4704-bf0b-a9a97da8fa98 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:21 devstack sudo[101218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35.6dfe6f34-0656-4704-bf0b-a9a97da8fa98 Jul 08 01:47:21 devstack sudo[101218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:21 devstack sudo[101209]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8a1b9354-ec02-4ff7-a649-d8688e7e46ac tempest-VolumesDeleteCascade-526616262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.0cc12b99-ffd1-4abc-915b-3c14d18e55d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.7e3612ba-aabc-435e-9f56-faf5bd0fa177 1G" returned: 0 in 1.030s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8a1b9354-ec02-4ff7-a649-d8688e7e46ac tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.0cc12b99-ffd1-4abc-915b-3c14d18e55d9 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.7e3612ba-aabc-435e-9f56-faf5bd0fa177 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:21 devstack sudo[101220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.0cc12b99-ffd1-4abc-915b-3c14d18e55d9 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.7e3612ba-aabc-435e-9f56-faf5bd0fa177 Jul 08 01:47:21 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:21 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-165de2ed-42af-4fe0-afda-bf8cbe0f4cbe tempest-CreateVolumesFromSnapshotTest-1626199979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.802s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:21 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-165de2ed-42af-4fe0-afda-bf8cbe0f4cbe tempest-CreateVolumesFromSnapshotTest-1626199979 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:47:21 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-165de2ed-42af-4fe0-afda-bf8cbe0f4cbe tempest-CreateVolumesFromSnapshotTest-1626199979 None] Deleted volume successfully. Jul 08 01:47:21 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-165de2ed-42af-4fe0-afda-bf8cbe0f4cbe tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "cinder-eed314c3-f4d9-437f-af53-aba85e12618f-delete_volume" released by "delete_volume" :: held 2.999s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:22 devstack sudo[101218]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5afcfb5f-d73c-4c88-bfaa-79bf653c1ca2 tempest-CreateVolumesFromSnapshotTest-1626199979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35.6dfe6f34-0656-4704-bf0b-a9a97da8fa98" returned: 0 in 0.939s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:22 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-5afcfb5f-d73c-4c88-bfaa-79bf653c1ca2 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8039d91-533b-41af-9ca6-07507d2cbd35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:47:22 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a0c028-4f0c-4fc4-bf79-3bbbbe1be63c]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5afcfb5f-d73c-4c88-bfaa-79bf653c1ca2 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:22 devstack sudo[101229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35 Jul 08 01:47:22 devstack sudo[101229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:22 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8a1b9354-ec02-4ff7-a649-d8688e7e46ac tempest-VolumesDeleteCascade-526616262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.0cc12b99-ffd1-4abc-915b-3c14d18e55d9 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.7e3612ba-aabc-435e-9f56-faf5bd0fa177" returned: 0 in 0.881s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:22 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-8a1b9354-ec02-4ff7-a649-d8688e7e46ac tempest-VolumesDeleteCascade-526616262 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.7e3612ba-aabc-435e-9f56-faf5bd0fa177 is being set with open permissions: ugo+rw Jul 08 01:47:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8a1b9354-ec02-4ff7-a649-d8688e7e46ac tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.7e3612ba-aabc-435e-9f56-faf5bd0fa177 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:22 devstack sudo[101231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.7e3612ba-aabc-435e-9f56-faf5bd0fa177 Jul 08 01:47:22 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:22 devstack sudo[101229]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5afcfb5f-d73c-4c88-bfaa-79bf653c1ca2 tempest-CreateVolumesFromSnapshotTest-1626199979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35" returned: 0 in 0.844s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5afcfb5f-d73c-4c88-bfaa-79bf653c1ca2 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35.6dfe6f34-0656-4704-bf0b-a9a97da8fa98 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:22 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8a1b9354-ec02-4ff7-a649-d8688e7e46ac tempest-VolumesDeleteCascade-526616262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.7e3612ba-aabc-435e-9f56-faf5bd0fa177" returned: 0 in 0.711s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:22 devstack sudo[101237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35.6dfe6f34-0656-4704-bf0b-a9a97da8fa98 Jul 08 01:47:22 devstack sudo[101237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8a1b9354-ec02-4ff7-a649-d8688e7e46ac tempest-VolumesDeleteCascade-526616262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.650s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:22 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-8a1b9354-ec02-4ff7-a649-d8688e7e46ac tempest-VolumesDeleteCascade-526616262 None] Create snapshot completed successfully Jul 08 01:47:23 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Acquiring lock "cinder-a458e374-53eb-4f25-b055-5d671dd5d9c0-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:23 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Lock "cinder-a458e374-53eb-4f25-b055-5d671dd5d9c0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:23 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Performing cascade delete. {{(pid=87284) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 08 01:47:23 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Acquiring lock "cinder-0cc12b99-ffd1-4abc-915b-3c14d18e55d9-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:23 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Lock "cinder-0cc12b99-ffd1-4abc-915b-3c14d18e55d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:23 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Acquiring lock "cinder-quobyte-a458e374-53eb-4f25-b055-5d671dd5d9c0" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:23 devstack sudo[101237]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:23 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Lock "cinder-quobyte-a458e374-53eb-4f25-b055-5d671dd5d9c0" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:23 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Acquiring lock "cinder-quobyte-0cc12b99-ffd1-4abc-915b-3c14d18e55d9" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5afcfb5f-d73c-4c88-bfaa-79bf653c1ca2 tempest-CreateVolumesFromSnapshotTest-1626199979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35.6dfe6f34-0656-4704-bf0b-a9a97da8fa98" returned: 0 in 0.840s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5afcfb5f-d73c-4c88-bfaa-79bf653c1ca2 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35.6dfe6f34-0656-4704-bf0b-a9a97da8fa98 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:23 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Lock "cinder-quobyte-0cc12b99-ffd1-4abc-915b-3c14d18e55d9" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:23 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Deleting offline snapshot 0cc12b99-ffd1-4abc-915b-3c14d18e55d9 of volume a458e374-53eb-4f25-b055-5d671dd5d9c0 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:47:23 devstack sudo[101243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35.6dfe6f34-0656-4704-bf0b-a9a97da8fa98 Jul 08 01:47:23 devstack sudo[101243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:23 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] snapshot_file for this snap is: volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.0cc12b99-ffd1-4abc-915b-3c14d18e55d9 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:47:23 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0cb4f80-643a-46d8-8b9d-471a6cf44754]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.0cc12b99-ffd1-4abc-915b-3c14d18e55d9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:23 devstack sudo[101245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.0cc12b99-ffd1-4abc-915b-3c14d18e55d9 Jul 08 01:47:23 devstack sudo[101245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:24 devstack sudo[101243]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5afcfb5f-d73c-4c88-bfaa-79bf653c1ca2 tempest-CreateVolumesFromSnapshotTest-1626199979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35.6dfe6f34-0656-4704-bf0b-a9a97da8fa98" returned: 0 in 0.824s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:24 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5afcfb5f-d73c-4c88-bfaa-79bf653c1ca2 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "cinder-quobyte-6dfe6f34-0656-4704-bf0b-a9a97da8fa98" released by "_delete_snapshot" :: held 3.585s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:24 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5afcfb5f-d73c-4c88-bfaa-79bf653c1ca2 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "cinder-quobyte-d8039d91-533b-41af-9ca6-07507d2cbd35" released by "delete_snapshot" :: held 3.618s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:24 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-5afcfb5f-d73c-4c88-bfaa-79bf653c1ca2 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Created reservations ['fe9bfaae-ba46-4ebb-8d52-07645de8ff8c', 'f81c9724-0cef-4ce3-8227-8f72d30e461a', '24430784-f16d-4b62-b1bd-ea9cbc49c13e', '6b74f345-f970-4b29-ace5-245f1a758909'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:24 devstack sudo[101245]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.0cc12b99-ffd1-4abc-915b-3c14d18e55d9" returned: 0 in 0.929s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:24 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a458e374-53eb-4f25-b055-5d671dd5d9c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:47:24 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[41dd447a-e046-4c4b-a931-17fce0310276]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:24 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-5afcfb5f-d73c-4c88-bfaa-79bf653c1ca2 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Delete snapshot completed successfully. Jul 08 01:47:24 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5afcfb5f-d73c-4c88-bfaa-79bf653c1ca2 tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "cinder-6dfe6f34-0656-4704-bf0b-a9a97da8fa98-delete_snapshot" released by "delete_snapshot" :: held 3.855s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:24 devstack sudo[101252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0 Jul 08 01:47:24 devstack sudo[101252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:25 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-9f35fe4a-2ee0-4ace-9eb0-344da381fa7c tempest-CreateVolumesFromSnapshotTest-1626199979 None] Acquiring lock "cinder-d8039d91-533b-41af-9ca6-07507d2cbd35-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:25 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-9f35fe4a-2ee0-4ace-9eb0-344da381fa7c tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "cinder-d8039d91-533b-41af-9ca6-07507d2cbd35-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:25 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-9f35fe4a-2ee0-4ace-9eb0-344da381fa7c tempest-CreateVolumesFromSnapshotTest-1626199979 None] Acquiring lock "cinder-quobyte-d8039d91-533b-41af-9ca6-07507d2cbd35" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:25 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-9f35fe4a-2ee0-4ace-9eb0-344da381fa7c tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "cinder-quobyte-d8039d91-533b-41af-9ca6-07507d2cbd35" acquired by "delete_volume" :: waited 0.037s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:25 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[04836420-643f-4274-a5e5-301e47b44be4]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9f35fe4a-2ee0-4ace-9eb0-344da381fa7c tempest-CreateVolumesFromSnapshotTest-1626199979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:25 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:47:25 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Flow 'volume_create_manager' (2bb9c01b-4bb2-45ff-8e4c-78a24041bd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:25 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58e530db-84d3-40ba-bed7-8f8453a4342a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:25 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58e530db-84d3-40ba-bed7-8f8453a4342a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e55112-c687-492f-92c5-cff8594bcb8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6d3793b4dcc42df83ad148c536fcb07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:25Z,use_quota=True,user_id='ca67da44b7a04df7a4694a9b9e5cfc06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff5c9fbc-9a27-4cc1-a4da-e64f0247afd5),volume_type_id=ff5c9fbc-9a27-4cc1-a4da-e64f0247afd5)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:25 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bf31e75-3415-48cb-bc9f-bb7e6a10c4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:25 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bf31e75-3415-48cb-bc9f-bb7e6a10c4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:25 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d44b50b-153a-4be5-979a-d970c93ee2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:25 devstack cinder-volume[87284]: DEBUG cinder.image.glance [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Creating Keystone auth plugin from conf {{(pid=87284) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:47:25 devstack sudo[101255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35 Jul 08 01:47:25 devstack sudo[101255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:25 devstack sudo[101252]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0" returned: 0 in 0.906s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:25 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[430de5e6-01f5-4fcf-bc99-70075f1bcea4]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.7e3612ba-aabc-435e-9f56-faf5bd0fa177 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:25 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d44b50b-153a-4be5-979a-d970c93ee2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a8e55112-c687-492f-92c5-cff8594bcb8e', 'volume_name': 'volume-a8e55112-c687-492f-92c5-cff8594bcb8e', 'volume_size': 1, 'image_id': '708a0e2f-c2d8-47ce-bc00-7176135d748c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/708a0e2f-c2d8-47ce-bc00-7176135d748c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '38f73916b2554de271e3aaea4719eb8c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b6d3793b4dcc42df83ad148c536fcb07', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '39edb9fbbfbcc201a83cdc3edd087bb2210639a9d8b16af60d93532463c3f2a36a40c27475883fbdf8d2328cbfed609833ab7152ba9dd1067b53127deb5e5093', 'id': '708a0e2f-c2d8-47ce-bc00-7176135d748c', 'created_at': datetime.datetime(2026, 7, 7, 23, 47, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 47, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/708a0e2f-c2d8-47ce-bc00-7176135d748c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:25 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f5a7fb1-6a15-438e-8358-ce59f84818eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:25 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f5a7fb1-6a15-438e-8358-ce59f84818eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:25 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (586289c8-8386-4a1a-9727-5fd4f345784f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:25 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Volume a8e55112-c687-492f-92c5-cff8594bcb8e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a8e55112-c687-492f-92c5-cff8594bcb8e', 'volume_size': 1, 'image_id': '708a0e2f-c2d8-47ce-bc00-7176135d748c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/708a0e2f-c2d8-47ce-bc00-7176135d748c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '38f73916b2554de271e3aaea4719eb8c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b6d3793b4dcc42df83ad148c536fcb07', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '39edb9fbbfbcc201a83cdc3edd087bb2210639a9d8b16af60d93532463c3f2a36a40c27475883fbdf8d2328cbfed609833ab7152ba9dd1067b53127deb5e5093', 'id': '708a0e2f-c2d8-47ce-bc00-7176135d748c', 'created_at': datetime.datetime(2026, 7, 7, 23, 47, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 47, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/708a0e2f-c2d8-47ce-bc00-7176135d748c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 08 01:47:25 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Trying to clone a8e55112-c687-492f-92c5-cff8594bcb8e from image 708a0e2f-c2d8-47ce-bc00-7176135d748c at location (None, [{'url': 'file:///opt/stack/data/glance/images/708a0e2f-c2d8-47ce-bc00-7176135d748c', 'metadata': {}}]). {{(pid=87284) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:47:25 devstack sudo[101261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.7e3612ba-aabc-435e-9f56-faf5bd0fa177 Jul 08 01:47:25 devstack sudo[101261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:25 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_708a0e2f-c2d8-47ce-bc00-7176135d748c_smxo4t5rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87284) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:47:25 devstack cinder-volume[87284]: INFO cinder.image.image_utils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Image download 0.00 MB at 0.00 MB/s Jul 08 01:47:25 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f6abb5-f7f1-425b-b124-f8624c0cc96a]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_708a0e2f-c2d8-47ce-bc00-7176135d748c_smxo4t5rdevstack@QuobyteHD {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:26 devstack sudo[101263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_708a0e2f-c2d8-47ce-bc00-7176135d748c_smxo4t5rdevstack@QuobyteHD Jul 08 01:47:26 devstack sudo[101263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:26 devstack sudo[101255]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9f35fe4a-2ee0-4ace-9eb0-344da381fa7c tempest-CreateVolumesFromSnapshotTest-1626199979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35" returned: 0 in 0.952s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9f35fe4a-2ee0-4ace-9eb0-344da381fa7c tempest-CreateVolumesFromSnapshotTest-1626199979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:26 devstack sudo[101268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35 Jul 08 01:47:26 devstack sudo[101268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:26 devstack sudo[101261]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.7e3612ba-aabc-435e-9f56-faf5bd0fa177" returned: 0 in 0.932s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:26 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a458e374-53eb-4f25-b055-5d671dd5d9c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:47:26 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54a1497-4431-486f-9705-8eda79c31604]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.0cc12b99-ffd1-4abc-915b-3c14d18e55d9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:26 devstack sudo[101263]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_708a0e2f-c2d8-47ce-bc00-7176135d748c_smxo4t5rdevstack@QuobyteHD" returned: 0 in 0.808s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_708a0e2f-c2d8-47ce-bc00-7176135d748c_smxo4t5rdevstack@QuobyteHD {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:26 devstack sudo[101278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.0cc12b99-ffd1-4abc-915b-3c14d18e55d9 Jul 08 01:47:26 devstack sudo[101278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:26 devstack sudo[101282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_708a0e2f-c2d8-47ce-bc00-7176135d748c_smxo4t5rdevstack@QuobyteHD Jul 08 01:47:26 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:27 devstack sudo[101268]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9f35fe4a-2ee0-4ace-9eb0-344da381fa7c tempest-CreateVolumesFromSnapshotTest-1626199979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d8039d91-533b-41af-9ca6-07507d2cbd35" returned: 0 in 0.784s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:27 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-9f35fe4a-2ee0-4ace-9eb0-344da381fa7c tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "cinder-quobyte-d8039d91-533b-41af-9ca6-07507d2cbd35" released by "delete_volume" :: held 1.842s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:27 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-9f35fe4a-2ee0-4ace-9eb0-344da381fa7c tempest-CreateVolumesFromSnapshotTest-1626199979 None] Created reservations ['4fdc0112-39cb-418a-bfdc-645633d4bcbe', '175876ca-e4af-4ebd-8b92-11451d94347f', '9e99b65c-a9ec-438a-a052-f9eaadbb7c0d', '2f07c135-1a76-4a6e-91dd-d502b054a8b0'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-9f35fe4a-2ee0-4ace-9eb0-344da381fa7c tempest-CreateVolumesFromSnapshotTest-1626199979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-9f35fe4a-2ee0-4ace-9eb0-344da381fa7c tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:27 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-9f35fe4a-2ee0-4ace-9eb0-344da381fa7c tempest-CreateVolumesFromSnapshotTest-1626199979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:27 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-9f35fe4a-2ee0-4ace-9eb0-344da381fa7c tempest-CreateVolumesFromSnapshotTest-1626199979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-9f35fe4a-2ee0-4ace-9eb0-344da381fa7c tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9f35fe4a-2ee0-4ace-9eb0-344da381fa7c tempest-CreateVolumesFromSnapshotTest-1626199979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:27 devstack sudo[101286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:47:27 devstack sudo[101286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:27 devstack sudo[101278]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.0cc12b99-ffd1-4abc-915b-3c14d18e55d9" returned: 0 in 0.926s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:27 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a458e374-53eb-4f25-b055-5d671dd5d9c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:47:27 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbd0526-927d-4b1b-9ae1-7ac950e8564c]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:27 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_708a0e2f-c2d8-47ce-bc00-7176135d748c_smxo4t5rdevstack@QuobyteHD" returned: 1 in 0.925s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_708a0e2f-c2d8-47ce-bc00-7176135d748c_smxo4t5rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:47:27 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Temporary image 708a0e2f-c2d8-47ce-bc00-7176135d748c is fetched for user ca67da44b7a04df7a4694a9b9e5cfc06. {{(pid=87284) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:47:27 devstack sudo[101295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0 Jul 08 01:47:27 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:27 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fadfa3-7a1a-44b2-a549-86e3aad1bbd1]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_708a0e2f-c2d8-47ce-bc00-7176135d748c_smxo4t5rdevstack@QuobyteHD {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:27 devstack sudo[101297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_708a0e2f-c2d8-47ce-bc00-7176135d748c_smxo4t5rdevstack@QuobyteHD Jul 08 01:47:27 devstack sudo[101297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:28 devstack sudo[101286]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9f35fe4a-2ee0-4ace-9eb0-344da381fa7c tempest-CreateVolumesFromSnapshotTest-1626199979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.807s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:28 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-9f35fe4a-2ee0-4ace-9eb0-344da381fa7c tempest-CreateVolumesFromSnapshotTest-1626199979 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:47:28 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-9f35fe4a-2ee0-4ace-9eb0-344da381fa7c tempest-CreateVolumesFromSnapshotTest-1626199979 None] Deleted volume successfully. Jul 08 01:47:28 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-9f35fe4a-2ee0-4ace-9eb0-344da381fa7c tempest-CreateVolumesFromSnapshotTest-1626199979 None] Lock "cinder-d8039d91-533b-41af-9ca6-07507d2cbd35-delete_volume" released by "delete_volume" :: held 2.939s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:28 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0" returned: 0 in 0.919s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.0cc12b99-ffd1-4abc-915b-3c14d18e55d9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:28 devstack sudo[101305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.0cc12b99-ffd1-4abc-915b-3c14d18e55d9 Jul 08 01:47:28 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:28 devstack sudo[101297]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_708a0e2f-c2d8-47ce-bc00-7176135d748c_smxo4t5rdevstack@QuobyteHD" returned: 0 in 0.906s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_708a0e2f-c2d8-47ce-bc00-7176135d748c_smxo4t5rdevstack@QuobyteHD {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:28 devstack sudo[101307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_708a0e2f-c2d8-47ce-bc00-7176135d748c_smxo4t5rdevstack@QuobyteHD Jul 08 01:47:28 devstack sudo[101307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:29 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.0cc12b99-ffd1-4abc-915b-3c14d18e55d9" returned: 0 in 0.887s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.0cc12b99-ffd1-4abc-915b-3c14d18e55d9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:29 devstack sudo[101316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.0cc12b99-ffd1-4abc-915b-3c14d18e55d9 Jul 08 01:47:29 devstack sudo[101316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:29 devstack sudo[101307]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_708a0e2f-c2d8-47ce-bc00-7176135d748c_smxo4t5rdevstack@QuobyteHD" returned: 1 in 0.839s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_708a0e2f-c2d8-47ce-bc00-7176135d748c_smxo4t5rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:47:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:29 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e55112-c687-492f-92c5-cff8594bcb8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6d3793b4dcc42df83ad148c536fcb07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:25Z,use_quota=True,user_id='ca67da44b7a04df7a4694a9b9e5cfc06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff5c9fbc-9a27-4cc1-a4da-e64f0247afd5),volume_type_id=ff5c9fbc-9a27-4cc1-a4da-e64f0247afd5)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:47:29 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Creating volume a8e55112-c687-492f-92c5-cff8594bcb8e {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:47:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:29 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:29 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:29 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:47:29 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:47:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8e55112-c687-492f-92c5-cff8594bcb8e 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:29 devstack sudo[101318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8e55112-c687-492f-92c5-cff8594bcb8e 1073741824 Jul 08 01:47:29 devstack sudo[101318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:30 devstack sudo[101316]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.0cc12b99-ffd1-4abc-915b-3c14d18e55d9" returned: 0 in 0.776s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a458e374-53eb-4f25-b055-5d671dd5d9c0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.7e3612ba-aabc-435e-9f56-faf5bd0fa177 -F qcow2 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:30 devstack sudo[101324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a458e374-53eb-4f25-b055-5d671dd5d9c0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.7e3612ba-aabc-435e-9f56-faf5bd0fa177 -F qcow2 Jul 08 01:47:30 devstack sudo[101324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:30 devstack sudo[101318]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8e55112-c687-492f-92c5-cff8594bcb8e 1073741824" returned: 0 in 1.002s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8e55112-c687-492f-92c5-cff8594bcb8e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:30 devstack sudo[101326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8e55112-c687-492f-92c5-cff8594bcb8e Jul 08 01:47:30 devstack sudo[101326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:31 devstack sudo[101324]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a458e374-53eb-4f25-b055-5d671dd5d9c0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.7e3612ba-aabc-435e-9f56-faf5bd0fa177 -F qcow2" returned: 0 in 0.795s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:31 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Lock "cinder-quobyte-0cc12b99-ffd1-4abc-915b-3c14d18e55d9" released by "_delete_snapshot" :: held 7.316s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:31 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Lock "cinder-quobyte-a458e374-53eb-4f25-b055-5d671dd5d9c0" released by "delete_snapshot" :: held 7.352s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:31 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Created reservations ['61ddaa8b-f7da-4f01-ae27-01c2e78b2656', 'cdfeb216-07c8-4718-a974-074fbc557e57', '620cf86e-04d5-4583-8571-1ff60ef205cb', 'f7a73780-27f6-4fd8-9dda-b7a04fb6f824'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:31 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Delete snapshot completed successfully. Jul 08 01:47:31 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Lock "cinder-0cc12b99-ffd1-4abc-915b-3c14d18e55d9-delete_snapshot" released by "delete_snapshot" :: held 7.541s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:31 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Acquiring lock "cinder-7e3612ba-aabc-435e-9f56-faf5bd0fa177-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:31 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Lock "cinder-7e3612ba-aabc-435e-9f56-faf5bd0fa177-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:31 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Acquiring lock "cinder-quobyte-a458e374-53eb-4f25-b055-5d671dd5d9c0" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:31 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Lock "cinder-quobyte-a458e374-53eb-4f25-b055-5d671dd5d9c0" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:31 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Acquiring lock "cinder-quobyte-7e3612ba-aabc-435e-9f56-faf5bd0fa177" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:31 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Lock "cinder-quobyte-7e3612ba-aabc-435e-9f56-faf5bd0fa177" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:31 devstack sudo[101326]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:31 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Deleting offline snapshot 7e3612ba-aabc-435e-9f56-faf5bd0fa177 of volume a458e374-53eb-4f25-b055-5d671dd5d9c0 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:47:31 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] snapshot_file for this snap is: volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.7e3612ba-aabc-435e-9f56-faf5bd0fa177 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:47:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8e55112-c687-492f-92c5-cff8594bcb8e" returned: 0 in 0.739s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:31 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] <== create_volume: return (1802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:47:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.805s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:31 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[500e0aaa-9130-4782-9c8a-6b38e5f30bf8]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.7e3612ba-aabc-435e-9f56-faf5bd0fa177 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:31 devstack cinder-volume[87284]: DEBUG cinder.volume.volume_utils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Attempting download of 708a0e2f-c2d8-47ce-bc00-7176135d748c ((None, [{'url': 'file:///opt/stack/data/glance/images/708a0e2f-c2d8-47ce-bc00-7176135d748c', 'metadata': {}}])) to volume a8e55112-c687-492f-92c5-cff8594bcb8e. {{(pid=87284) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:47:31 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[71bd479a-2ed5-4c95-8539-f21aa8cee605]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_708a0e2f-c2d8-47ce-bc00-7176135d748c_drryiwf9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:31 devstack sudo[101332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.7e3612ba-aabc-435e-9f56-faf5bd0fa177 Jul 08 01:47:31 devstack sudo[101332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:31 devstack sudo[101333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_708a0e2f-c2d8-47ce-bc00-7176135d748c_drryiwf9 Jul 08 01:47:31 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:32 devstack sudo[101332]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.7e3612ba-aabc-435e-9f56-faf5bd0fa177" returned: 0 in 0.872s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:32 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a458e374-53eb-4f25-b055-5d671dd5d9c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:47:32 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[843d15f2-c74d-4752-be6f-6fcd234461d2]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:32 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_708a0e2f-c2d8-47ce-bc00-7176135d748c_drryiwf9" returned: 0 in 0.873s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_708a0e2f-c2d8-47ce-bc00-7176135d748c_drryiwf9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:32 devstack sudo[101341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0 Jul 08 01:47:32 devstack sudo[101341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:32 devstack sudo[101342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_708a0e2f-c2d8-47ce-bc00-7176135d748c_drryiwf9 Jul 08 01:47:32 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:33 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_708a0e2f-c2d8-47ce-bc00-7176135d748c_drryiwf9" returned: 1 in 0.853s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_708a0e2f-c2d8-47ce-bc00-7176135d748c_drryiwf9' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:47:33 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[86365991-8763-48bd-87ff-70c1ddba2918]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_708a0e2f-c2d8-47ce-bc00-7176135d748c_smxo4t5rdevstack@QuobyteHD {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:33 devstack sudo[101341]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0" returned: 0 in 0.911s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.7e3612ba-aabc-435e-9f56-faf5bd0fa177 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:33 devstack sudo[101352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.7e3612ba-aabc-435e-9f56-faf5bd0fa177 Jul 08 01:47:33 devstack sudo[101352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:33 devstack sudo[101351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_708a0e2f-c2d8-47ce-bc00-7176135d748c_smxo4t5rdevstack@QuobyteHD Jul 08 01:47:33 devstack sudo[101351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:33 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:47:33 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Flow 'volume_create_manager' (a1dbf735-9f62-4d22-a1d7-ebf30a6484d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:33 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd2e9dff-ef9f-4573-a43b-32dfc5a04941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:33 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd2e9dff-ef9f-4573-a43b-32dfc5a04941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58402857-62e9-41e3-af83-797bc21779f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77ca4f7be0834764833189f64723e7fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:34Z,use_quota=True,user_id='e5b71ce79e5643b09e4012665224c276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:33 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16f5cfba-94cc-4d65-8a54-a3eba0e67dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:33 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16f5cfba-94cc-4d65-8a54-a3eba0e67dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:33 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9db48f9b-0e99-49aa-8a46-e8bd4db3cdf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:33 devstack cinder-volume[87284]: DEBUG cinder.image.glance [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Creating Keystone auth plugin from conf {{(pid=87284) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:47:34 devstack sudo[101352]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.7e3612ba-aabc-435e-9f56-faf5bd0fa177" returned: 0 in 0.882s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.7e3612ba-aabc-435e-9f56-faf5bd0fa177 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:34 devstack sudo[101351]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_708a0e2f-c2d8-47ce-bc00-7176135d748c_smxo4t5rdevstack@QuobyteHD" returned: 0 in 0.923s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_708a0e2f-c2d8-47ce-bc00-7176135d748c_smxo4t5rdevstack@QuobyteHD {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:34 devstack sudo[101360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.7e3612ba-aabc-435e-9f56-faf5bd0fa177 Jul 08 01:47:34 devstack sudo[101360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:34 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9db48f9b-0e99-49aa-8a46-e8bd4db3cdf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '58402857-62e9-41e3-af83-797bc21779f4', 'volume_name': 'volume-58402857-62e9-41e3-af83-797bc21779f4', 'volume_size': 1, 'image_id': 'd7e07783-7253-49ae-97c9-e70e03765702', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d7e07783-7253-49ae-97c9-e70e03765702', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1c55a89b8c91e1ff2eac7b650846a805', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '77ca4f7be0834764833189f64723e7fe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'eb345b5bf6db19f0425f5ee722907f108a552bd3c7cdb6eca38063c9f3f291c37ab0f15ac853fd9c19f4ded40c9ba9fcebaee6884c9db15a3d6d1a8c715fab0f', 'id': 'd7e07783-7253-49ae-97c9-e70e03765702', 'created_at': datetime.datetime(2026, 7, 7, 23, 47, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 47, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d7e07783-7253-49ae-97c9-e70e03765702/file', 'properties': {}}, 'image_service': }' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:34 devstack sudo[101362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_708a0e2f-c2d8-47ce-bc00-7176135d748c_smxo4t5rdevstack@QuobyteHD Jul 08 01:47:34 devstack sudo[101362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:34 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0b55fd2-4f74-41e3-8214-4a2393aa87f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:34 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0b55fd2-4f74-41e3-8214-4a2393aa87f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:34 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b0cee31-9510-4432-a21d-a161595907c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:34 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Volume 58402857-62e9-41e3-af83-797bc21779f4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-58402857-62e9-41e3-af83-797bc21779f4', 'volume_size': 1, 'image_id': 'd7e07783-7253-49ae-97c9-e70e03765702', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d7e07783-7253-49ae-97c9-e70e03765702', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1c55a89b8c91e1ff2eac7b650846a805', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '77ca4f7be0834764833189f64723e7fe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'eb345b5bf6db19f0425f5ee722907f108a552bd3c7cdb6eca38063c9f3f291c37ab0f15ac853fd9c19f4ded40c9ba9fcebaee6884c9db15a3d6d1a8c715fab0f', 'id': 'd7e07783-7253-49ae-97c9-e70e03765702', 'created_at': datetime.datetime(2026, 7, 7, 23, 47, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 47, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d7e07783-7253-49ae-97c9-e70e03765702/file', 'properties': {}}, 'image_service': } Jul 08 01:47:34 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Trying to clone 58402857-62e9-41e3-af83-797bc21779f4 from image d7e07783-7253-49ae-97c9-e70e03765702 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d7e07783-7253-49ae-97c9-e70e03765702', 'metadata': {}}]). {{(pid=87284) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:47:34 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d7e07783-7253-49ae-97c9-e70e03765702_3yh3jlwwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87284) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:47:34 devstack cinder-volume[87284]: INFO cinder.image.image_utils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Image download 0.00 MB at 0.00 MB/s Jul 08 01:47:34 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[1417ba32-cbe2-4080-a773-8804287f48c4]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d7e07783-7253-49ae-97c9-e70e03765702_3yh3jlwwdevstack@QuobyteHD {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:34 devstack sudo[101364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d7e07783-7253-49ae-97c9-e70e03765702_3yh3jlwwdevstack@QuobyteHD Jul 08 01:47:34 devstack sudo[101364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:34 devstack sudo[101360]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0.7e3612ba-aabc-435e-9f56-faf5bd0fa177" returned: 0 in 0.736s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:34 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Lock "cinder-quobyte-7e3612ba-aabc-435e-9f56-faf5bd0fa177" released by "_delete_snapshot" :: held 3.550s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:34 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Lock "cinder-quobyte-a458e374-53eb-4f25-b055-5d671dd5d9c0" released by "delete_snapshot" :: held 3.574s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:34 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Created reservations ['c7cf39da-f216-4ed1-8626-a4d44a8b06fa', '4eedb185-cdcf-430c-9fab-4a0e04d8fc17', '00107337-093e-4bd5-83dd-301c949c3bcd', 'bebc77b7-14be-472a-bf00-be37873bc0e6'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:34 devstack sudo[101362]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_708a0e2f-c2d8-47ce-bc00-7176135d748c_smxo4t5rdevstack@QuobyteHD" returned: 1 in 0.875s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_708a0e2f-c2d8-47ce-bc00-7176135d748c_smxo4t5rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:47:34 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] 708a0e2f-c2d8-47ce-bc00-7176135d748c was raw, converting to raw {{(pid=87284) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:47:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_708a0e2f-c2d8-47ce-bc00-7176135d748c_smxo4t5rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8e55112-c687-492f-92c5-cff8594bcb8e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:35 devstack sudo[101370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_708a0e2f-c2d8-47ce-bc00-7176135d748c_smxo4t5rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8e55112-c687-492f-92c5-cff8594bcb8e Jul 08 01:47:35 devstack sudo[101370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:35 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Delete snapshot completed successfully. Jul 08 01:47:35 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Lock "cinder-7e3612ba-aabc-435e-9f56-faf5bd0fa177-delete_snapshot" released by "delete_snapshot" :: held 3.807s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:35 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Snapshots deleted, issuing volume delete {{(pid=87284) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 08 01:47:35 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Acquiring lock "cinder-quobyte-a458e374-53eb-4f25-b055-5d671dd5d9c0" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:35 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Lock "cinder-quobyte-a458e374-53eb-4f25-b055-5d671dd5d9c0" acquired by "delete_volume" :: waited 0.027s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:35 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4f6797-fc63-4406-a746-cb03e13fb6e9]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:35 devstack sudo[101364]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d7e07783-7253-49ae-97c9-e70e03765702_3yh3jlwwdevstack@QuobyteHD" returned: 0 in 0.841s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d7e07783-7253-49ae-97c9-e70e03765702_3yh3jlwwdevstack@QuobyteHD {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:35 devstack sudo[101374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0 Jul 08 01:47:35 devstack sudo[101374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:35 devstack sudo[101376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d7e07783-7253-49ae-97c9-e70e03765702_3yh3jlwwdevstack@QuobyteHD Jul 08 01:47:35 devstack sudo[101376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:35 devstack sudo[101370]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_708a0e2f-c2d8-47ce-bc00-7176135d748c_smxo4t5rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8e55112-c687-492f-92c5-cff8594bcb8e" returned: 0 in 0.903s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:35 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_708a0e2f-c2d8-47ce-bc00-7176135d748c_smxo4t5rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8e55112-c687-492f-92c5-cff8594bcb8e {{(pid=87284) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:47:35 devstack cinder-volume[87284]: INFO cinder.image.image_utils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 01:47:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8e55112-c687-492f-92c5-cff8594bcb8e 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:35 devstack sudo[101418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8e55112-c687-492f-92c5-cff8594bcb8e 1G Jul 08 01:47:35 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:36 devstack sudo[101374]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0" returned: 0 in 0.971s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:36 devstack sudo[101424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0 Jul 08 01:47:36 devstack sudo[101424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:36 devstack sudo[101376]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d7e07783-7253-49ae-97c9-e70e03765702_3yh3jlwwdevstack@QuobyteHD" returned: 1 in 0.971s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d7e07783-7253-49ae-97c9-e70e03765702_3yh3jlwwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:47:36 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Temporary image d7e07783-7253-49ae-97c9-e70e03765702 is fetched for user e5b71ce79e5643b09e4012665224c276. {{(pid=87284) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:47:36 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f04f7b6-4cdd-41c7-8ddf-1950270c4a42]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d7e07783-7253-49ae-97c9-e70e03765702_3yh3jlwwdevstack@QuobyteHD {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:36 devstack sudo[101428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d7e07783-7253-49ae-97c9-e70e03765702_3yh3jlwwdevstack@QuobyteHD Jul 08 01:47:36 devstack sudo[101428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:36 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8e55112-c687-492f-92c5-cff8594bcb8e 1G" returned: 0 in 0.842s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:36 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[8256f6a8-1edd-422a-b595-45ebadb235ba]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8e55112-c687-492f-92c5-cff8594bcb8e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:36 devstack sudo[101424]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a458e374-53eb-4f25-b055-5d671dd5d9c0" returned: 0 in 0.748s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:36 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Lock "cinder-quobyte-a458e374-53eb-4f25-b055-5d671dd5d9c0" released by "delete_volume" :: held 1.799s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:36 devstack sudo[101434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8e55112-c687-492f-92c5-cff8594bcb8e Jul 08 01:47:36 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:36 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Created reservations ['f028a153-6d84-4a67-984b-1952c3a5a934', '53a5e8dd-ea6d-4980-aeb0-90d0b1951637', '7a0e8889-82b8-4cb2-9b28-46e00a746b0b', 'b89b3b74-a410-4e88-bcae-698a40f66c22'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:37 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:37 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:37 devstack sudo[101438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:47:37 devstack sudo[101438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:37 devstack sudo[101428]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d7e07783-7253-49ae-97c9-e70e03765702_3yh3jlwwdevstack@QuobyteHD" returned: 0 in 0.851s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d7e07783-7253-49ae-97c9-e70e03765702_3yh3jlwwdevstack@QuobyteHD {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:37 devstack sudo[101440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d7e07783-7253-49ae-97c9-e70e03765702_3yh3jlwwdevstack@QuobyteHD Jul 08 01:47:37 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:37 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8e55112-c687-492f-92c5-cff8594bcb8e" returned: 0 in 0.840s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8e55112-c687-492f-92c5-cff8594bcb8e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:37 devstack sudo[101444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8e55112-c687-492f-92c5-cff8594bcb8e Jul 08 01:47:37 devstack sudo[101444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:37 devstack sudo[101438]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.714s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:37 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:47:37 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Deleted volume successfully. Jul 08 01:47:37 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5f6a0e48-7b29-419f-bad1-4d4df982c058 tempest-VolumesDeleteCascade-526616262 None] Lock "cinder-a458e374-53eb-4f25-b055-5d671dd5d9c0-delete_volume" released by "delete_volume" :: held 14.201s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:37 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d7e07783-7253-49ae-97c9-e70e03765702_3yh3jlwwdevstack@QuobyteHD" returned: 1 in 0.804s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d7e07783-7253-49ae-97c9-e70e03765702_3yh3jlwwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:47:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:37 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58402857-62e9-41e3-af83-797bc21779f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77ca4f7be0834764833189f64723e7fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:34Z,use_quota=True,user_id='e5b71ce79e5643b09e4012665224c276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:47:37 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Creating volume 58402857-62e9-41e3-af83-797bc21779f4 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:47:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:37 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:37 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:37 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:47:37 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:47:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58402857-62e9-41e3-af83-797bc21779f4 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:38 devstack sudo[101450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58402857-62e9-41e3-af83-797bc21779f4 1073741824 Jul 08 01:47:38 devstack sudo[101450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:38 devstack sudo[101444]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8e55112-c687-492f-92c5-cff8594bcb8e" returned: 1 in 0.959s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8e55112-c687-492f-92c5-cff8594bcb8e' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:47:38 devstack cinder-volume[87284]: DEBUG cinder.volume.volume_utils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Downloaded image 708a0e2f-c2d8-47ce-bc00-7176135d748c ((None, [{'url': 'file:///opt/stack/data/glance/images/708a0e2f-c2d8-47ce-bc00-7176135d748c', 'metadata': {}}])) to volume a8e55112-c687-492f-92c5-cff8594bcb8e successfully. {{(pid=87284) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:47:38 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Temporary image 708a0e2f-c2d8-47ce-bc00-7176135d748c for user ca67da44b7a04df7a4694a9b9e5cfc06 is deleted. {{(pid=87284) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:47:38 devstack cinder-volume[87284]: DEBUG cinder.volume.volume_utils [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Marking volume a8e55112-c687-492f-92c5-cff8594bcb8e as bootable. {{(pid=87284) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:47:38 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Copying metadata from image 708a0e2f-c2d8-47ce-bc00-7176135d748c to a8e55112-c687-492f-92c5-cff8594bcb8e. {{(pid=87284) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:47:38 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Creating volume glance metadata for volume a8e55112-c687-492f-92c5-cff8594bcb8e backed by image 708a0e2f-c2d8-47ce-bc00-7176135d748c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '708a0e2f-c2d8-47ce-bc00-7176135d748c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '38f73916b2554de271e3aaea4719eb8c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87284) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:47:38 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaa9dc17-2f55-488c-ac9a-a6fd136577ba tempest-VolumesDeleteCascade-526616262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:47:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eaa9dc17-2f55-488c-ac9a-a6fd136577ba tempest-VolumesDeleteCascade-526616262 None] Flow 'volume_create_manager' (98f9f69a-84f4-4dd8-a0a9-9d649344319b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eaa9dc17-2f55-488c-ac9a-a6fd136577ba tempest-VolumesDeleteCascade-526616262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (341cb77c-d177-4af6-8011-aa5eaf200f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eaa9dc17-2f55-488c-ac9a-a6fd136577ba tempest-VolumesDeleteCascade-526616262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (341cb77c-d177-4af6-8011-aa5eaf200f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-317149933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7f9010e-f0ff-45f9-82ca-5447984ccc6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6995ed3e2f04dd68148c0f75f811baa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:39Z,use_quota=True,user_id='dfcbc3f82d6d4b47b3131da8027188be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eaa9dc17-2f55-488c-ac9a-a6fd136577ba tempest-VolumesDeleteCascade-526616262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ffd26b9-2c81-4edc-b180-6f4ecd55c1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eaa9dc17-2f55-488c-ac9a-a6fd136577ba tempest-VolumesDeleteCascade-526616262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ffd26b9-2c81-4edc-b180-6f4ecd55c1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eaa9dc17-2f55-488c-ac9a-a6fd136577ba tempest-VolumesDeleteCascade-526616262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f2cbc7b-794d-4bf7-891c-dbae0917b72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eaa9dc17-2f55-488c-ac9a-a6fd136577ba tempest-VolumesDeleteCascade-526616262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f2cbc7b-794d-4bf7-891c-dbae0917b72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7f9010e-f0ff-45f9-82ca-5447984ccc6f', 'volume_name': 'volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eaa9dc17-2f55-488c-ac9a-a6fd136577ba tempest-VolumesDeleteCascade-526616262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edfeb4cf-c490-411b-aa55-e75ba49f8236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eaa9dc17-2f55-488c-ac9a-a6fd136577ba tempest-VolumesDeleteCascade-526616262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edfeb4cf-c490-411b-aa55-e75ba49f8236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eaa9dc17-2f55-488c-ac9a-a6fd136577ba tempest-VolumesDeleteCascade-526616262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee59a41d-ba2e-4cb2-bca5-4afd29e11774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:38 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-eaa9dc17-2f55-488c-ac9a-a6fd136577ba tempest-VolumesDeleteCascade-526616262 None] Volume c7f9010e-f0ff-45f9-82ca-5447984ccc6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f', 'volume_size': 1} Jul 08 01:47:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-eaa9dc17-2f55-488c-ac9a-a6fd136577ba tempest-VolumesDeleteCascade-526616262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (586289c8-8386-4a1a-9727-5fd4f345784f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8e55112-c687-492f-92c5-cff8594bcb8e', 'volume_size': 1, 'image_id': '708a0e2f-c2d8-47ce-bc00-7176135d748c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/708a0e2f-c2d8-47ce-bc00-7176135d748c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '38f73916b2554de271e3aaea4719eb8c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b6d3793b4dcc42df83ad148c536fcb07', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '39edb9fbbfbcc201a83cdc3edd087bb2210639a9d8b16af60d93532463c3f2a36a40c27475883fbdf8d2328cbfed609833ab7152ba9dd1067b53127deb5e5093', 'id': '708a0e2f-c2d8-47ce-bc00-7176135d748c', 'created_at': datetime.datetime(2026, 7, 7, 23, 47, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 47, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/708a0e2f-c2d8-47ce-bc00-7176135d748c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f20ad13-7393-4c7d-b71e-c093fa01efcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:38 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Volume volume-a8e55112-c687-492f-92c5-cff8594bcb8e (a8e55112-c687-492f-92c5-cff8594bcb8e): created successfully Jul 08 01:47:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f20ad13-7393-4c7d-b71e-c093fa01efcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Flow 'volume_create_manager' (2bb9c01b-4bb2-45ff-8e4c-78a24041bd23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:38 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-724359d7-96f0-4dc5-96e2-3f7474bdb4e6 tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Created volume successfully. Jul 08 01:47:39 devstack sudo[101450]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58402857-62e9-41e3-af83-797bc21779f4 1073741824" returned: 0 in 1.034s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58402857-62e9-41e3-af83-797bc21779f4 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:39 devstack sudo[101459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58402857-62e9-41e3-af83-797bc21779f4 Jul 08 01:47:39 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:39 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b1d2e9de-0826-4b50-9901-fcb5110adc4f tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Acquiring lock "cinder-a8e55112-c687-492f-92c5-cff8594bcb8e-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:39 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b1d2e9de-0826-4b50-9901-fcb5110adc4f tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Lock "cinder-a8e55112-c687-492f-92c5-cff8594bcb8e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:39 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b1d2e9de-0826-4b50-9901-fcb5110adc4f tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Acquiring lock "cinder-quobyte-a8e55112-c687-492f-92c5-cff8594bcb8e" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:39 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b1d2e9de-0826-4b50-9901-fcb5110adc4f tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Lock "cinder-quobyte-a8e55112-c687-492f-92c5-cff8594bcb8e" acquired by "delete_volume" :: waited 0.019s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:39 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe867c3-c503-477c-bad3-9b0330aabde4]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b1d2e9de-0826-4b50-9901-fcb5110adc4f tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8e55112-c687-492f-92c5-cff8594bcb8e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:39 devstack sudo[101461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8e55112-c687-492f-92c5-cff8594bcb8e Jul 08 01:47:39 devstack sudo[101461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:39 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58402857-62e9-41e3-af83-797bc21779f4" returned: 0 in 0.692s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:39 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] <== create_volume: return (1780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:47:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-eaa9dc17-2f55-488c-ac9a-a6fd136577ba tempest-VolumesDeleteCascade-526616262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.034s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:39 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-eaa9dc17-2f55-488c-ac9a-a6fd136577ba tempest-VolumesDeleteCascade-526616262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-317149933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7f9010e-f0ff-45f9-82ca-5447984ccc6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6995ed3e2f04dd68148c0f75f811baa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:39Z,use_quota=True,user_id='dfcbc3f82d6d4b47b3131da8027188be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:47:39 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-eaa9dc17-2f55-488c-ac9a-a6fd136577ba tempest-VolumesDeleteCascade-526616262 None] Creating volume c7f9010e-f0ff-45f9-82ca-5447984ccc6f {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:47:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-eaa9dc17-2f55-488c-ac9a-a6fd136577ba tempest-VolumesDeleteCascade-526616262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-eaa9dc17-2f55-488c-ac9a-a6fd136577ba tempest-VolumesDeleteCascade-526616262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:39 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-eaa9dc17-2f55-488c-ac9a-a6fd136577ba tempest-VolumesDeleteCascade-526616262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:39 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-eaa9dc17-2f55-488c-ac9a-a6fd136577ba tempest-VolumesDeleteCascade-526616262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-eaa9dc17-2f55-488c-ac9a-a6fd136577ba tempest-VolumesDeleteCascade-526616262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:39 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-eaa9dc17-2f55-488c-ac9a-a6fd136577ba tempest-VolumesDeleteCascade-526616262 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:47:39 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-eaa9dc17-2f55-488c-ac9a-a6fd136577ba tempest-VolumesDeleteCascade-526616262 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:47:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-eaa9dc17-2f55-488c-ac9a-a6fd136577ba tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:39 devstack sudo[101464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f 1073741824 Jul 08 01:47:39 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:39 devstack cinder-volume[87284]: DEBUG cinder.volume.volume_utils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Attempting download of d7e07783-7253-49ae-97c9-e70e03765702 ((None, [{'url': 'file:///opt/stack/data/glance/images/d7e07783-7253-49ae-97c9-e70e03765702', 'metadata': {}}])) to volume 58402857-62e9-41e3-af83-797bc21779f4. {{(pid=87284) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:47:39 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe21575a-3707-4cac-b2da-f3437932ec4c]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d7e07783-7253-49ae-97c9-e70e03765702_ya_0ikxg {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:39 devstack sudo[101466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d7e07783-7253-49ae-97c9-e70e03765702_ya_0ikxg Jul 08 01:47:39 devstack sudo[101466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:40 devstack sudo[101461]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b1d2e9de-0826-4b50-9901-fcb5110adc4f tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8e55112-c687-492f-92c5-cff8594bcb8e" returned: 0 in 0.860s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b1d2e9de-0826-4b50-9901-fcb5110adc4f tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8e55112-c687-492f-92c5-cff8594bcb8e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:40 devstack sudo[101470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8e55112-c687-492f-92c5-cff8594bcb8e Jul 08 01:47:40 devstack sudo[101470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:40 devstack sudo[101466]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d7e07783-7253-49ae-97c9-e70e03765702_ya_0ikxg" returned: 0 in 0.775s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d7e07783-7253-49ae-97c9-e70e03765702_ya_0ikxg {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:40 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-eaa9dc17-2f55-488c-ac9a-a6fd136577ba tempest-VolumesDeleteCascade-526616262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f 1073741824" returned: 0 in 0.960s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:40 devstack sudo[101478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d7e07783-7253-49ae-97c9-e70e03765702_ya_0ikxg Jul 08 01:47:40 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-eaa9dc17-2f55-488c-ac9a-a6fd136577ba tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:40 devstack sudo[101480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f Jul 08 01:47:40 devstack sudo[101480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:41 devstack sudo[101470]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b1d2e9de-0826-4b50-9901-fcb5110adc4f tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8e55112-c687-492f-92c5-cff8594bcb8e" returned: 1 in 0.875s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b1d2e9de-0826-4b50-9901-fcb5110adc4f tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8e55112-c687-492f-92c5-cff8594bcb8e' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:47:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b1d2e9de-0826-4b50-9901-fcb5110adc4f tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8e55112-c687-492f-92c5-cff8594bcb8e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:41 devstack sudo[101485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8e55112-c687-492f-92c5-cff8594bcb8e Jul 08 01:47:41 devstack sudo[101485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:41 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d7e07783-7253-49ae-97c9-e70e03765702_ya_0ikxg" returned: 1 in 0.821s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d7e07783-7253-49ae-97c9-e70e03765702_ya_0ikxg' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:47:41 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efd7065-75c4-49b2-9e5b-199225b062e8]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d7e07783-7253-49ae-97c9-e70e03765702_3yh3jlwwdevstack@QuobyteHD {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:41 devstack sudo[101480]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-eaa9dc17-2f55-488c-ac9a-a6fd136577ba tempest-VolumesDeleteCascade-526616262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f" returned: 0 in 0.736s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:41 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-eaa9dc17-2f55-488c-ac9a-a6fd136577ba tempest-VolumesDeleteCascade-526616262 None] <== create_volume: return (1748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:47:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-eaa9dc17-2f55-488c-ac9a-a6fd136577ba tempest-VolumesDeleteCascade-526616262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:41 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eaa9dc17-2f55-488c-ac9a-a6fd136577ba tempest-VolumesDeleteCascade-526616262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee59a41d-ba2e-4cb2-bca5-4afd29e11774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:41 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eaa9dc17-2f55-488c-ac9a-a6fd136577ba tempest-VolumesDeleteCascade-526616262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b245cc9-b3dd-4ce6-a70d-c2bed6c10fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:41 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-eaa9dc17-2f55-488c-ac9a-a6fd136577ba tempest-VolumesDeleteCascade-526616262 None] Volume volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f (c7f9010e-f0ff-45f9-82ca-5447984ccc6f): created successfully Jul 08 01:47:41 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eaa9dc17-2f55-488c-ac9a-a6fd136577ba tempest-VolumesDeleteCascade-526616262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b245cc9-b3dd-4ce6-a70d-c2bed6c10fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:41 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eaa9dc17-2f55-488c-ac9a-a6fd136577ba tempest-VolumesDeleteCascade-526616262 None] Flow 'volume_create_manager' (98f9f69a-84f4-4dd8-a0a9-9d649344319b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:41 devstack sudo[101492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d7e07783-7253-49ae-97c9-e70e03765702_3yh3jlwwdevstack@QuobyteHD Jul 08 01:47:41 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:41 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-eaa9dc17-2f55-488c-ac9a-a6fd136577ba tempest-VolumesDeleteCascade-526616262 None] Created volume successfully. Jul 08 01:47:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4a403627-c001-458e-8d28-3b1ed4c07104 tempest-VolumesDeleteCascade-526616262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4a403627-c001-458e-8d28-3b1ed4c07104 tempest-VolumesDeleteCascade-526616262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:41 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-4a403627-c001-458e-8d28-3b1ed4c07104 tempest-VolumesDeleteCascade-526616262 None] Creating offline snapshot 7a82cda4-b490-4449-ba29-d66879260c60 of volume c7f9010e-f0ff-45f9-82ca-5447984ccc6f {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:47:41 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[80207d56-eb37-445f-90fc-9be08f876482]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4a403627-c001-458e-8d28-3b1ed4c07104 tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:41 devstack sudo[101485]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b1d2e9de-0826-4b50-9901-fcb5110adc4f tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8e55112-c687-492f-92c5-cff8594bcb8e" returned: 0 in 0.779s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:42 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b1d2e9de-0826-4b50-9901-fcb5110adc4f tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Lock "cinder-quobyte-a8e55112-c687-492f-92c5-cff8594bcb8e" released by "delete_volume" :: held 2.581s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:42 devstack cinder-volume[87284]: WARNING cinder.quota [None req-b1d2e9de-0826-4b50-9901-fcb5110adc4f tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:47:42 devstack cinder-volume[87284]: WARNING cinder.quota [None req-b1d2e9de-0826-4b50-9901-fcb5110adc4f tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:47:42 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-b1d2e9de-0826-4b50-9901-fcb5110adc4f tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Created reservations ['58f94c22-9f91-4d12-9c27-680c634fc3b4', '79cfbfbd-1c48-47ac-81c6-44ef18a35cda', 'c23c8356-e8c4-43fc-be13-483bd94a32ef', 'e2c0d13f-cea4-4423-be19-4915dc5785d7'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:42 devstack sudo[101495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f Jul 08 01:47:42 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b1d2e9de-0826-4b50-9901-fcb5110adc4f tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b1d2e9de-0826-4b50-9901-fcb5110adc4f tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:42 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b1d2e9de-0826-4b50-9901-fcb5110adc4f tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:42 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b1d2e9de-0826-4b50-9901-fcb5110adc4f tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b1d2e9de-0826-4b50-9901-fcb5110adc4f tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b1d2e9de-0826-4b50-9901-fcb5110adc4f tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:42 devstack sudo[101497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:47:42 devstack sudo[101497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:42 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d7e07783-7253-49ae-97c9-e70e03765702_3yh3jlwwdevstack@QuobyteHD" returned: 0 in 0.832s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d7e07783-7253-49ae-97c9-e70e03765702_3yh3jlwwdevstack@QuobyteHD {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:42 devstack sudo[101501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d7e07783-7253-49ae-97c9-e70e03765702_3yh3jlwwdevstack@QuobyteHD Jul 08 01:47:42 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:42 devstack sudo[101497]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b1d2e9de-0826-4b50-9901-fcb5110adc4f tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.728s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:42 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-b1d2e9de-0826-4b50-9901-fcb5110adc4f tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:47:42 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-b1d2e9de-0826-4b50-9901-fcb5110adc4f tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Deleted volume successfully. Jul 08 01:47:42 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4a403627-c001-458e-8d28-3b1ed4c07104 tempest-VolumesDeleteCascade-526616262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f" returned: 0 in 0.941s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4a403627-c001-458e-8d28-3b1ed4c07104 tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f.7a82cda4-b490-4449-ba29-d66879260c60 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:42 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b1d2e9de-0826-4b50-9901-fcb5110adc4f tempest-VolumeAndVolumeTypeFromImageTest-1404825529 None] Lock "cinder-a8e55112-c687-492f-92c5-cff8594bcb8e-delete_volume" released by "delete_volume" :: held 3.585s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:42 devstack sudo[101508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f.7a82cda4-b490-4449-ba29-d66879260c60 1G Jul 08 01:47:42 devstack sudo[101508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:43 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d7e07783-7253-49ae-97c9-e70e03765702_3yh3jlwwdevstack@QuobyteHD" returned: 1 in 0.835s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d7e07783-7253-49ae-97c9-e70e03765702_3yh3jlwwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:47:43 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] d7e07783-7253-49ae-97c9-e70e03765702 was raw, converting to raw {{(pid=87284) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:47:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d7e07783-7253-49ae-97c9-e70e03765702_3yh3jlwwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58402857-62e9-41e3-af83-797bc21779f4 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:43 devstack sudo[101513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d7e07783-7253-49ae-97c9-e70e03765702_3yh3jlwwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58402857-62e9-41e3-af83-797bc21779f4 Jul 08 01:47:43 devstack sudo[101513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:43 devstack sudo[101508]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4a403627-c001-458e-8d28-3b1ed4c07104 tempest-VolumesDeleteCascade-526616262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f.7a82cda4-b490-4449-ba29-d66879260c60 1G" returned: 0 in 0.992s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4a403627-c001-458e-8d28-3b1ed4c07104 tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f.7a82cda4-b490-4449-ba29-d66879260c60 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:43 devstack sudo[101522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f.7a82cda4-b490-4449-ba29-d66879260c60 Jul 08 01:47:43 devstack sudo[101522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:43 devstack sudo[101513]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d7e07783-7253-49ae-97c9-e70e03765702_3yh3jlwwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58402857-62e9-41e3-af83-797bc21779f4" returned: 0 in 0.855s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:43 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d7e07783-7253-49ae-97c9-e70e03765702_3yh3jlwwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58402857-62e9-41e3-af83-797bc21779f4 {{(pid=87284) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:47:43 devstack cinder-volume[87284]: INFO cinder.image.image_utils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 01:47:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58402857-62e9-41e3-af83-797bc21779f4 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:44 devstack sudo[101524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58402857-62e9-41e3-af83-797bc21779f4 1G Jul 08 01:47:44 devstack sudo[101524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:44 devstack sudo[101522]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4a403627-c001-458e-8d28-3b1ed4c07104 tempest-VolumesDeleteCascade-526616262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f.7a82cda4-b490-4449-ba29-d66879260c60" returned: 0 in 0.839s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:44 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-4a403627-c001-458e-8d28-3b1ed4c07104 tempest-VolumesDeleteCascade-526616262 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f.7a82cda4-b490-4449-ba29-d66879260c60 is being set with open permissions: ugo+rw Jul 08 01:47:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4a403627-c001-458e-8d28-3b1ed4c07104 tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f.7a82cda4-b490-4449-ba29-d66879260c60 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:44 devstack sudo[101533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f.7a82cda4-b490-4449-ba29-d66879260c60 Jul 08 01:47:44 devstack sudo[101533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:44 devstack sudo[101524]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58402857-62e9-41e3-af83-797bc21779f4 1G" returned: 0 in 0.911s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:44 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efaf307-0582-4b0e-8fa5-af4389f84990]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58402857-62e9-41e3-af83-797bc21779f4 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:45 devstack sudo[101536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58402857-62e9-41e3-af83-797bc21779f4 Jul 08 01:47:45 devstack sudo[101536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:45 devstack sudo[101533]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4a403627-c001-458e-8d28-3b1ed4c07104 tempest-VolumesDeleteCascade-526616262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f.7a82cda4-b490-4449-ba29-d66879260c60" returned: 0 in 0.798s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4a403627-c001-458e-8d28-3b1ed4c07104 tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:45 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f.info Jul 08 01:47:45 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:45 devstack sudo[101536]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58402857-62e9-41e3-af83-797bc21779f4" returned: 0 in 0.977s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58402857-62e9-41e3-af83-797bc21779f4 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:46 devstack sudo[101544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58402857-62e9-41e3-af83-797bc21779f4 Jul 08 01:47:46 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:46 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4a403627-c001-458e-8d28-3b1ed4c07104 tempest-VolumesDeleteCascade-526616262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f.info" returned: 0 in 0.822s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:46 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-4a403627-c001-458e-8d28-3b1ed4c07104 tempest-VolumesDeleteCascade-526616262 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f.info is being set with open permissions: ugo+rw Jul 08 01:47:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4a403627-c001-458e-8d28-3b1ed4c07104 tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:46 devstack sudo[101547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f.info Jul 08 01:47:46 devstack sudo[101547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:46 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58402857-62e9-41e3-af83-797bc21779f4" returned: 1 in 0.867s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58402857-62e9-41e3-af83-797bc21779f4' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:47:46 devstack cinder-volume[87284]: DEBUG cinder.volume.volume_utils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Downloaded image d7e07783-7253-49ae-97c9-e70e03765702 ((None, [{'url': 'file:///opt/stack/data/glance/images/d7e07783-7253-49ae-97c9-e70e03765702', 'metadata': {}}])) to volume 58402857-62e9-41e3-af83-797bc21779f4 successfully. {{(pid=87284) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:47:46 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Temporary image d7e07783-7253-49ae-97c9-e70e03765702 for user e5b71ce79e5643b09e4012665224c276 is deleted. {{(pid=87284) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:47:46 devstack cinder-volume[87284]: DEBUG cinder.volume.volume_utils [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Marking volume 58402857-62e9-41e3-af83-797bc21779f4 as bootable. {{(pid=87284) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:47:46 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Copying metadata from image d7e07783-7253-49ae-97c9-e70e03765702 to 58402857-62e9-41e3-af83-797bc21779f4. {{(pid=87284) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:47:46 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Creating volume glance metadata for volume 58402857-62e9-41e3-af83-797bc21779f4 backed by image d7e07783-7253-49ae-97c9-e70e03765702 with: {'image_id': 'd7e07783-7253-49ae-97c9-e70e03765702', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '1c55a89b8c91e1ff2eac7b650846a805', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87284) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:47:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b0cee31-9510-4432-a21d-a161595907c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58402857-62e9-41e3-af83-797bc21779f4', 'volume_size': 1, 'image_id': 'd7e07783-7253-49ae-97c9-e70e03765702', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d7e07783-7253-49ae-97c9-e70e03765702', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1c55a89b8c91e1ff2eac7b650846a805', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '77ca4f7be0834764833189f64723e7fe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'eb345b5bf6db19f0425f5ee722907f108a552bd3c7cdb6eca38063c9f3f291c37ab0f15ac853fd9c19f4ded40c9ba9fcebaee6884c9db15a3d6d1a8c715fab0f', 'id': 'd7e07783-7253-49ae-97c9-e70e03765702', 'created_at': datetime.datetime(2026, 7, 7, 23, 47, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 47, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d7e07783-7253-49ae-97c9-e70e03765702/file', 'properties': {}}, 'image_service': }' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a24992f-f8e6-41b3-b815-50967a6dbe46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:46 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Volume volume-58402857-62e9-41e3-af83-797bc21779f4 (58402857-62e9-41e3-af83-797bc21779f4): created successfully Jul 08 01:47:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a24992f-f8e6-41b3-b815-50967a6dbe46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Flow 'volume_create_manager' (a1dbf735-9f62-4d22-a1d7-ebf30a6484d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:46 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-934220d0-19c9-4a2d-9d89-c09e54d320f1 tempest-VolumeImageDependencyTests-697855112 None] Created volume successfully. Jul 08 01:47:47 devstack sudo[101547]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4a403627-c001-458e-8d28-3b1ed4c07104 tempest-VolumesDeleteCascade-526616262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f.info" returned: 0 in 0.720s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4a403627-c001-458e-8d28-3b1ed4c07104 tempest-VolumesDeleteCascade-526616262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.230s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:47 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-4a403627-c001-458e-8d28-3b1ed4c07104 tempest-VolumesDeleteCascade-526616262 None] Create snapshot completed successfully Jul 08 01:47:47 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-a12feea8-6bb5-43f0-8af3-386280dae256 tempest-VolumeImageDependencyTests-697855112 None] Acquiring lock "cinder-58402857-62e9-41e3-af83-797bc21779f4-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:48 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-a12feea8-6bb5-43f0-8af3-386280dae256 tempest-VolumeImageDependencyTests-697855112 None] Lock "cinder-58402857-62e9-41e3-af83-797bc21779f4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:48 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-af1f3da0-8514-4c71-8082-1f35338b92dd tempest-CreateVolumesFromImageTest-260207281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:47:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-af1f3da0-8514-4c71-8082-1f35338b92dd tempest-CreateVolumesFromImageTest-260207281 None] Flow 'volume_create_manager' (e2b43731-fc6d-45c9-b5e6-b4f15396ec03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-af1f3da0-8514-4c71-8082-1f35338b92dd tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4caf6097-86e6-495b-b468-14d7f59ad5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-af1f3da0-8514-4c71-8082-1f35338b92dd tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4caf6097-86e6-495b-b468-14d7f59ad5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-16582467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d24072bb-269a-48ec-94f1-c32ec780147f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8780575ccc9a477a940927cc0972bc1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:48Z,use_quota=True,user_id='7ba233b639df431282645d9f361e037a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-af1f3da0-8514-4c71-8082-1f35338b92dd tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ac747e-7cdd-47b6-82dd-c674634d229a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-af1f3da0-8514-4c71-8082-1f35338b92dd tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ac747e-7cdd-47b6-82dd-c674634d229a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-af1f3da0-8514-4c71-8082-1f35338b92dd tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23f5f1a1-06c1-4e8f-8885-c465fdbda07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-af1f3da0-8514-4c71-8082-1f35338b92dd tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23f5f1a1-06c1-4e8f-8885-c465fdbda07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd24072bb-269a-48ec-94f1-c32ec780147f', 'volume_name': 'volume-d24072bb-269a-48ec-94f1-c32ec780147f', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-af1f3da0-8514-4c71-8082-1f35338b92dd tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23a5dbe8-2a55-4f6c-aad5-16aeea696f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-af1f3da0-8514-4c71-8082-1f35338b92dd tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23a5dbe8-2a55-4f6c-aad5-16aeea696f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-af1f3da0-8514-4c71-8082-1f35338b92dd tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cc18f36-563e-4aae-bb65-8b89ee560fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:48 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-af1f3da0-8514-4c71-8082-1f35338b92dd tempest-CreateVolumesFromImageTest-260207281 None] Volume d24072bb-269a-48ec-94f1-c32ec780147f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d24072bb-269a-48ec-94f1-c32ec780147f', 'volume_size': 1} Jul 08 01:47:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-af1f3da0-8514-4c71-8082-1f35338b92dd tempest-CreateVolumesFromImageTest-260207281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-af1f3da0-8514-4c71-8082-1f35338b92dd tempest-CreateVolumesFromImageTest-260207281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:48 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-af1f3da0-8514-4c71-8082-1f35338b92dd tempest-CreateVolumesFromImageTest-260207281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-16582467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d24072bb-269a-48ec-94f1-c32ec780147f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8780575ccc9a477a940927cc0972bc1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:48Z,use_quota=True,user_id='7ba233b639df431282645d9f361e037a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:47:48 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-af1f3da0-8514-4c71-8082-1f35338b92dd tempest-CreateVolumesFromImageTest-260207281 None] Creating volume d24072bb-269a-48ec-94f1-c32ec780147f {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:47:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-af1f3da0-8514-4c71-8082-1f35338b92dd tempest-CreateVolumesFromImageTest-260207281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-af1f3da0-8514-4c71-8082-1f35338b92dd tempest-CreateVolumesFromImageTest-260207281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:48 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-af1f3da0-8514-4c71-8082-1f35338b92dd tempest-CreateVolumesFromImageTest-260207281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:48 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-af1f3da0-8514-4c71-8082-1f35338b92dd tempest-CreateVolumesFromImageTest-260207281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-af1f3da0-8514-4c71-8082-1f35338b92dd tempest-CreateVolumesFromImageTest-260207281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:48 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-af1f3da0-8514-4c71-8082-1f35338b92dd tempest-CreateVolumesFromImageTest-260207281 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:47:48 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-af1f3da0-8514-4c71-8082-1f35338b92dd tempest-CreateVolumesFromImageTest-260207281 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:47:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-af1f3da0-8514-4c71-8082-1f35338b92dd tempest-CreateVolumesFromImageTest-260207281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d24072bb-269a-48ec-94f1-c32ec780147f 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:48 devstack sudo[101553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d24072bb-269a-48ec-94f1-c32ec780147f 1073741824 Jul 08 01:47:48 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:48 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-a12feea8-6bb5-43f0-8af3-386280dae256 tempest-VolumeImageDependencyTests-697855112 None] Acquiring lock "cinder-quobyte-58402857-62e9-41e3-af83-797bc21779f4" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:48 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-a12feea8-6bb5-43f0-8af3-386280dae256 tempest-VolumeImageDependencyTests-697855112 None] Lock "cinder-quobyte-58402857-62e9-41e3-af83-797bc21779f4" acquired by "delete_volume" :: waited 0.017s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:48 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d141e3-10f6-4b37-ae9f-b5c421ff3271]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a12feea8-6bb5-43f0-8af3-386280dae256 tempest-VolumeImageDependencyTests-697855112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58402857-62e9-41e3-af83-797bc21779f4 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:48 devstack sudo[101555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58402857-62e9-41e3-af83-797bc21779f4 Jul 08 01:47:48 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:48 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:UPDATE=155,cinder:SELECT=135,cinder:INSERT=47,cinder:DELETE=13 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:47:48 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:INSERT=59,cinder:SELECT=127,cinder:UPDATE=153,cinder:DELETE=13 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:47:48 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-5805f043-b453-4ff2-80d1-9309f9be1f38 tempest-CreateVolumesFromImageTest-260207281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:47:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5805f043-b453-4ff2-80d1-9309f9be1f38 tempest-CreateVolumesFromImageTest-260207281 None] Flow 'volume_create_manager' (17fc92ce-510a-4560-bd77-7edcda41dc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5805f043-b453-4ff2-80d1-9309f9be1f38 tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0722e7b0-69c8-40be-a964-9cb1b8aad13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5805f043-b453-4ff2-80d1-9309f9be1f38 tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0722e7b0-69c8-40be-a964-9cb1b8aad13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-290382370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff80eff0-4673-48d3-80cc-f0761341ad12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8780575ccc9a477a940927cc0972bc1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:49Z,use_quota=True,user_id='7ba233b639df431282645d9f361e037a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5805f043-b453-4ff2-80d1-9309f9be1f38 tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9d091e1-5fb4-406a-9113-359f6ebd4fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5805f043-b453-4ff2-80d1-9309f9be1f38 tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9d091e1-5fb4-406a-9113-359f6ebd4fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5805f043-b453-4ff2-80d1-9309f9be1f38 tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04128814-0033-41c7-8670-3319fce1d319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5805f043-b453-4ff2-80d1-9309f9be1f38 tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04128814-0033-41c7-8670-3319fce1d319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff80eff0-4673-48d3-80cc-f0761341ad12', 'volume_name': 'volume-ff80eff0-4673-48d3-80cc-f0761341ad12', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5805f043-b453-4ff2-80d1-9309f9be1f38 tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25305b8c-f6ee-455b-9489-f6299cd2717c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5805f043-b453-4ff2-80d1-9309f9be1f38 tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25305b8c-f6ee-455b-9489-f6299cd2717c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5805f043-b453-4ff2-80d1-9309f9be1f38 tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08c1707a-7203-45dc-bcd9-1f1da68424d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:48 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-5805f043-b453-4ff2-80d1-9309f9be1f38 tempest-CreateVolumesFromImageTest-260207281 None] Volume ff80eff0-4673-48d3-80cc-f0761341ad12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff80eff0-4673-48d3-80cc-f0761341ad12', 'volume_size': 1} Jul 08 01:47:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5805f043-b453-4ff2-80d1-9309f9be1f38 tempest-CreateVolumesFromImageTest-260207281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:49 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-e88fc4bb-497b-4ad3-926b-f497d59b165a tempest-CreateVolumesFromImageTest-260207281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:47:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e88fc4bb-497b-4ad3-926b-f497d59b165a tempest-CreateVolumesFromImageTest-260207281 None] Flow 'volume_create_manager' (775eb181-d985-42d6-ac86-824369042618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e88fc4bb-497b-4ad3-926b-f497d59b165a tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77c74799-dfd0-42db-b014-ff8b0db6c865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e88fc4bb-497b-4ad3-926b-f497d59b165a tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77c74799-dfd0-42db-b014-ff8b0db6c865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2112931887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2109504a-f1e9-443a-8a58-9afc8c0a3af4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8780575ccc9a477a940927cc0972bc1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:49Z,use_quota=True,user_id='7ba233b639df431282645d9f361e037a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e88fc4bb-497b-4ad3-926b-f497d59b165a tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c002691-71c8-457d-9527-146b77caa217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e88fc4bb-497b-4ad3-926b-f497d59b165a tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c002691-71c8-457d-9527-146b77caa217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e88fc4bb-497b-4ad3-926b-f497d59b165a tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8e46c24-0d96-41af-94ee-bbb25e26b63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e88fc4bb-497b-4ad3-926b-f497d59b165a tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8e46c24-0d96-41af-94ee-bbb25e26b63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2109504a-f1e9-443a-8a58-9afc8c0a3af4', 'volume_name': 'volume-2109504a-f1e9-443a-8a58-9afc8c0a3af4', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e88fc4bb-497b-4ad3-926b-f497d59b165a tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f92fec-1bc2-4f25-be65-48998bae7f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e88fc4bb-497b-4ad3-926b-f497d59b165a tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f92fec-1bc2-4f25-be65-48998bae7f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e88fc4bb-497b-4ad3-926b-f497d59b165a tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6cdde27-3aa9-4cc3-92e5-4b4ec81abf61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:49 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-e88fc4bb-497b-4ad3-926b-f497d59b165a tempest-CreateVolumesFromImageTest-260207281 None] Volume 2109504a-f1e9-443a-8a58-9afc8c0a3af4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2109504a-f1e9-443a-8a58-9afc8c0a3af4', 'volume_size': 1} Jul 08 01:47:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e88fc4bb-497b-4ad3-926b-f497d59b165a tempest-CreateVolumesFromImageTest-260207281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:49 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-af1f3da0-8514-4c71-8082-1f35338b92dd tempest-CreateVolumesFromImageTest-260207281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d24072bb-269a-48ec-94f1-c32ec780147f 1073741824" returned: 0 in 1.229s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:49 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:47:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-af1f3da0-8514-4c71-8082-1f35338b92dd tempest-CreateVolumesFromImageTest-260207281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d24072bb-269a-48ec-94f1-c32ec780147f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Flow 'volume_create_manager' (7e6be3b4-e070-4efd-a4ff-4ae3a9c70617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e60bf2-8187-4636-95bd-9deb59519274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:49 devstack sudo[101562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d24072bb-269a-48ec-94f1-c32ec780147f Jul 08 01:47:49 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:49 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a12feea8-6bb5-43f0-8af3-386280dae256 tempest-VolumeImageDependencyTests-697855112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58402857-62e9-41e3-af83-797bc21779f4" returned: 0 in 1.271s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a12feea8-6bb5-43f0-8af3-386280dae256 tempest-VolumeImageDependencyTests-697855112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58402857-62e9-41e3-af83-797bc21779f4 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e60bf2-8187-4636-95bd-9deb59519274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1705809596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d5db308-fdc1-46e6-a361-b6706d445f99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6995ed3e2f04dd68148c0f75f811baa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7a82cda4-b490-4449-ba29-d66879260c60,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:49Z,use_quota=True,user_id='dfcbc3f82d6d4b47b3131da8027188be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5872fb4-0fa5-4c34-a06e-3c46adf68154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5872fb4-0fa5-4c34-a06e-3c46adf68154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b789f625-d166-407c-9b78-ae9344f10735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b789f625-d166-407c-9b78-ae9344f10735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1d5db308-fdc1-46e6-a361-b6706d445f99', 'volume_name': 'volume-1d5db308-fdc1-46e6-a361-b6706d445f99', 'volume_size': 1, 'snapshot_id': '7a82cda4-b490-4449-ba29-d66879260c60'}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb8f9af-402a-4a9b-a42b-679e0bd51156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb8f9af-402a-4a9b-a42b-679e0bd51156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af15e47d-e4ec-4dad-8800-dec847a87f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:49 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Volume 1d5db308-fdc1-46e6-a361-b6706d445f99: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1d5db308-fdc1-46e6-a361-b6706d445f99', 'volume_size': 1, 'snapshot_id': '7a82cda4-b490-4449-ba29-d66879260c60'} Jul 08 01:47:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:49 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ccc1af0-0738-4abd-8024-07e16cc1b440 tempest-CreateVolumesFromImageTest-260207281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:47:49 devstack sudo[101564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58402857-62e9-41e3-af83-797bc21779f4 Jul 08 01:47:49 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5ccc1af0-0738-4abd-8024-07e16cc1b440 tempest-CreateVolumesFromImageTest-260207281 None] Flow 'volume_create_manager' (b2d31c82-75d3-4964-8d2f-d7f050b1a366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5ccc1af0-0738-4abd-8024-07e16cc1b440 tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce11a73a-2435-41ed-9d42-4a50fd476173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5ccc1af0-0738-4abd-8024-07e16cc1b440 tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce11a73a-2435-41ed-9d42-4a50fd476173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1427635112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e63c7387-19ce-4f4c-93c7-b14de06a3035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8780575ccc9a477a940927cc0972bc1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:50Z,use_quota=True,user_id='7ba233b639df431282645d9f361e037a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5ccc1af0-0738-4abd-8024-07e16cc1b440 tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2de3ec21-e492-4b24-8e81-46186a4c9d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5ccc1af0-0738-4abd-8024-07e16cc1b440 tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2de3ec21-e492-4b24-8e81-46186a4c9d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5ccc1af0-0738-4abd-8024-07e16cc1b440 tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84f7916c-3e84-4272-b72e-2b9debb3ffe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5ccc1af0-0738-4abd-8024-07e16cc1b440 tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84f7916c-3e84-4272-b72e-2b9debb3ffe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e63c7387-19ce-4f4c-93c7-b14de06a3035', 'volume_name': 'volume-e63c7387-19ce-4f4c-93c7-b14de06a3035', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5ccc1af0-0738-4abd-8024-07e16cc1b440 tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7717fabc-e2a3-40d4-aa7b-d1679f10a204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5ccc1af0-0738-4abd-8024-07e16cc1b440 tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7717fabc-e2a3-40d4-aa7b-d1679f10a204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5ccc1af0-0738-4abd-8024-07e16cc1b440 tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cdbb924-00ab-4340-bbe8-3667f8290a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:49 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-5ccc1af0-0738-4abd-8024-07e16cc1b440 tempest-CreateVolumesFromImageTest-260207281 None] Volume e63c7387-19ce-4f4c-93c7-b14de06a3035: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e63c7387-19ce-4f4c-93c7-b14de06a3035', 'volume_size': 1} Jul 08 01:47:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5ccc1af0-0738-4abd-8024-07e16cc1b440 tempest-CreateVolumesFromImageTest-260207281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:50 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa102904-3035-4806-b096-3b4ec11b668b tempest-CreateVolumesFromImageTest-260207281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:47:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fa102904-3035-4806-b096-3b4ec11b668b tempest-CreateVolumesFromImageTest-260207281 None] Flow 'volume_create_manager' (6f8cbea8-7c94-4a8f-9544-6a4606a865e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fa102904-3035-4806-b096-3b4ec11b668b tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efb67de0-1184-42a6-8df5-61a80a1e95d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fa102904-3035-4806-b096-3b4ec11b668b tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efb67de0-1184-42a6-8df5-61a80a1e95d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1373449816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bb70a9f-efd9-420c-b6c0-0e7efd8d690a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8780575ccc9a477a940927cc0972bc1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:50Z,use_quota=True,user_id='7ba233b639df431282645d9f361e037a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fa102904-3035-4806-b096-3b4ec11b668b tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (913696fa-066b-4fce-9da0-b4791e7966eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fa102904-3035-4806-b096-3b4ec11b668b tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (913696fa-066b-4fce-9da0-b4791e7966eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fa102904-3035-4806-b096-3b4ec11b668b tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5149b65d-5fe3-4d01-b6f0-dcc0d00b12f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fa102904-3035-4806-b096-3b4ec11b668b tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5149b65d-5fe3-4d01-b6f0-dcc0d00b12f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bb70a9f-efd9-420c-b6c0-0e7efd8d690a', 'volume_name': 'volume-1bb70a9f-efd9-420c-b6c0-0e7efd8d690a', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fa102904-3035-4806-b096-3b4ec11b668b tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff99952-5bf6-4595-b48d-2b2031b7082c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fa102904-3035-4806-b096-3b4ec11b668b tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff99952-5bf6-4595-b48d-2b2031b7082c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fa102904-3035-4806-b096-3b4ec11b668b tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cae689a7-0a57-4500-9bf5-4aa387ad24da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:50 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-fa102904-3035-4806-b096-3b4ec11b668b tempest-CreateVolumesFromImageTest-260207281 None] Volume 1bb70a9f-efd9-420c-b6c0-0e7efd8d690a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bb70a9f-efd9-420c-b6c0-0e7efd8d690a', 'volume_size': 1} Jul 08 01:47:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-fa102904-3035-4806-b096-3b4ec11b668b tempest-CreateVolumesFromImageTest-260207281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:50 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-af1f3da0-8514-4c71-8082-1f35338b92dd tempest-CreateVolumesFromImageTest-260207281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d24072bb-269a-48ec-94f1-c32ec780147f" returned: 0 in 0.818s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-af1f3da0-8514-4c71-8082-1f35338b92dd tempest-CreateVolumesFromImageTest-260207281 None] <== create_volume: return (2143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:47:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-af1f3da0-8514-4c71-8082-1f35338b92dd tempest-CreateVolumesFromImageTest-260207281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.146s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5805f043-b453-4ff2-80d1-9309f9be1f38 tempest-CreateVolumesFromImageTest-260207281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.320s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5805f043-b453-4ff2-80d1-9309f9be1f38 tempest-CreateVolumesFromImageTest-260207281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-290382370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff80eff0-4673-48d3-80cc-f0761341ad12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8780575ccc9a477a940927cc0972bc1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:49Z,use_quota=True,user_id='7ba233b639df431282645d9f361e037a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:47:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-5805f043-b453-4ff2-80d1-9309f9be1f38 tempest-CreateVolumesFromImageTest-260207281 None] Creating volume ff80eff0-4673-48d3-80cc-f0761341ad12 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:47:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5805f043-b453-4ff2-80d1-9309f9be1f38 tempest-CreateVolumesFromImageTest-260207281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5805f043-b453-4ff2-80d1-9309f9be1f38 tempest-CreateVolumesFromImageTest-260207281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5805f043-b453-4ff2-80d1-9309f9be1f38 tempest-CreateVolumesFromImageTest-260207281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5805f043-b453-4ff2-80d1-9309f9be1f38 tempest-CreateVolumesFromImageTest-260207281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5805f043-b453-4ff2-80d1-9309f9be1f38 tempest-CreateVolumesFromImageTest-260207281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5805f043-b453-4ff2-80d1-9309f9be1f38 tempest-CreateVolumesFromImageTest-260207281 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:47:50 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-5805f043-b453-4ff2-80d1-9309f9be1f38 tempest-CreateVolumesFromImageTest-260207281 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:47:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5805f043-b453-4ff2-80d1-9309f9be1f38 tempest-CreateVolumesFromImageTest-260207281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ff80eff0-4673-48d3-80cc-f0761341ad12 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-af1f3da0-8514-4c71-8082-1f35338b92dd tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cc18f36-563e-4aae-bb65-8b89ee560fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d24072bb-269a-48ec-94f1-c32ec780147f', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:50 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ff80eff0-4673-48d3-80cc-f0761341ad12 1073741824 Jul 08 01:47:50 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-af1f3da0-8514-4c71-8082-1f35338b92dd tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (664585ed-c12a-41cb-a4a5-898bd3683840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:50 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-af1f3da0-8514-4c71-8082-1f35338b92dd tempest-CreateVolumesFromImageTest-260207281 None] Volume volume-d24072bb-269a-48ec-94f1-c32ec780147f (d24072bb-269a-48ec-94f1-c32ec780147f): created successfully Jul 08 01:47:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-af1f3da0-8514-4c71-8082-1f35338b92dd tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (664585ed-c12a-41cb-a4a5-898bd3683840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-af1f3da0-8514-4c71-8082-1f35338b92dd tempest-CreateVolumesFromImageTest-260207281 None] Flow 'volume_create_manager' (e2b43731-fc6d-45c9-b5e6-b4f15396ec03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:50 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-af1f3da0-8514-4c71-8082-1f35338b92dd tempest-CreateVolumesFromImageTest-260207281 None] Created volume successfully. Jul 08 01:47:50 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a12feea8-6bb5-43f0-8af3-386280dae256 tempest-VolumeImageDependencyTests-697855112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58402857-62e9-41e3-af83-797bc21779f4" returned: 1 in 0.943s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a12feea8-6bb5-43f0-8af3-386280dae256 tempest-VolumeImageDependencyTests-697855112 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58402857-62e9-41e3-af83-797bc21779f4' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:47:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a12feea8-6bb5-43f0-8af3-386280dae256 tempest-VolumeImageDependencyTests-697855112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58402857-62e9-41e3-af83-797bc21779f4 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:50 devstack sudo[101572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58402857-62e9-41e3-af83-797bc21779f4 Jul 08 01:47:50 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:51 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a12feea8-6bb5-43f0-8af3-386280dae256 tempest-VolumeImageDependencyTests-697855112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58402857-62e9-41e3-af83-797bc21779f4" returned: 0 in 0.686s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:51 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-a12feea8-6bb5-43f0-8af3-386280dae256 tempest-VolumeImageDependencyTests-697855112 None] Lock "cinder-quobyte-58402857-62e9-41e3-af83-797bc21779f4" released by "delete_volume" :: held 2.982s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:51 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-a12feea8-6bb5-43f0-8af3-386280dae256 tempest-VolumeImageDependencyTests-697855112 None] Created reservations ['7251e0e8-7ff5-4c0d-a892-c65c1e2d43f8', '1a626ac8-b349-4edb-ae66-513381303a37', '96930bf0-d085-46b9-8eaa-b819f541c237', '36d3d652-553e-4b1c-8ccd-426e058bb2ce'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a12feea8-6bb5-43f0-8af3-386280dae256 tempest-VolumeImageDependencyTests-697855112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a12feea8-6bb5-43f0-8af3-386280dae256 tempest-VolumeImageDependencyTests-697855112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:51 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a12feea8-6bb5-43f0-8af3-386280dae256 tempest-VolumeImageDependencyTests-697855112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:51 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a12feea8-6bb5-43f0-8af3-386280dae256 tempest-VolumeImageDependencyTests-697855112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:51 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a12feea8-6bb5-43f0-8af3-386280dae256 tempest-VolumeImageDependencyTests-697855112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a12feea8-6bb5-43f0-8af3-386280dae256 tempest-VolumeImageDependencyTests-697855112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5805f043-b453-4ff2-80d1-9309f9be1f38 tempest-CreateVolumesFromImageTest-260207281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ff80eff0-4673-48d3-80cc-f0761341ad12 1073741824" returned: 0 in 1.045s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:51 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:47:51 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5805f043-b453-4ff2-80d1-9309f9be1f38 tempest-CreateVolumesFromImageTest-260207281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ff80eff0-4673-48d3-80cc-f0761341ad12 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:51 devstack sudo[101580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ff80eff0-4673-48d3-80cc-f0761341ad12 Jul 08 01:47:51 devstack sudo[101580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:52 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a12feea8-6bb5-43f0-8af3-386280dae256 tempest-VolumeImageDependencyTests-697855112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.658s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:52 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-a12feea8-6bb5-43f0-8af3-386280dae256 tempest-VolumeImageDependencyTests-697855112 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:47:52 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-a12feea8-6bb5-43f0-8af3-386280dae256 tempest-VolumeImageDependencyTests-697855112 None] Deleted volume successfully. Jul 08 01:47:52 devstack sudo[101580]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5805f043-b453-4ff2-80d1-9309f9be1f38 tempest-CreateVolumesFromImageTest-260207281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ff80eff0-4673-48d3-80cc-f0761341ad12" returned: 0 in 0.650s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5805f043-b453-4ff2-80d1-9309f9be1f38 tempest-CreateVolumesFromImageTest-260207281 None] <== create_volume: return (1739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:47:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5805f043-b453-4ff2-80d1-9309f9be1f38 tempest-CreateVolumesFromImageTest-260207281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:52 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-a12feea8-6bb5-43f0-8af3-386280dae256 tempest-VolumeImageDependencyTests-697855112 None] Lock "cinder-58402857-62e9-41e3-af83-797bc21779f4-delete_volume" released by "delete_volume" :: held 4.023s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e88fc4bb-497b-4ad3-926b-f497d59b165a tempest-CreateVolumesFromImageTest-260207281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.743s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e88fc4bb-497b-4ad3-926b-f497d59b165a tempest-CreateVolumesFromImageTest-260207281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2112931887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2109504a-f1e9-443a-8a58-9afc8c0a3af4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8780575ccc9a477a940927cc0972bc1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:49Z,use_quota=True,user_id='7ba233b639df431282645d9f361e037a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:47:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-e88fc4bb-497b-4ad3-926b-f497d59b165a tempest-CreateVolumesFromImageTest-260207281 None] Creating volume 2109504a-f1e9-443a-8a58-9afc8c0a3af4 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:47:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e88fc4bb-497b-4ad3-926b-f497d59b165a tempest-CreateVolumesFromImageTest-260207281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e88fc4bb-497b-4ad3-926b-f497d59b165a tempest-CreateVolumesFromImageTest-260207281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e88fc4bb-497b-4ad3-926b-f497d59b165a tempest-CreateVolumesFromImageTest-260207281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e88fc4bb-497b-4ad3-926b-f497d59b165a tempest-CreateVolumesFromImageTest-260207281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e88fc4bb-497b-4ad3-926b-f497d59b165a tempest-CreateVolumesFromImageTest-260207281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e88fc4bb-497b-4ad3-926b-f497d59b165a tempest-CreateVolumesFromImageTest-260207281 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:47:52 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-e88fc4bb-497b-4ad3-926b-f497d59b165a tempest-CreateVolumesFromImageTest-260207281 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:47:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e88fc4bb-497b-4ad3-926b-f497d59b165a tempest-CreateVolumesFromImageTest-260207281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2109504a-f1e9-443a-8a58-9afc8c0a3af4 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:52 devstack sudo[101584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2109504a-f1e9-443a-8a58-9afc8c0a3af4 1073741824 Jul 08 01:47:52 devstack sudo[101584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:52 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5805f043-b453-4ff2-80d1-9309f9be1f38 tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08c1707a-7203-45dc-bcd9-1f1da68424d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff80eff0-4673-48d3-80cc-f0761341ad12', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:52 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5805f043-b453-4ff2-80d1-9309f9be1f38 tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69bc12e9-9eb8-4e12-941a-e90f5fab5bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:52 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-5805f043-b453-4ff2-80d1-9309f9be1f38 tempest-CreateVolumesFromImageTest-260207281 None] Volume volume-ff80eff0-4673-48d3-80cc-f0761341ad12 (ff80eff0-4673-48d3-80cc-f0761341ad12): created successfully Jul 08 01:47:52 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5805f043-b453-4ff2-80d1-9309f9be1f38 tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69bc12e9-9eb8-4e12-941a-e90f5fab5bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:52 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5805f043-b453-4ff2-80d1-9309f9be1f38 tempest-CreateVolumesFromImageTest-260207281 None] Flow 'volume_create_manager' (17fc92ce-510a-4560-bd77-7edcda41dc81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:52 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-5805f043-b453-4ff2-80d1-9309f9be1f38 tempest-CreateVolumesFromImageTest-260207281 None] Created volume successfully. Jul 08 01:47:53 devstack sudo[101584]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e88fc4bb-497b-4ad3-926b-f497d59b165a tempest-CreateVolumesFromImageTest-260207281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2109504a-f1e9-443a-8a58-9afc8c0a3af4 1073741824" returned: 0 in 0.990s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e88fc4bb-497b-4ad3-926b-f497d59b165a tempest-CreateVolumesFromImageTest-260207281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2109504a-f1e9-443a-8a58-9afc8c0a3af4 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:53 devstack sudo[101589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2109504a-f1e9-443a-8a58-9afc8c0a3af4 Jul 08 01:47:53 devstack sudo[101589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:53 devstack sudo[101589]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e88fc4bb-497b-4ad3-926b-f497d59b165a tempest-CreateVolumesFromImageTest-260207281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2109504a-f1e9-443a-8a58-9afc8c0a3af4" returned: 0 in 0.757s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:53 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e88fc4bb-497b-4ad3-926b-f497d59b165a tempest-CreateVolumesFromImageTest-260207281 None] <== create_volume: return (1801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:47:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e88fc4bb-497b-4ad3-926b-f497d59b165a tempest-CreateVolumesFromImageTest-260207281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.805s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.214s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:53 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Acquiring lock "cinder-quobyte-7a82cda4-b490-4449-ba29-d66879260c60-1d5db308-fdc1-46e6-a361-b6706d445f99" by "_create_volume_from_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:53 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Lock "cinder-quobyte-7a82cda4-b490-4449-ba29-d66879260c60-1d5db308-fdc1-46e6-a361-b6706d445f99" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:53 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Creating volume 1d5db308-fdc1-46e6-a361-b6706d445f99 from snapshot 7a82cda4-b490-4449-ba29-d66879260c60 {{(pid=87284) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 01:47:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:53 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:53 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:53 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:47:53 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Acquiring lock "cinder-quobyte-1d5db308-fdc1-46e6-a361-b6706d445f99" by "_copy_volume_from_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:53 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e88fc4bb-497b-4ad3-926b-f497d59b165a tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6cdde27-3aa9-4cc3-92e5-4b4ec81abf61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2109504a-f1e9-443a-8a58-9afc8c0a3af4', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:53 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e88fc4bb-497b-4ad3-926b-f497d59b165a tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e02b91d-c404-4d29-a226-1c8cd41b7f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:53 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-e88fc4bb-497b-4ad3-926b-f497d59b165a tempest-CreateVolumesFromImageTest-260207281 None] Volume volume-2109504a-f1e9-443a-8a58-9afc8c0a3af4 (2109504a-f1e9-443a-8a58-9afc8c0a3af4): created successfully Jul 08 01:47:53 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e88fc4bb-497b-4ad3-926b-f497d59b165a tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e02b91d-c404-4d29-a226-1c8cd41b7f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:53 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e88fc4bb-497b-4ad3-926b-f497d59b165a tempest-CreateVolumesFromImageTest-260207281 None] Flow 'volume_create_manager' (775eb181-d985-42d6-ac86-824369042618) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:53 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Lock "cinder-quobyte-1d5db308-fdc1-46e6-a361-b6706d445f99" acquired by "_copy_volume_from_snapshot" :: waited 0.063s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:53 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] snapshot: 7a82cda4-b490-4449-ba29-d66879260c60, volume: 1d5db308-fdc1-46e6-a361-b6706d445f99, {{(pid=87284) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:47:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:54 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:54 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:54 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-e88fc4bb-497b-4ad3-926b-f497d59b165a tempest-CreateVolumesFromImageTest-260207281 None] Created volume successfully. Jul 08 01:47:54 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[172907bf-3b98-4b03-a921-6cf56a6814c3]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f.7a82cda4-b490-4449-ba29-d66879260c60 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:54 devstack sudo[101592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f.7a82cda4-b490-4449-ba29-d66879260c60 Jul 08 01:47:54 devstack sudo[101592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:54 devstack sudo[101592]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f.7a82cda4-b490-4449-ba29-d66879260c60" returned: 0 in 0.911s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:54 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:47:54 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f {{(pid=87284) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:47:54 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Creating direct copy from snapshot {{(pid=87284) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:47:54 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[516bd32b-c259-40ed-a9a7-c3903a578215]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:55 devstack sudo[101597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f Jul 08 01:47:55 devstack sudo[101597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:55 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:47:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:55 devstack sudo[101599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:47:55 devstack sudo[101599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:55 devstack sudo[101597]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f" returned: 0 in 0.811s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:55 devstack cinder-volume[87284]: DEBUG cinder.utils [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Path /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1d5db308-fdc1-46e6-a361-b6706d445f99 not found in is_blk_device check {{(pid=87284) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:47:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1d5db308-fdc1-46e6-a361-b6706d445f99 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:55 devstack sudo[101607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1d5db308-fdc1-46e6-a361-b6706d445f99 Jul 08 01:47:55 devstack sudo[101607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:55 devstack sudo[101599]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.693s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:55 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:47:55 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager._thread_info {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:47:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread count: 29 {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:47:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread info: [<_MainThread(MainThread, started 127058402500736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:48:00 devstack sudo[101607]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1d5db308-fdc1-46e6-a361-b6706d445f99" returned: 0 in 4.505s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:00 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[664efe95-05c4-45ca-9d8e-c47988577405]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:00 devstack sudo[101621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f Jul 08 01:48:00 devstack sudo[101621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:01 devstack sudo[101621]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f" returned: 0 in 0.972s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:01 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Image conversion details: src /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f, size 1024.00 MB, duration 4.51 sec, destination /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1d5db308-fdc1-46e6-a361-b6706d445f99 {{(pid=87284) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:48:01 devstack cinder-volume[87284]: INFO cinder.image.image_utils [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Converted 1024.00 MB image at 227.18 MB/s Jul 08 01:48:01 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1d5db308-fdc1-46e6-a361-b6706d445f99 is being set with open permissions: ugo+rw Jul 08 01:48:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1d5db308-fdc1-46e6-a361-b6706d445f99 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:01 devstack sudo[101627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1d5db308-fdc1-46e6-a361-b6706d445f99 Jul 08 01:48:01 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:01 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1d5db308-fdc1-46e6-a361-b6706d445f99" returned: 0 in 0.650s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:01 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Lock "cinder-quobyte-1d5db308-fdc1-46e6-a361-b6706d445f99" released by "_copy_volume_from_snapshot" :: held 7.974s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:01 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Lock "cinder-quobyte-7a82cda4-b490-4449-ba29-d66879260c60-1d5db308-fdc1-46e6-a361-b6706d445f99" released by "_create_volume_from_snapshot" :: held 8.054s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.075s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5ccc1af0-0738-4abd-8024-07e16cc1b440 tempest-CreateVolumesFromImageTest-260207281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.105s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:01 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5ccc1af0-0738-4abd-8024-07e16cc1b440 tempest-CreateVolumesFromImageTest-260207281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1427635112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e63c7387-19ce-4f4c-93c7-b14de06a3035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8780575ccc9a477a940927cc0972bc1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:50Z,use_quota=True,user_id='7ba233b639df431282645d9f361e037a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:48:01 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-5ccc1af0-0738-4abd-8024-07e16cc1b440 tempest-CreateVolumesFromImageTest-260207281 None] Creating volume e63c7387-19ce-4f4c-93c7-b14de06a3035 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:48:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5ccc1af0-0738-4abd-8024-07e16cc1b440 tempest-CreateVolumesFromImageTest-260207281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5ccc1af0-0738-4abd-8024-07e16cc1b440 tempest-CreateVolumesFromImageTest-260207281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:01 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5ccc1af0-0738-4abd-8024-07e16cc1b440 tempest-CreateVolumesFromImageTest-260207281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:01 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5ccc1af0-0738-4abd-8024-07e16cc1b440 tempest-CreateVolumesFromImageTest-260207281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5ccc1af0-0738-4abd-8024-07e16cc1b440 tempest-CreateVolumesFromImageTest-260207281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:01 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5ccc1af0-0738-4abd-8024-07e16cc1b440 tempest-CreateVolumesFromImageTest-260207281 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:48:01 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-5ccc1af0-0738-4abd-8024-07e16cc1b440 tempest-CreateVolumesFromImageTest-260207281 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:48:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5ccc1af0-0738-4abd-8024-07e16cc1b440 tempest-CreateVolumesFromImageTest-260207281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-e63c7387-19ce-4f4c-93c7-b14de06a3035 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:01 devstack sudo[101630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-e63c7387-19ce-4f4c-93c7-b14de06a3035 1073741824 Jul 08 01:48:01 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:02 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af15e47d-e4ec-4dad-8800-dec847a87f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d5db308-fdc1-46e6-a361-b6706d445f99', 'volume_size': 1, 'snapshot_id': '7a82cda4-b490-4449-ba29-d66879260c60'}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:02 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2d76019-51d7-4575-8775-1c4b07ce1333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:02 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Volume volume-1d5db308-fdc1-46e6-a361-b6706d445f99 (1d5db308-fdc1-46e6-a361-b6706d445f99): created successfully Jul 08 01:48:02 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2d76019-51d7-4575-8775-1c4b07ce1333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:02 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Flow 'volume_create_manager' (7e6be3b4-e070-4efd-a4ff-4ae3a9c70617) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:48:02 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-07daac64-3af7-4881-bb58-546e6116cc93 tempest-VolumesDeleteCascade-526616262 None] Created volume successfully. Jul 08 01:48:02 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5ccc1af0-0738-4abd-8024-07e16cc1b440 tempest-CreateVolumesFromImageTest-260207281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-e63c7387-19ce-4f4c-93c7-b14de06a3035 1073741824" returned: 0 in 1.015s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5ccc1af0-0738-4abd-8024-07e16cc1b440 tempest-CreateVolumesFromImageTest-260207281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-e63c7387-19ce-4f4c-93c7-b14de06a3035 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:03 devstack sudo[101636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-e63c7387-19ce-4f4c-93c7-b14de06a3035 Jul 08 01:48:03 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:03 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] Acquiring lock "cinder-c7f9010e-f0ff-45f9-82ca-5447984ccc6f-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:03 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] Lock "cinder-c7f9010e-f0ff-45f9-82ca-5447984ccc6f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] Performing cascade delete. {{(pid=87284) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 08 01:48:03 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] Acquiring lock "cinder-7a82cda4-b490-4449-ba29-d66879260c60-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:03 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] Lock "cinder-7a82cda4-b490-4449-ba29-d66879260c60-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:03 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] Acquiring lock "cinder-quobyte-c7f9010e-f0ff-45f9-82ca-5447984ccc6f" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:03 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] Lock "cinder-quobyte-c7f9010e-f0ff-45f9-82ca-5447984ccc6f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:03 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] Acquiring lock "cinder-quobyte-7a82cda4-b490-4449-ba29-d66879260c60" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:03 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] Lock "cinder-quobyte-7a82cda4-b490-4449-ba29-d66879260c60" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:03 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] Deleting offline snapshot 7a82cda4-b490-4449-ba29-d66879260c60 of volume c7f9010e-f0ff-45f9-82ca-5447984ccc6f {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:48:03 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] snapshot_file for this snap is: volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f.7a82cda4-b490-4449-ba29-d66879260c60 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:48:03 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[021a195c-6196-4207-9b12-b71b0bd3b839]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f.7a82cda4-b490-4449-ba29-d66879260c60 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:03 devstack sudo[101638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f.7a82cda4-b490-4449-ba29-d66879260c60 Jul 08 01:48:03 devstack sudo[101638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:03 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5ccc1af0-0738-4abd-8024-07e16cc1b440 tempest-CreateVolumesFromImageTest-260207281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-e63c7387-19ce-4f4c-93c7-b14de06a3035" returned: 0 in 0.738s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:03 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5ccc1af0-0738-4abd-8024-07e16cc1b440 tempest-CreateVolumesFromImageTest-260207281 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:48:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5ccc1af0-0738-4abd-8024-07e16cc1b440 tempest-CreateVolumesFromImageTest-260207281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.801s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-fa102904-3035-4806-b096-3b4ec11b668b tempest-CreateVolumesFromImageTest-260207281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.651s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:03 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-fa102904-3035-4806-b096-3b4ec11b668b tempest-CreateVolumesFromImageTest-260207281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1373449816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bb70a9f-efd9-420c-b6c0-0e7efd8d690a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8780575ccc9a477a940927cc0972bc1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:50Z,use_quota=True,user_id='7ba233b639df431282645d9f361e037a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:48:03 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-fa102904-3035-4806-b096-3b4ec11b668b tempest-CreateVolumesFromImageTest-260207281 None] Creating volume 1bb70a9f-efd9-420c-b6c0-0e7efd8d690a {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:48:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-fa102904-3035-4806-b096-3b4ec11b668b tempest-CreateVolumesFromImageTest-260207281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-fa102904-3035-4806-b096-3b4ec11b668b tempest-CreateVolumesFromImageTest-260207281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:03 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-fa102904-3035-4806-b096-3b4ec11b668b tempest-CreateVolumesFromImageTest-260207281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:03 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-fa102904-3035-4806-b096-3b4ec11b668b tempest-CreateVolumesFromImageTest-260207281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-fa102904-3035-4806-b096-3b4ec11b668b tempest-CreateVolumesFromImageTest-260207281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:03 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-fa102904-3035-4806-b096-3b4ec11b668b tempest-CreateVolumesFromImageTest-260207281 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:48:03 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-fa102904-3035-4806-b096-3b4ec11b668b tempest-CreateVolumesFromImageTest-260207281 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:48:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-fa102904-3035-4806-b096-3b4ec11b668b tempest-CreateVolumesFromImageTest-260207281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1bb70a9f-efd9-420c-b6c0-0e7efd8d690a 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:03 devstack sudo[101641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1bb70a9f-efd9-420c-b6c0-0e7efd8d690a 1073741824 Jul 08 01:48:03 devstack sudo[101641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5ccc1af0-0738-4abd-8024-07e16cc1b440 tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cdbb924-00ab-4340-bbe8-3667f8290a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e63c7387-19ce-4f4c-93c7-b14de06a3035', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5ccc1af0-0738-4abd-8024-07e16cc1b440 tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beaa04bf-132c-4e43-b07f-361bee51c136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:03 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-5ccc1af0-0738-4abd-8024-07e16cc1b440 tempest-CreateVolumesFromImageTest-260207281 None] Volume volume-e63c7387-19ce-4f4c-93c7-b14de06a3035 (e63c7387-19ce-4f4c-93c7-b14de06a3035): created successfully Jul 08 01:48:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5ccc1af0-0738-4abd-8024-07e16cc1b440 tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beaa04bf-132c-4e43-b07f-361bee51c136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5ccc1af0-0738-4abd-8024-07e16cc1b440 tempest-CreateVolumesFromImageTest-260207281 None] Flow 'volume_create_manager' (b2d31c82-75d3-4964-8d2f-d7f050b1a366) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:48:03 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-5ccc1af0-0738-4abd-8024-07e16cc1b440 tempest-CreateVolumesFromImageTest-260207281 None] Created volume successfully. Jul 08 01:48:04 devstack sudo[101638]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f.7a82cda4-b490-4449-ba29-d66879260c60" returned: 0 in 0.917s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:04 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:48:04 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6565c1-858b-4cf1-ab42-f71e81289ca4]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:04 devstack sudo[101649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f Jul 08 01:48:04 devstack sudo[101649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:04 devstack sudo[101641]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-fa102904-3035-4806-b096-3b4ec11b668b tempest-CreateVolumesFromImageTest-260207281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1bb70a9f-efd9-420c-b6c0-0e7efd8d690a 1073741824" returned: 0 in 1.002s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-fa102904-3035-4806-b096-3b4ec11b668b tempest-CreateVolumesFromImageTest-260207281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1bb70a9f-efd9-420c-b6c0-0e7efd8d690a {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:04 devstack sudo[101652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1bb70a9f-efd9-420c-b6c0-0e7efd8d690a Jul 08 01:48:04 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:05 devstack sudo[101649]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f" returned: 0 in 0.864s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f.7a82cda4-b490-4449-ba29-d66879260c60 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:05 devstack sudo[101658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f.7a82cda4-b490-4449-ba29-d66879260c60 Jul 08 01:48:05 devstack sudo[101658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:05 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-fa102904-3035-4806-b096-3b4ec11b668b tempest-CreateVolumesFromImageTest-260207281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1bb70a9f-efd9-420c-b6c0-0e7efd8d690a" returned: 0 in 0.772s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:05 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-fa102904-3035-4806-b096-3b4ec11b668b tempest-CreateVolumesFromImageTest-260207281 None] <== create_volume: return (1820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:48:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-fa102904-3035-4806-b096-3b4ec11b668b tempest-CreateVolumesFromImageTest-260207281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.823s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:05 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fa102904-3035-4806-b096-3b4ec11b668b tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cae689a7-0a57-4500-9bf5-4aa387ad24da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bb70a9f-efd9-420c-b6c0-0e7efd8d690a', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:05 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fa102904-3035-4806-b096-3b4ec11b668b tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a69f2f-a99b-4156-b302-07c12fd349fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:05 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-fa102904-3035-4806-b096-3b4ec11b668b tempest-CreateVolumesFromImageTest-260207281 None] Volume volume-1bb70a9f-efd9-420c-b6c0-0e7efd8d690a (1bb70a9f-efd9-420c-b6c0-0e7efd8d690a): created successfully Jul 08 01:48:05 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fa102904-3035-4806-b096-3b4ec11b668b tempest-CreateVolumesFromImageTest-260207281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a69f2f-a99b-4156-b302-07c12fd349fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:05 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fa102904-3035-4806-b096-3b4ec11b668b tempest-CreateVolumesFromImageTest-260207281 None] Flow 'volume_create_manager' (6f8cbea8-7c94-4a8f-9544-6a4606a865e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:48:05 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-fa102904-3035-4806-b096-3b4ec11b668b tempest-CreateVolumesFromImageTest-260207281 None] Created volume successfully. Jul 08 01:48:06 devstack sudo[101658]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f.7a82cda4-b490-4449-ba29-d66879260c60" returned: 0 in 0.806s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f.7a82cda4-b490-4449-ba29-d66879260c60 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:06 devstack sudo[101664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f.7a82cda4-b490-4449-ba29-d66879260c60 Jul 08 01:48:06 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:06 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6d3a860b-b546-451e-84a7-5df9c4ac41af tempest-CreateVolumesFromImageTest-260207281 None] Acquiring lock "cinder-1bb70a9f-efd9-420c-b6c0-0e7efd8d690a-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:06 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6d3a860b-b546-451e-84a7-5df9c4ac41af tempest-CreateVolumesFromImageTest-260207281 None] Lock "cinder-1bb70a9f-efd9-420c-b6c0-0e7efd8d690a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:06 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6d3a860b-b546-451e-84a7-5df9c4ac41af tempest-CreateVolumesFromImageTest-260207281 None] Acquiring lock "cinder-quobyte-1bb70a9f-efd9-420c-b6c0-0e7efd8d690a" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:06 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6d3a860b-b546-451e-84a7-5df9c4ac41af tempest-CreateVolumesFromImageTest-260207281 None] Lock "cinder-quobyte-1bb70a9f-efd9-420c-b6c0-0e7efd8d690a" acquired by "delete_volume" :: waited 0.020s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:06 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72fb484-ef59-4d77-a3a6-cdf6cb44f095]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6d3a860b-b546-451e-84a7-5df9c4ac41af tempest-CreateVolumesFromImageTest-260207281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1bb70a9f-efd9-420c-b6c0-0e7efd8d690a {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:06 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f.7a82cda4-b490-4449-ba29-d66879260c60" returned: 0 in 0.724s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:06 devstack sudo[101667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1bb70a9f-efd9-420c-b6c0-0e7efd8d690a Jul 08 01:48:06 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:06 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] Lock "cinder-quobyte-7a82cda4-b490-4449-ba29-d66879260c60" released by "_delete_snapshot" :: held 3.424s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:06 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] Lock "cinder-quobyte-c7f9010e-f0ff-45f9-82ca-5447984ccc6f" released by "delete_snapshot" :: held 3.450s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:07 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] Created reservations ['48f6813e-6350-47c7-83fb-616d32a483df', '00868db7-00bc-4161-9dd1-935b5b76c1e0', 'dd48d681-ddbe-45e3-8842-8cb55c3a44ae', '384600de-1f86-4a35-aae8-e7d6f4fb4cb5'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:48:07 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] Delete snapshot completed successfully. Jul 08 01:48:07 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] Lock "cinder-7a82cda4-b490-4449-ba29-d66879260c60-delete_snapshot" released by "delete_snapshot" :: held 3.615s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:07 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] Snapshots deleted, issuing volume delete {{(pid=87284) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 08 01:48:07 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] Acquiring lock "cinder-quobyte-c7f9010e-f0ff-45f9-82ca-5447984ccc6f" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:07 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] Lock "cinder-quobyte-c7f9010e-f0ff-45f9-82ca-5447984ccc6f" acquired by "delete_volume" :: waited 0.015s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:07 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0b8253-5d55-4603-906e-f2783eee1358]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:07 devstack sudo[101669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f Jul 08 01:48:07 devstack sudo[101669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:07 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6d3a860b-b546-451e-84a7-5df9c4ac41af tempest-CreateVolumesFromImageTest-260207281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1bb70a9f-efd9-420c-b6c0-0e7efd8d690a" returned: 0 in 0.820s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6d3a860b-b546-451e-84a7-5df9c4ac41af tempest-CreateVolumesFromImageTest-260207281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1bb70a9f-efd9-420c-b6c0-0e7efd8d690a {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:07 devstack sudo[101674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1bb70a9f-efd9-420c-b6c0-0e7efd8d690a Jul 08 01:48:07 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:07 devstack sudo[101669]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f" returned: 0 in 0.843s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:08 devstack sudo[101679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f Jul 08 01:48:08 devstack sudo[101679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:08 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6d3a860b-b546-451e-84a7-5df9c4ac41af tempest-CreateVolumesFromImageTest-260207281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1bb70a9f-efd9-420c-b6c0-0e7efd8d690a" returned: 0 in 0.682s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:08 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6d3a860b-b546-451e-84a7-5df9c4ac41af tempest-CreateVolumesFromImageTest-260207281 None] Lock "cinder-quobyte-1bb70a9f-efd9-420c-b6c0-0e7efd8d690a" released by "delete_volume" :: held 1.550s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:08 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-6d3a860b-b546-451e-84a7-5df9c4ac41af tempest-CreateVolumesFromImageTest-260207281 None] Created reservations ['f129263d-5e27-46a8-9563-9e5fcbe6c0dd', 'cdb78d71-1cfc-4f40-b054-fbff2fd881c3', '62528d03-6d6a-43bf-88b9-5ffdb00e5d28', 'cb5656c9-8707-482b-8fc2-4fb01e602af2'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:48:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6d3a860b-b546-451e-84a7-5df9c4ac41af tempest-CreateVolumesFromImageTest-260207281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6d3a860b-b546-451e-84a7-5df9c4ac41af tempest-CreateVolumesFromImageTest-260207281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:08 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-6d3a860b-b546-451e-84a7-5df9c4ac41af tempest-CreateVolumesFromImageTest-260207281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:08 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-6d3a860b-b546-451e-84a7-5df9c4ac41af tempest-CreateVolumesFromImageTest-260207281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6d3a860b-b546-451e-84a7-5df9c4ac41af tempest-CreateVolumesFromImageTest-260207281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6d3a860b-b546-451e-84a7-5df9c4ac41af tempest-CreateVolumesFromImageTest-260207281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:08 devstack sudo[101682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:48:08 devstack sudo[101682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:08 devstack sudo[101679]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c7f9010e-f0ff-45f9-82ca-5447984ccc6f" returned: 0 in 0.689s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:08 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] Lock "cinder-quobyte-c7f9010e-f0ff-45f9-82ca-5447984ccc6f" released by "delete_volume" :: held 1.606s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:08 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] Created reservations ['ab209a37-9a7e-41ac-9ba4-35c0f9d5164d', '800381c7-b79c-41df-be83-45e06fd4f32b', '2399aa35-52eb-4c8e-aecf-70828ad40afa', 'd23ec005-479a-49e8-ae90-b88457f0ae82'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:48:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:08 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:08 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:08 devstack sudo[101685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:48:08 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:08 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d06c2e62-a58b-411a-b6a0-aba0606429b0 tempest-CreateVolumesFromImageTest-260207281 None] Acquiring lock "cinder-e63c7387-19ce-4f4c-93c7-b14de06a3035-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:08 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d06c2e62-a58b-411a-b6a0-aba0606429b0 tempest-CreateVolumesFromImageTest-260207281 None] Lock "cinder-e63c7387-19ce-4f4c-93c7-b14de06a3035-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:09 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d06c2e62-a58b-411a-b6a0-aba0606429b0 tempest-CreateVolumesFromImageTest-260207281 None] Acquiring lock "cinder-quobyte-e63c7387-19ce-4f4c-93c7-b14de06a3035" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:09 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d06c2e62-a58b-411a-b6a0-aba0606429b0 tempest-CreateVolumesFromImageTest-260207281 None] Lock "cinder-quobyte-e63c7387-19ce-4f4c-93c7-b14de06a3035" acquired by "delete_volume" :: waited 0.034s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:09 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e03d26-f70a-402e-9e19-ce215bc14616]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d06c2e62-a58b-411a-b6a0-aba0606429b0 tempest-CreateVolumesFromImageTest-260207281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-e63c7387-19ce-4f4c-93c7-b14de06a3035 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:09 devstack sudo[101687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-e63c7387-19ce-4f4c-93c7-b14de06a3035 Jul 08 01:48:09 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:09 devstack sudo[101682]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6d3a860b-b546-451e-84a7-5df9c4ac41af tempest-CreateVolumesFromImageTest-260207281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.779s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:09 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-6d3a860b-b546-451e-84a7-5df9c4ac41af tempest-CreateVolumesFromImageTest-260207281 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:48:09 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-6d3a860b-b546-451e-84a7-5df9c4ac41af tempest-CreateVolumesFromImageTest-260207281 None] Deleted volume successfully. Jul 08 01:48:09 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6d3a860b-b546-451e-84a7-5df9c4ac41af tempest-CreateVolumesFromImageTest-260207281 None] Lock "cinder-1bb70a9f-efd9-420c-b6c0-0e7efd8d690a-delete_volume" released by "delete_volume" :: held 2.595s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:09 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.704s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:09 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:48:09 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] Deleted volume successfully. Jul 08 01:48:09 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3e38e8f9-31e3-435c-b618-0e194434fc5b tempest-VolumesDeleteCascade-526616262 None] Lock "cinder-c7f9010e-f0ff-45f9-82ca-5447984ccc6f-delete_volume" released by "delete_volume" :: held 6.215s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:09 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d06c2e62-a58b-411a-b6a0-aba0606429b0 tempest-CreateVolumesFromImageTest-260207281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-e63c7387-19ce-4f4c-93c7-b14de06a3035" returned: 0 in 0.828s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d06c2e62-a58b-411a-b6a0-aba0606429b0 tempest-CreateVolumesFromImageTest-260207281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-e63c7387-19ce-4f4c-93c7-b14de06a3035 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:09 devstack sudo[101694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-e63c7387-19ce-4f4c-93c7-b14de06a3035 Jul 08 01:48:09 devstack sudo[101694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:10 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e1025e75-4118-4717-8aa9-66441ea62563 tempest-VolumesDeleteCascade-526616262 None] Acquiring lock "cinder-1d5db308-fdc1-46e6-a361-b6706d445f99-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:10 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e1025e75-4118-4717-8aa9-66441ea62563 tempest-VolumesDeleteCascade-526616262 None] Lock "cinder-1d5db308-fdc1-46e6-a361-b6706d445f99-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:10 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e1025e75-4118-4717-8aa9-66441ea62563 tempest-VolumesDeleteCascade-526616262 None] Acquiring lock "cinder-quobyte-1d5db308-fdc1-46e6-a361-b6706d445f99" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:10 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e1025e75-4118-4717-8aa9-66441ea62563 tempest-VolumesDeleteCascade-526616262 None] Lock "cinder-quobyte-1d5db308-fdc1-46e6-a361-b6706d445f99" acquired by "delete_volume" :: waited 0.014s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:10 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1803d1-60b4-4a97-8bca-8dd903c9619f]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e1025e75-4118-4717-8aa9-66441ea62563 tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1d5db308-fdc1-46e6-a361-b6706d445f99 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:10 devstack sudo[101696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1d5db308-fdc1-46e6-a361-b6706d445f99 Jul 08 01:48:10 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:10 devstack sudo[101694]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d06c2e62-a58b-411a-b6a0-aba0606429b0 tempest-CreateVolumesFromImageTest-260207281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-e63c7387-19ce-4f4c-93c7-b14de06a3035" returned: 0 in 0.699s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:10 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d06c2e62-a58b-411a-b6a0-aba0606429b0 tempest-CreateVolumesFromImageTest-260207281 None] Lock "cinder-quobyte-e63c7387-19ce-4f4c-93c7-b14de06a3035" released by "delete_volume" :: held 1.586s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:10 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-d06c2e62-a58b-411a-b6a0-aba0606429b0 tempest-CreateVolumesFromImageTest-260207281 None] Created reservations ['48d8c454-ce46-4b86-8e89-3fe9f30997f4', '3c3bf8f3-a49d-4412-bff8-c4ef51e62e34', '586cbc9d-2be1-40a3-878d-1b376475a52c', 'c6362dc9-c542-442d-bb91-abb9d34a79af'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:48:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-d06c2e62-a58b-411a-b6a0-aba0606429b0 tempest-CreateVolumesFromImageTest-260207281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-d06c2e62-a58b-411a-b6a0-aba0606429b0 tempest-CreateVolumesFromImageTest-260207281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:10 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-d06c2e62-a58b-411a-b6a0-aba0606429b0 tempest-CreateVolumesFromImageTest-260207281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:10 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-d06c2e62-a58b-411a-b6a0-aba0606429b0 tempest-CreateVolumesFromImageTest-260207281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-d06c2e62-a58b-411a-b6a0-aba0606429b0 tempest-CreateVolumesFromImageTest-260207281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d06c2e62-a58b-411a-b6a0-aba0606429b0 tempest-CreateVolumesFromImageTest-260207281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:10 devstack sudo[101699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:48:10 devstack sudo[101699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:10 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e1025e75-4118-4717-8aa9-66441ea62563 tempest-VolumesDeleteCascade-526616262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1d5db308-fdc1-46e6-a361-b6706d445f99" returned: 0 in 0.782s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e1025e75-4118-4717-8aa9-66441ea62563 tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1d5db308-fdc1-46e6-a361-b6706d445f99 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:11 devstack sudo[101704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1d5db308-fdc1-46e6-a361-b6706d445f99 Jul 08 01:48:11 devstack sudo[101704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:11 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5f089928-0385-4438-a2cf-9a4950853b84 tempest-CreateVolumesFromImageTest-260207281 None] Acquiring lock "cinder-2109504a-f1e9-443a-8a58-9afc8c0a3af4-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:11 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5f089928-0385-4438-a2cf-9a4950853b84 tempest-CreateVolumesFromImageTest-260207281 None] Lock "cinder-2109504a-f1e9-443a-8a58-9afc8c0a3af4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:11 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5f089928-0385-4438-a2cf-9a4950853b84 tempest-CreateVolumesFromImageTest-260207281 None] Acquiring lock "cinder-quobyte-2109504a-f1e9-443a-8a58-9afc8c0a3af4" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:11 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5f089928-0385-4438-a2cf-9a4950853b84 tempest-CreateVolumesFromImageTest-260207281 None] Lock "cinder-quobyte-2109504a-f1e9-443a-8a58-9afc8c0a3af4" acquired by "delete_volume" :: waited 0.022s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:11 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c35b9e-07f2-4c1b-980a-7469b32d7530]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5f089928-0385-4438-a2cf-9a4950853b84 tempest-CreateVolumesFromImageTest-260207281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2109504a-f1e9-443a-8a58-9afc8c0a3af4 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:11 devstack sudo[101699]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d06c2e62-a58b-411a-b6a0-aba0606429b0 tempest-CreateVolumesFromImageTest-260207281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.670s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:11 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-d06c2e62-a58b-411a-b6a0-aba0606429b0 tempest-CreateVolumesFromImageTest-260207281 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:48:11 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-d06c2e62-a58b-411a-b6a0-aba0606429b0 tempest-CreateVolumesFromImageTest-260207281 None] Deleted volume successfully. Jul 08 01:48:11 devstack sudo[101707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2109504a-f1e9-443a-8a58-9afc8c0a3af4 Jul 08 01:48:11 devstack sudo[101707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:11 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d06c2e62-a58b-411a-b6a0-aba0606429b0 tempest-CreateVolumesFromImageTest-260207281 None] Lock "cinder-e63c7387-19ce-4f4c-93c7-b14de06a3035-delete_volume" released by "delete_volume" :: held 2.513s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:11 devstack sudo[101704]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e1025e75-4118-4717-8aa9-66441ea62563 tempest-VolumesDeleteCascade-526616262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1d5db308-fdc1-46e6-a361-b6706d445f99" returned: 0 in 0.741s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:11 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e1025e75-4118-4717-8aa9-66441ea62563 tempest-VolumesDeleteCascade-526616262 None] Lock "cinder-quobyte-1d5db308-fdc1-46e6-a361-b6706d445f99" released by "delete_volume" :: held 1.564s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:11 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-e1025e75-4118-4717-8aa9-66441ea62563 tempest-VolumesDeleteCascade-526616262 None] Created reservations ['a10b7093-b5d9-41c7-ba4f-132065b2538e', '68d91a90-a9b2-4655-b82e-c6e78a83d08a', '1bb082c9-fac0-4a93-af39-b360b5505de2', '0fc57616-3605-47ab-8ac6-16bfe7ccc981'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:48:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e1025e75-4118-4717-8aa9-66441ea62563 tempest-VolumesDeleteCascade-526616262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e1025e75-4118-4717-8aa9-66441ea62563 tempest-VolumesDeleteCascade-526616262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:11 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e1025e75-4118-4717-8aa9-66441ea62563 tempest-VolumesDeleteCascade-526616262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:11 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e1025e75-4118-4717-8aa9-66441ea62563 tempest-VolumesDeleteCascade-526616262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e1025e75-4118-4717-8aa9-66441ea62563 tempest-VolumesDeleteCascade-526616262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e1025e75-4118-4717-8aa9-66441ea62563 tempest-VolumesDeleteCascade-526616262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:11 devstack sudo[101710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:48:11 devstack sudo[101710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:12 devstack sudo[101707]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5f089928-0385-4438-a2cf-9a4950853b84 tempest-CreateVolumesFromImageTest-260207281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2109504a-f1e9-443a-8a58-9afc8c0a3af4" returned: 0 in 0.886s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5f089928-0385-4438-a2cf-9a4950853b84 tempest-CreateVolumesFromImageTest-260207281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2109504a-f1e9-443a-8a58-9afc8c0a3af4 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:12 devstack sudo[101715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2109504a-f1e9-443a-8a58-9afc8c0a3af4 Jul 08 01:48:12 devstack sudo[101715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:12 devstack sudo[101710]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e1025e75-4118-4717-8aa9-66441ea62563 tempest-VolumesDeleteCascade-526616262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.732s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:12 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-e1025e75-4118-4717-8aa9-66441ea62563 tempest-VolumesDeleteCascade-526616262 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:48:12 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-e1025e75-4118-4717-8aa9-66441ea62563 tempest-VolumesDeleteCascade-526616262 None] Deleted volume successfully. Jul 08 01:48:12 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e1025e75-4118-4717-8aa9-66441ea62563 tempest-VolumesDeleteCascade-526616262 None] Lock "cinder-1d5db308-fdc1-46e6-a361-b6706d445f99-delete_volume" released by "delete_volume" :: held 2.523s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:12 devstack sudo[101715]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5f089928-0385-4438-a2cf-9a4950853b84 tempest-CreateVolumesFromImageTest-260207281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2109504a-f1e9-443a-8a58-9afc8c0a3af4" returned: 0 in 0.697s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:12 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5f089928-0385-4438-a2cf-9a4950853b84 tempest-CreateVolumesFromImageTest-260207281 None] Lock "cinder-quobyte-2109504a-f1e9-443a-8a58-9afc8c0a3af4" released by "delete_volume" :: held 1.626s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:13 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-5f089928-0385-4438-a2cf-9a4950853b84 tempest-CreateVolumesFromImageTest-260207281 None] Created reservations ['206e97cb-2ff5-4160-9c7e-e4b97d9eea4e', 'eed798c2-b8cc-4661-a6b4-647e5aeda93f', 'c5ee03a4-3990-49f3-9dd7-198f52d3f1d8', '6d636688-996a-4060-a698-55a70217eeee'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:48:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5f089928-0385-4438-a2cf-9a4950853b84 tempest-CreateVolumesFromImageTest-260207281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5f089928-0385-4438-a2cf-9a4950853b84 tempest-CreateVolumesFromImageTest-260207281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:13 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5f089928-0385-4438-a2cf-9a4950853b84 tempest-CreateVolumesFromImageTest-260207281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:13 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5f089928-0385-4438-a2cf-9a4950853b84 tempest-CreateVolumesFromImageTest-260207281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5f089928-0385-4438-a2cf-9a4950853b84 tempest-CreateVolumesFromImageTest-260207281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5f089928-0385-4438-a2cf-9a4950853b84 tempest-CreateVolumesFromImageTest-260207281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:13 devstack sudo[101719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:48:13 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:13 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-89398afa-284a-4f79-8401-4a2f4023e0fd tempest-CreateVolumesFromImageTest-260207281 None] Acquiring lock "cinder-ff80eff0-4673-48d3-80cc-f0761341ad12-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:13 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-89398afa-284a-4f79-8401-4a2f4023e0fd tempest-CreateVolumesFromImageTest-260207281 None] Lock "cinder-ff80eff0-4673-48d3-80cc-f0761341ad12-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:13 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-89398afa-284a-4f79-8401-4a2f4023e0fd tempest-CreateVolumesFromImageTest-260207281 None] Acquiring lock "cinder-quobyte-ff80eff0-4673-48d3-80cc-f0761341ad12" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:13 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-89398afa-284a-4f79-8401-4a2f4023e0fd tempest-CreateVolumesFromImageTest-260207281 None] Lock "cinder-quobyte-ff80eff0-4673-48d3-80cc-f0761341ad12" acquired by "delete_volume" :: waited 0.019s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:13 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[1329bf00-a7da-4285-b345-8535c35371f0]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-89398afa-284a-4f79-8401-4a2f4023e0fd tempest-CreateVolumesFromImageTest-260207281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ff80eff0-4673-48d3-80cc-f0761341ad12 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:13 devstack sudo[101722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ff80eff0-4673-48d3-80cc-f0761341ad12 Jul 08 01:48:13 devstack sudo[101722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:13 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5f089928-0385-4438-a2cf-9a4950853b84 tempest-CreateVolumesFromImageTest-260207281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.762s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:13 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-5f089928-0385-4438-a2cf-9a4950853b84 tempest-CreateVolumesFromImageTest-260207281 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:48:13 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-5f089928-0385-4438-a2cf-9a4950853b84 tempest-CreateVolumesFromImageTest-260207281 None] Deleted volume successfully. Jul 08 01:48:13 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5f089928-0385-4438-a2cf-9a4950853b84 tempest-CreateVolumesFromImageTest-260207281 None] Lock "cinder-2109504a-f1e9-443a-8a58-9afc8c0a3af4-delete_volume" released by "delete_volume" :: held 2.656s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:14 devstack sudo[101722]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-89398afa-284a-4f79-8401-4a2f4023e0fd tempest-CreateVolumesFromImageTest-260207281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ff80eff0-4673-48d3-80cc-f0761341ad12" returned: 0 in 0.881s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-89398afa-284a-4f79-8401-4a2f4023e0fd tempest-CreateVolumesFromImageTest-260207281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ff80eff0-4673-48d3-80cc-f0761341ad12 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:14 devstack sudo[101728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ff80eff0-4673-48d3-80cc-f0761341ad12 Jul 08 01:48:14 devstack sudo[101728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:15 devstack sudo[101728]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-89398afa-284a-4f79-8401-4a2f4023e0fd tempest-CreateVolumesFromImageTest-260207281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ff80eff0-4673-48d3-80cc-f0761341ad12" returned: 0 in 0.647s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:15 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-89398afa-284a-4f79-8401-4a2f4023e0fd tempest-CreateVolumesFromImageTest-260207281 None] Lock "cinder-quobyte-ff80eff0-4673-48d3-80cc-f0761341ad12" released by "delete_volume" :: held 1.582s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:15 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-89398afa-284a-4f79-8401-4a2f4023e0fd tempest-CreateVolumesFromImageTest-260207281 None] Created reservations ['954fda86-7f3f-4171-8b64-4a6db7191834', 'e12b91ae-f93b-4edc-b4c1-6d8d0b8b16ae', '33f7c2fc-157d-4a0b-b884-d98418350676', '0bfcceab-267a-4c63-b959-00e43656c716'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:48:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-89398afa-284a-4f79-8401-4a2f4023e0fd tempest-CreateVolumesFromImageTest-260207281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-89398afa-284a-4f79-8401-4a2f4023e0fd tempest-CreateVolumesFromImageTest-260207281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:15 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-89398afa-284a-4f79-8401-4a2f4023e0fd tempest-CreateVolumesFromImageTest-260207281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:15 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-89398afa-284a-4f79-8401-4a2f4023e0fd tempest-CreateVolumesFromImageTest-260207281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-89398afa-284a-4f79-8401-4a2f4023e0fd tempest-CreateVolumesFromImageTest-260207281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-89398afa-284a-4f79-8401-4a2f4023e0fd tempest-CreateVolumesFromImageTest-260207281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:15 devstack sudo[101732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:48:15 devstack sudo[101732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:15 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-53eed8df-07c1-42a6-9547-53f1ba5198ba tempest-CreateVolumesFromImageTest-260207281 None] Acquiring lock "cinder-d24072bb-269a-48ec-94f1-c32ec780147f-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:15 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-53eed8df-07c1-42a6-9547-53f1ba5198ba tempest-CreateVolumesFromImageTest-260207281 None] Lock "cinder-d24072bb-269a-48ec-94f1-c32ec780147f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:15 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-53eed8df-07c1-42a6-9547-53f1ba5198ba tempest-CreateVolumesFromImageTest-260207281 None] Acquiring lock "cinder-quobyte-d24072bb-269a-48ec-94f1-c32ec780147f" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:15 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-53eed8df-07c1-42a6-9547-53f1ba5198ba tempest-CreateVolumesFromImageTest-260207281 None] Lock "cinder-quobyte-d24072bb-269a-48ec-94f1-c32ec780147f" acquired by "delete_volume" :: waited 0.033s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:15 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b6d34b-ce96-4830-8ad2-ed766002588f]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-53eed8df-07c1-42a6-9547-53f1ba5198ba tempest-CreateVolumesFromImageTest-260207281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d24072bb-269a-48ec-94f1-c32ec780147f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:16 devstack sudo[101732]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-89398afa-284a-4f79-8401-4a2f4023e0fd tempest-CreateVolumesFromImageTest-260207281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.739s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:16 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-89398afa-284a-4f79-8401-4a2f4023e0fd tempest-CreateVolumesFromImageTest-260207281 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:48:16 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-89398afa-284a-4f79-8401-4a2f4023e0fd tempest-CreateVolumesFromImageTest-260207281 None] Deleted volume successfully. Jul 08 01:48:16 devstack sudo[101735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d24072bb-269a-48ec-94f1-c32ec780147f Jul 08 01:48:16 devstack sudo[101735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:16 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-89398afa-284a-4f79-8401-4a2f4023e0fd tempest-CreateVolumesFromImageTest-260207281 None] Lock "cinder-ff80eff0-4673-48d3-80cc-f0761341ad12-delete_volume" released by "delete_volume" :: held 2.574s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:16 devstack sudo[101735]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-53eed8df-07c1-42a6-9547-53f1ba5198ba tempest-CreateVolumesFromImageTest-260207281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d24072bb-269a-48ec-94f1-c32ec780147f" returned: 0 in 0.923s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-53eed8df-07c1-42a6-9547-53f1ba5198ba tempest-CreateVolumesFromImageTest-260207281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d24072bb-269a-48ec-94f1-c32ec780147f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:16 devstack sudo[101740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d24072bb-269a-48ec-94f1-c32ec780147f Jul 08 01:48:16 devstack sudo[101740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:17 devstack sudo[101740]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-53eed8df-07c1-42a6-9547-53f1ba5198ba tempest-CreateVolumesFromImageTest-260207281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d24072bb-269a-48ec-94f1-c32ec780147f" returned: 0 in 0.853s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:17 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-53eed8df-07c1-42a6-9547-53f1ba5198ba tempest-CreateVolumesFromImageTest-260207281 None] Lock "cinder-quobyte-d24072bb-269a-48ec-94f1-c32ec780147f" released by "delete_volume" :: held 1.827s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:17 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-53eed8df-07c1-42a6-9547-53f1ba5198ba tempest-CreateVolumesFromImageTest-260207281 None] Created reservations ['577ba2e3-12b5-4c82-97a4-f7f73dadc085', 'd55d57ed-d202-4e57-977d-03555adf7cd4', 'cddf1b6b-88ea-4fb6-bcec-62347db57575', '4ba840d9-4e3e-4c0e-b39a-c74c5046c559'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:48:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-53eed8df-07c1-42a6-9547-53f1ba5198ba tempest-CreateVolumesFromImageTest-260207281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-53eed8df-07c1-42a6-9547-53f1ba5198ba tempest-CreateVolumesFromImageTest-260207281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:17 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-53eed8df-07c1-42a6-9547-53f1ba5198ba tempest-CreateVolumesFromImageTest-260207281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:17 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-53eed8df-07c1-42a6-9547-53f1ba5198ba tempest-CreateVolumesFromImageTest-260207281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-53eed8df-07c1-42a6-9547-53f1ba5198ba tempest-CreateVolumesFromImageTest-260207281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-53eed8df-07c1-42a6-9547-53f1ba5198ba tempest-CreateVolumesFromImageTest-260207281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:18 devstack sudo[101743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:48:18 devstack sudo[101743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:18 devstack sudo[101743]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-53eed8df-07c1-42a6-9547-53f1ba5198ba tempest-CreateVolumesFromImageTest-260207281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.809s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:18 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-53eed8df-07c1-42a6-9547-53f1ba5198ba tempest-CreateVolumesFromImageTest-260207281 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:48:18 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-53eed8df-07c1-42a6-9547-53f1ba5198ba tempest-CreateVolumesFromImageTest-260207281 None] Deleted volume successfully. Jul 08 01:48:18 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-53eed8df-07c1-42a6-9547-53f1ba5198ba tempest-CreateVolumesFromImageTest-260207281 None] Lock "cinder-d24072bb-269a-48ec-94f1-c32ec780147f-delete_volume" released by "delete_volume" :: held 3.005s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:21 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-350ad03e-1f63-46ad-bebf-bd74148cf5e5 tempest-CinderUnicodeTest-858400234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:48:21 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-350ad03e-1f63-46ad-bebf-bd74148cf5e5 tempest-CinderUnicodeTest-858400234 None] Flow 'volume_create_manager' (1867f790-3a26-4960-870c-bd5bac7f12cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:48:21 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-350ad03e-1f63-46ad-bebf-bd74148cf5e5 tempest-CinderUnicodeTest-858400234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d09855e4-255f-4465-a5b2-71750d031d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:21 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-350ad03e-1f63-46ad-bebf-bd74148cf5e5 tempest-CinderUnicodeTest-858400234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d09855e4-255f-4465-a5b2-71750d031d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97478413-b4a8-43f9-9f6c-2e1e61c55a8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59749eb03ff44cbf9fbb6a7fc1371ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:48:21Z,use_quota=True,user_id='bd7fe7326ef446248966448d1ed11764',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:21 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-350ad03e-1f63-46ad-bebf-bd74148cf5e5 tempest-CinderUnicodeTest-858400234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca35de6-9f04-44bf-9da1-71ef1ffcdeb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:21 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-350ad03e-1f63-46ad-bebf-bd74148cf5e5 tempest-CinderUnicodeTest-858400234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca35de6-9f04-44bf-9da1-71ef1ffcdeb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:21 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-350ad03e-1f63-46ad-bebf-bd74148cf5e5 tempest-CinderUnicodeTest-858400234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481353aa-c0e4-4bab-b82b-723fc0cfda61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:21 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-350ad03e-1f63-46ad-bebf-bd74148cf5e5 tempest-CinderUnicodeTest-858400234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481353aa-c0e4-4bab-b82b-723fc0cfda61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97478413-b4a8-43f9-9f6c-2e1e61c55a8d', 'volume_name': 'volume-97478413-b4a8-43f9-9f6c-2e1e61c55a8d', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:21 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-350ad03e-1f63-46ad-bebf-bd74148cf5e5 tempest-CinderUnicodeTest-858400234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65bf307b-7345-46d2-af1d-d386fbd94749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:21 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-350ad03e-1f63-46ad-bebf-bd74148cf5e5 tempest-CinderUnicodeTest-858400234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65bf307b-7345-46d2-af1d-d386fbd94749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:21 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-350ad03e-1f63-46ad-bebf-bd74148cf5e5 tempest-CinderUnicodeTest-858400234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (119a43f6-3e39-4461-b20f-168b228bf730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:21 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-350ad03e-1f63-46ad-bebf-bd74148cf5e5 tempest-CinderUnicodeTest-858400234 None] Volume 97478413-b4a8-43f9-9f6c-2e1e61c55a8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97478413-b4a8-43f9-9f6c-2e1e61c55a8d', 'volume_size': 1} Jul 08 01:48:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-350ad03e-1f63-46ad-bebf-bd74148cf5e5 tempest-CinderUnicodeTest-858400234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-350ad03e-1f63-46ad-bebf-bd74148cf5e5 tempest-CinderUnicodeTest-858400234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:21 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-350ad03e-1f63-46ad-bebf-bd74148cf5e5 tempest-CinderUnicodeTest-858400234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97478413-b4a8-43f9-9f6c-2e1e61c55a8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59749eb03ff44cbf9fbb6a7fc1371ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:48:21Z,use_quota=True,user_id='bd7fe7326ef446248966448d1ed11764',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:48:21 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-350ad03e-1f63-46ad-bebf-bd74148cf5e5 tempest-CinderUnicodeTest-858400234 None] Creating volume 97478413-b4a8-43f9-9f6c-2e1e61c55a8d {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:48:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-350ad03e-1f63-46ad-bebf-bd74148cf5e5 tempest-CinderUnicodeTest-858400234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-350ad03e-1f63-46ad-bebf-bd74148cf5e5 tempest-CinderUnicodeTest-858400234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:21 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-350ad03e-1f63-46ad-bebf-bd74148cf5e5 tempest-CinderUnicodeTest-858400234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:21 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-350ad03e-1f63-46ad-bebf-bd74148cf5e5 tempest-CinderUnicodeTest-858400234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-350ad03e-1f63-46ad-bebf-bd74148cf5e5 tempest-CinderUnicodeTest-858400234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:21 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-350ad03e-1f63-46ad-bebf-bd74148cf5e5 tempest-CinderUnicodeTest-858400234 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:48:21 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-350ad03e-1f63-46ad-bebf-bd74148cf5e5 tempest-CinderUnicodeTest-858400234 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:48:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-350ad03e-1f63-46ad-bebf-bd74148cf5e5 tempest-CinderUnicodeTest-858400234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-97478413-b4a8-43f9-9f6c-2e1e61c55a8d 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:21 devstack sudo[101746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-97478413-b4a8-43f9-9f6c-2e1e61c55a8d 1073741824 Jul 08 01:48:21 devstack sudo[101746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:22 devstack sudo[101746]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-350ad03e-1f63-46ad-bebf-bd74148cf5e5 tempest-CinderUnicodeTest-858400234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-97478413-b4a8-43f9-9f6c-2e1e61c55a8d 1073741824" returned: 0 in 0.953s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-350ad03e-1f63-46ad-bebf-bd74148cf5e5 tempest-CinderUnicodeTest-858400234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-97478413-b4a8-43f9-9f6c-2e1e61c55a8d {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:22 devstack sudo[101752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-97478413-b4a8-43f9-9f6c-2e1e61c55a8d Jul 08 01:48:22 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:23 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-350ad03e-1f63-46ad-bebf-bd74148cf5e5 tempest-CinderUnicodeTest-858400234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-97478413-b4a8-43f9-9f6c-2e1e61c55a8d" returned: 0 in 0.691s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:23 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-350ad03e-1f63-46ad-bebf-bd74148cf5e5 tempest-CinderUnicodeTest-858400234 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:48:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-350ad03e-1f63-46ad-bebf-bd74148cf5e5 tempest-CinderUnicodeTest-858400234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:23 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-350ad03e-1f63-46ad-bebf-bd74148cf5e5 tempest-CinderUnicodeTest-858400234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (119a43f6-3e39-4461-b20f-168b228bf730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97478413-b4a8-43f9-9f6c-2e1e61c55a8d', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:23 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-350ad03e-1f63-46ad-bebf-bd74148cf5e5 tempest-CinderUnicodeTest-858400234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7379707-9f05-4862-a3af-864d8ecc9a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:23 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-350ad03e-1f63-46ad-bebf-bd74148cf5e5 tempest-CinderUnicodeTest-858400234 None] Volume volume-97478413-b4a8-43f9-9f6c-2e1e61c55a8d (97478413-b4a8-43f9-9f6c-2e1e61c55a8d): created successfully Jul 08 01:48:23 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-350ad03e-1f63-46ad-bebf-bd74148cf5e5 tempest-CinderUnicodeTest-858400234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7379707-9f05-4862-a3af-864d8ecc9a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:23 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-350ad03e-1f63-46ad-bebf-bd74148cf5e5 tempest-CinderUnicodeTest-858400234 None] Flow 'volume_create_manager' (1867f790-3a26-4960-870c-bd5bac7f12cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:48:23 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-350ad03e-1f63-46ad-bebf-bd74148cf5e5 tempest-CinderUnicodeTest-858400234 None] Created volume successfully. Jul 08 01:48:24 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-453e2963-6904-49de-88f2-83fde3c80933 tempest-CinderUnicodeTest-858400234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:48:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-453e2963-6904-49de-88f2-83fde3c80933 tempest-CinderUnicodeTest-858400234 None] Flow 'volume_create_manager' (69908f2a-c2cd-4187-b29a-8bffe11cfc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:48:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-453e2963-6904-49de-88f2-83fde3c80933 tempest-CinderUnicodeTest-858400234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b2c1d40-8131-46de-81b7-7256a17d040d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-453e2963-6904-49de-88f2-83fde3c80933 tempest-CinderUnicodeTest-858400234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b2c1d40-8131-46de-81b7-7256a17d040d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:48:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1860908949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec00dd45-49c6-40d1-b24a-e206da1310c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59749eb03ff44cbf9fbb6a7fc1371ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:48:24Z,use_quota=True,user_id='bd7fe7326ef446248966448d1ed11764',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-453e2963-6904-49de-88f2-83fde3c80933 tempest-CinderUnicodeTest-858400234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce3748c7-cbc0-4be1-be16-d588d534eb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-453e2963-6904-49de-88f2-83fde3c80933 tempest-CinderUnicodeTest-858400234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce3748c7-cbc0-4be1-be16-d588d534eb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-453e2963-6904-49de-88f2-83fde3c80933 tempest-CinderUnicodeTest-858400234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1bbd0eb-1945-47ac-9d7c-3325361bdaa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-453e2963-6904-49de-88f2-83fde3c80933 tempest-CinderUnicodeTest-858400234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1bbd0eb-1945-47ac-9d7c-3325361bdaa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec00dd45-49c6-40d1-b24a-e206da1310c0', 'volume_name': 'volume-ec00dd45-49c6-40d1-b24a-e206da1310c0', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-453e2963-6904-49de-88f2-83fde3c80933 tempest-CinderUnicodeTest-858400234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bca85cb7-54da-4480-aac4-ac585dacc67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-453e2963-6904-49de-88f2-83fde3c80933 tempest-CinderUnicodeTest-858400234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bca85cb7-54da-4480-aac4-ac585dacc67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-453e2963-6904-49de-88f2-83fde3c80933 tempest-CinderUnicodeTest-858400234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ce4b5b-005a-408d-ab2c-507caf5f25ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:24 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-453e2963-6904-49de-88f2-83fde3c80933 tempest-CinderUnicodeTest-858400234 None] Volume ec00dd45-49c6-40d1-b24a-e206da1310c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec00dd45-49c6-40d1-b24a-e206da1310c0', 'volume_size': 1} Jul 08 01:48:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-453e2963-6904-49de-88f2-83fde3c80933 tempest-CinderUnicodeTest-858400234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-453e2963-6904-49de-88f2-83fde3c80933 tempest-CinderUnicodeTest-858400234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:24 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-453e2963-6904-49de-88f2-83fde3c80933 tempest-CinderUnicodeTest-858400234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:48:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1860908949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec00dd45-49c6-40d1-b24a-e206da1310c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59749eb03ff44cbf9fbb6a7fc1371ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:48:24Z,use_quota=True,user_id='bd7fe7326ef446248966448d1ed11764',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:48:24 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-453e2963-6904-49de-88f2-83fde3c80933 tempest-CinderUnicodeTest-858400234 None] Creating volume ec00dd45-49c6-40d1-b24a-e206da1310c0 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:48:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-453e2963-6904-49de-88f2-83fde3c80933 tempest-CinderUnicodeTest-858400234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-453e2963-6904-49de-88f2-83fde3c80933 tempest-CinderUnicodeTest-858400234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:24 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-453e2963-6904-49de-88f2-83fde3c80933 tempest-CinderUnicodeTest-858400234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:24 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-453e2963-6904-49de-88f2-83fde3c80933 tempest-CinderUnicodeTest-858400234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-453e2963-6904-49de-88f2-83fde3c80933 tempest-CinderUnicodeTest-858400234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:24 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-453e2963-6904-49de-88f2-83fde3c80933 tempest-CinderUnicodeTest-858400234 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:48:24 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-453e2963-6904-49de-88f2-83fde3c80933 tempest-CinderUnicodeTest-858400234 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:48:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-453e2963-6904-49de-88f2-83fde3c80933 tempest-CinderUnicodeTest-858400234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:24 devstack sudo[101755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0 1073741824 Jul 08 01:48:24 devstack sudo[101755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:25 devstack sudo[101755]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-453e2963-6904-49de-88f2-83fde3c80933 tempest-CinderUnicodeTest-858400234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0 1073741824" returned: 0 in 0.955s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-453e2963-6904-49de-88f2-83fde3c80933 tempest-CinderUnicodeTest-858400234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:25 devstack sudo[101762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0 Jul 08 01:48:25 devstack sudo[101762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:26 devstack sudo[101762]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-453e2963-6904-49de-88f2-83fde3c80933 tempest-CinderUnicodeTest-858400234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0" returned: 0 in 0.717s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:26 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-453e2963-6904-49de-88f2-83fde3c80933 tempest-CinderUnicodeTest-858400234 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:48:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-453e2963-6904-49de-88f2-83fde3c80933 tempest-CinderUnicodeTest-858400234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.734s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-453e2963-6904-49de-88f2-83fde3c80933 tempest-CinderUnicodeTest-858400234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ce4b5b-005a-408d-ab2c-507caf5f25ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec00dd45-49c6-40d1-b24a-e206da1310c0', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-453e2963-6904-49de-88f2-83fde3c80933 tempest-CinderUnicodeTest-858400234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2db39ee-3571-473e-92b6-2762e613892f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:26 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-453e2963-6904-49de-88f2-83fde3c80933 tempest-CinderUnicodeTest-858400234 None] Volume volume-ec00dd45-49c6-40d1-b24a-e206da1310c0 (ec00dd45-49c6-40d1-b24a-e206da1310c0): created successfully Jul 08 01:48:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-453e2963-6904-49de-88f2-83fde3c80933 tempest-CinderUnicodeTest-858400234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2db39ee-3571-473e-92b6-2762e613892f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-453e2963-6904-49de-88f2-83fde3c80933 tempest-CinderUnicodeTest-858400234 None] Flow 'volume_create_manager' (69908f2a-c2cd-4187-b29a-8bffe11cfc89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:48:26 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-453e2963-6904-49de-88f2-83fde3c80933 tempest-CinderUnicodeTest-858400234 None] Created volume successfully. Jul 08 01:48:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-bb00a9f1-b60a-4a21-a4cc-73868c6c5442 tempest-CinderUnicodeTest-858400234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-bb00a9f1-b60a-4a21-a4cc-73868c6c5442 tempest-CinderUnicodeTest-858400234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:26 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-bb00a9f1-b60a-4a21-a4cc-73868c6c5442 tempest-CinderUnicodeTest-858400234 None] Creating offline snapshot 414b5005-6d89-4ad0-b3bf-9854cbf0918d of volume ec00dd45-49c6-40d1-b24a-e206da1310c0 {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:48:26 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a8a7b9-be1f-4ce5-8f77-6806fc258fef]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-bb00a9f1-b60a-4a21-a4cc-73868c6c5442 tempest-CinderUnicodeTest-858400234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:26 devstack sudo[101768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0 Jul 08 01:48:26 devstack sudo[101768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:27 devstack sudo[101768]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-bb00a9f1-b60a-4a21-a4cc-73868c6c5442 tempest-CinderUnicodeTest-858400234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0" returned: 0 in 0.908s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-bb00a9f1-b60a-4a21-a4cc-73868c6c5442 tempest-CinderUnicodeTest-858400234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0.414b5005-6d89-4ad0-b3bf-9854cbf0918d 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:27 devstack sudo[101776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0.414b5005-6d89-4ad0-b3bf-9854cbf0918d 1G Jul 08 01:48:27 devstack sudo[101776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:28 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-580d6311-b71b-4382-8c70-1c9fc5ed7e0b tempest-VolumesActionsTest-1890167577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:48:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-580d6311-b71b-4382-8c70-1c9fc5ed7e0b tempest-VolumesActionsTest-1890167577 None] Flow 'volume_create_manager' (809ff8bf-cb52-4f0a-8c25-7b3a03bce581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:48:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-580d6311-b71b-4382-8c70-1c9fc5ed7e0b tempest-VolumesActionsTest-1890167577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f7193c3-a969-40c5-bcd0-c504637d1809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-580d6311-b71b-4382-8c70-1c9fc5ed7e0b tempest-VolumesActionsTest-1890167577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f7193c3-a969-40c5-bcd0-c504637d1809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-530974344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e7e39c6-bc35-44a7-ba0c-3135a1270829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42e9994b7344478f9a4218e61b0c667f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:48:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:48:28Z,use_quota=True,user_id='ef684abddcf840edad0cd07340fcec8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-580d6311-b71b-4382-8c70-1c9fc5ed7e0b tempest-VolumesActionsTest-1890167577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa65b537-e4df-48a9-b00a-f79721d41674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-580d6311-b71b-4382-8c70-1c9fc5ed7e0b tempest-VolumesActionsTest-1890167577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa65b537-e4df-48a9-b00a-f79721d41674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-580d6311-b71b-4382-8c70-1c9fc5ed7e0b tempest-VolumesActionsTest-1890167577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c7934d-aed5-4d49-9347-6c4253b402b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-580d6311-b71b-4382-8c70-1c9fc5ed7e0b tempest-VolumesActionsTest-1890167577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c7934d-aed5-4d49-9347-6c4253b402b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e7e39c6-bc35-44a7-ba0c-3135a1270829', 'volume_name': 'volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-580d6311-b71b-4382-8c70-1c9fc5ed7e0b tempest-VolumesActionsTest-1890167577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1429751-b665-4f75-9fb9-cad0439ff7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-580d6311-b71b-4382-8c70-1c9fc5ed7e0b tempest-VolumesActionsTest-1890167577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1429751-b665-4f75-9fb9-cad0439ff7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-580d6311-b71b-4382-8c70-1c9fc5ed7e0b tempest-VolumesActionsTest-1890167577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c66b8f3c-189b-45ee-9b93-9fcb892bcc07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:28 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-580d6311-b71b-4382-8c70-1c9fc5ed7e0b tempest-VolumesActionsTest-1890167577 None] Volume 0e7e39c6-bc35-44a7-ba0c-3135a1270829: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829', 'volume_size': 1} Jul 08 01:48:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-580d6311-b71b-4382-8c70-1c9fc5ed7e0b tempest-VolumesActionsTest-1890167577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:28 devstack sudo[101776]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-bb00a9f1-b60a-4a21-a4cc-73868c6c5442 tempest-CinderUnicodeTest-858400234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0.414b5005-6d89-4ad0-b3bf-9854cbf0918d 1G" returned: 0 in 1.030s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-bb00a9f1-b60a-4a21-a4cc-73868c6c5442 tempest-CinderUnicodeTest-858400234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec00dd45-49c6-40d1-b24a-e206da1310c0 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0.414b5005-6d89-4ad0-b3bf-9854cbf0918d {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:28 devstack sudo[101781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec00dd45-49c6-40d1-b24a-e206da1310c0 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0.414b5005-6d89-4ad0-b3bf-9854cbf0918d Jul 08 01:48:28 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:29 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-bb00a9f1-b60a-4a21-a4cc-73868c6c5442 tempest-CinderUnicodeTest-858400234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec00dd45-49c6-40d1-b24a-e206da1310c0 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0.414b5005-6d89-4ad0-b3bf-9854cbf0918d" returned: 0 in 0.729s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:29 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-bb00a9f1-b60a-4a21-a4cc-73868c6c5442 tempest-CinderUnicodeTest-858400234 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0.414b5005-6d89-4ad0-b3bf-9854cbf0918d is being set with open permissions: ugo+rw Jul 08 01:48:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-bb00a9f1-b60a-4a21-a4cc-73868c6c5442 tempest-CinderUnicodeTest-858400234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0.414b5005-6d89-4ad0-b3bf-9854cbf0918d {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:29 devstack sudo[101786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0.414b5005-6d89-4ad0-b3bf-9854cbf0918d Jul 08 01:48:29 devstack sudo[101786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:30 devstack sudo[101786]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-bb00a9f1-b60a-4a21-a4cc-73868c6c5442 tempest-CinderUnicodeTest-858400234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0.414b5005-6d89-4ad0-b3bf-9854cbf0918d" returned: 0 in 0.743s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-bb00a9f1-b60a-4a21-a4cc-73868c6c5442 tempest-CinderUnicodeTest-858400234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:30 devstack sudo[101789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0.info Jul 08 01:48:30 devstack sudo[101789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:30 devstack sudo[101789]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-bb00a9f1-b60a-4a21-a4cc-73868c6c5442 tempest-CinderUnicodeTest-858400234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0.info" returned: 0 in 0.702s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:30 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-bb00a9f1-b60a-4a21-a4cc-73868c6c5442 tempest-CinderUnicodeTest-858400234 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0.info is being set with open permissions: ugo+rw Jul 08 01:48:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-bb00a9f1-b60a-4a21-a4cc-73868c6c5442 tempest-CinderUnicodeTest-858400234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:30 devstack sudo[101792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0.info Jul 08 01:48:30 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:31 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-bb00a9f1-b60a-4a21-a4cc-73868c6c5442 tempest-CinderUnicodeTest-858400234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0.info" returned: 0 in 0.714s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-bb00a9f1-b60a-4a21-a4cc-73868c6c5442 tempest-CinderUnicodeTest-858400234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.935s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-580d6311-b71b-4382-8c70-1c9fc5ed7e0b tempest-VolumesActionsTest-1890167577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.493s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:31 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-580d6311-b71b-4382-8c70-1c9fc5ed7e0b tempest-VolumesActionsTest-1890167577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-530974344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e7e39c6-bc35-44a7-ba0c-3135a1270829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42e9994b7344478f9a4218e61b0c667f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:48:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:48:28Z,use_quota=True,user_id='ef684abddcf840edad0cd07340fcec8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:48:31 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-580d6311-b71b-4382-8c70-1c9fc5ed7e0b tempest-VolumesActionsTest-1890167577 None] Creating volume 0e7e39c6-bc35-44a7-ba0c-3135a1270829 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:48:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-580d6311-b71b-4382-8c70-1c9fc5ed7e0b tempest-VolumesActionsTest-1890167577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-580d6311-b71b-4382-8c70-1c9fc5ed7e0b tempest-VolumesActionsTest-1890167577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:31 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-580d6311-b71b-4382-8c70-1c9fc5ed7e0b tempest-VolumesActionsTest-1890167577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:31 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-580d6311-b71b-4382-8c70-1c9fc5ed7e0b tempest-VolumesActionsTest-1890167577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-580d6311-b71b-4382-8c70-1c9fc5ed7e0b tempest-VolumesActionsTest-1890167577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:31 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-580d6311-b71b-4382-8c70-1c9fc5ed7e0b tempest-VolumesActionsTest-1890167577 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:48:31 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-580d6311-b71b-4382-8c70-1c9fc5ed7e0b tempest-VolumesActionsTest-1890167577 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:48:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-580d6311-b71b-4382-8c70-1c9fc5ed7e0b tempest-VolumesActionsTest-1890167577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:31 devstack sudo[101795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829 1073741824 Jul 08 01:48:31 devstack sudo[101795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:31 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-bb00a9f1-b60a-4a21-a4cc-73868c6c5442 tempest-CinderUnicodeTest-858400234 None] Create snapshot completed successfully Jul 08 01:48:32 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6abe9bea-e58d-45a0-acbd-1118c33815f8 tempest-CinderUnicodeTest-858400234 None] Acquiring lock "cinder-414b5005-6d89-4ad0-b3bf-9854cbf0918d-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:32 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6abe9bea-e58d-45a0-acbd-1118c33815f8 tempest-CinderUnicodeTest-858400234 None] Lock "cinder-414b5005-6d89-4ad0-b3bf-9854cbf0918d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:32 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6abe9bea-e58d-45a0-acbd-1118c33815f8 tempest-CinderUnicodeTest-858400234 None] Acquiring lock "cinder-quobyte-ec00dd45-49c6-40d1-b24a-e206da1310c0" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:32 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6abe9bea-e58d-45a0-acbd-1118c33815f8 tempest-CinderUnicodeTest-858400234 None] Lock "cinder-quobyte-ec00dd45-49c6-40d1-b24a-e206da1310c0" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:32 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6abe9bea-e58d-45a0-acbd-1118c33815f8 tempest-CinderUnicodeTest-858400234 None] Acquiring lock "cinder-quobyte-414b5005-6d89-4ad0-b3bf-9854cbf0918d" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:32 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6abe9bea-e58d-45a0-acbd-1118c33815f8 tempest-CinderUnicodeTest-858400234 None] Lock "cinder-quobyte-414b5005-6d89-4ad0-b3bf-9854cbf0918d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:32 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-6abe9bea-e58d-45a0-acbd-1118c33815f8 tempest-CinderUnicodeTest-858400234 None] Deleting offline snapshot 414b5005-6d89-4ad0-b3bf-9854cbf0918d of volume ec00dd45-49c6-40d1-b24a-e206da1310c0 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:48:32 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-6abe9bea-e58d-45a0-acbd-1118c33815f8 tempest-CinderUnicodeTest-858400234 None] snapshot_file for this snap is: volume-ec00dd45-49c6-40d1-b24a-e206da1310c0.414b5005-6d89-4ad0-b3bf-9854cbf0918d {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:48:32 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[93264f7b-2c88-4a7c-9617-b40f0f3892b1]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6abe9bea-e58d-45a0-acbd-1118c33815f8 tempest-CinderUnicodeTest-858400234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0.414b5005-6d89-4ad0-b3bf-9854cbf0918d {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:32 devstack sudo[101797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0.414b5005-6d89-4ad0-b3bf-9854cbf0918d Jul 08 01:48:32 devstack sudo[101797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:32 devstack sudo[101795]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-580d6311-b71b-4382-8c70-1c9fc5ed7e0b tempest-VolumesActionsTest-1890167577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829 1073741824" returned: 0 in 1.046s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-580d6311-b71b-4382-8c70-1c9fc5ed7e0b tempest-VolumesActionsTest-1890167577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:32 devstack sudo[101802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829 Jul 08 01:48:32 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:33 devstack sudo[101797]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6abe9bea-e58d-45a0-acbd-1118c33815f8 tempest-CinderUnicodeTest-858400234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0.414b5005-6d89-4ad0-b3bf-9854cbf0918d" returned: 0 in 0.895s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:33 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-6abe9bea-e58d-45a0-acbd-1118c33815f8 tempest-CinderUnicodeTest-858400234 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec00dd45-49c6-40d1-b24a-e206da1310c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:48:33 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[498aa748-430b-4f01-be16-9a6c8acc9acd]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6abe9bea-e58d-45a0-acbd-1118c33815f8 tempest-CinderUnicodeTest-858400234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:33 devstack sudo[101807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0 Jul 08 01:48:33 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:33 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-580d6311-b71b-4382-8c70-1c9fc5ed7e0b tempest-VolumesActionsTest-1890167577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829" returned: 0 in 0.653s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:33 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-580d6311-b71b-4382-8c70-1c9fc5ed7e0b tempest-VolumesActionsTest-1890167577 None] <== create_volume: return (1754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:48:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-580d6311-b71b-4382-8c70-1c9fc5ed7e0b tempest-VolumesActionsTest-1890167577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.757s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:33 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-580d6311-b71b-4382-8c70-1c9fc5ed7e0b tempest-VolumesActionsTest-1890167577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c66b8f3c-189b-45ee-9b93-9fcb892bcc07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:33 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-580d6311-b71b-4382-8c70-1c9fc5ed7e0b tempest-VolumesActionsTest-1890167577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec89e149-8422-4085-8854-19af3328ca06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:33 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-580d6311-b71b-4382-8c70-1c9fc5ed7e0b tempest-VolumesActionsTest-1890167577 None] Volume volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829 (0e7e39c6-bc35-44a7-ba0c-3135a1270829): created successfully Jul 08 01:48:33 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-580d6311-b71b-4382-8c70-1c9fc5ed7e0b tempest-VolumesActionsTest-1890167577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec89e149-8422-4085-8854-19af3328ca06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:33 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-580d6311-b71b-4382-8c70-1c9fc5ed7e0b tempest-VolumesActionsTest-1890167577 None] Flow 'volume_create_manager' (809ff8bf-cb52-4f0a-8c25-7b3a03bce581) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:48:33 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-580d6311-b71b-4382-8c70-1c9fc5ed7e0b tempest-VolumesActionsTest-1890167577 None] Created volume successfully. Jul 08 01:48:33 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6abe9bea-e58d-45a0-acbd-1118c33815f8 tempest-CinderUnicodeTest-858400234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0" returned: 0 in 0.820s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6abe9bea-e58d-45a0-acbd-1118c33815f8 tempest-CinderUnicodeTest-858400234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0.414b5005-6d89-4ad0-b3bf-9854cbf0918d {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:33 devstack sudo[101813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0.414b5005-6d89-4ad0-b3bf-9854cbf0918d Jul 08 01:48:33 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:34 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6abe9bea-e58d-45a0-acbd-1118c33815f8 tempest-CinderUnicodeTest-858400234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0.414b5005-6d89-4ad0-b3bf-9854cbf0918d" returned: 0 in 0.811s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6abe9bea-e58d-45a0-acbd-1118c33815f8 tempest-CinderUnicodeTest-858400234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0.414b5005-6d89-4ad0-b3bf-9854cbf0918d {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:34 devstack sudo[101819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0.414b5005-6d89-4ad0-b3bf-9854cbf0918d Jul 08 01:48:34 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:35 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6abe9bea-e58d-45a0-acbd-1118c33815f8 tempest-CinderUnicodeTest-858400234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0.414b5005-6d89-4ad0-b3bf-9854cbf0918d" returned: 0 in 0.674s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:35 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6abe9bea-e58d-45a0-acbd-1118c33815f8 tempest-CinderUnicodeTest-858400234 None] Lock "cinder-quobyte-414b5005-6d89-4ad0-b3bf-9854cbf0918d" released by "_delete_snapshot" :: held 3.350s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:35 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6abe9bea-e58d-45a0-acbd-1118c33815f8 tempest-CinderUnicodeTest-858400234 None] Lock "cinder-quobyte-ec00dd45-49c6-40d1-b24a-e206da1310c0" released by "delete_snapshot" :: held 3.378s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:35 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-6abe9bea-e58d-45a0-acbd-1118c33815f8 tempest-CinderUnicodeTest-858400234 None] Created reservations ['1dfe27f7-bdd1-4990-ab8b-cc7172d65244', '15332ebd-2e8e-4820-bd2f-8d951ba79d96', '56faa0cf-26d8-4250-8daa-3fa5d61d3a06', '097dace2-92f4-4aa4-ae43-ee1cdecdc261'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:48:35 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-6abe9bea-e58d-45a0-acbd-1118c33815f8 tempest-CinderUnicodeTest-858400234 None] Delete snapshot completed successfully. Jul 08 01:48:35 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6abe9bea-e58d-45a0-acbd-1118c33815f8 tempest-CinderUnicodeTest-858400234 None] Lock "cinder-414b5005-6d89-4ad0-b3bf-9854cbf0918d-delete_snapshot" released by "delete_snapshot" :: held 3.556s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:36 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-df12e5e7-e533-4e97-ac73-7a147cc4c562 tempest-CinderUnicodeTest-858400234 None] Acquiring lock "cinder-ec00dd45-49c6-40d1-b24a-e206da1310c0-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:36 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-df12e5e7-e533-4e97-ac73-7a147cc4c562 tempest-CinderUnicodeTest-858400234 None] Lock "cinder-ec00dd45-49c6-40d1-b24a-e206da1310c0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:36 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-df12e5e7-e533-4e97-ac73-7a147cc4c562 tempest-CinderUnicodeTest-858400234 None] Acquiring lock "cinder-quobyte-ec00dd45-49c6-40d1-b24a-e206da1310c0" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:36 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-df12e5e7-e533-4e97-ac73-7a147cc4c562 tempest-CinderUnicodeTest-858400234 None] Lock "cinder-quobyte-ec00dd45-49c6-40d1-b24a-e206da1310c0" acquired by "delete_volume" :: waited 0.026s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:36 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[b108346b-caec-45d1-bdca-60a9c8eb5569]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-df12e5e7-e533-4e97-ac73-7a147cc4c562 tempest-CinderUnicodeTest-858400234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:36 devstack sudo[101860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0 Jul 08 01:48:36 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:37 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-df12e5e7-e533-4e97-ac73-7a147cc4c562 tempest-CinderUnicodeTest-858400234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0" returned: 0 in 0.862s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-df12e5e7-e533-4e97-ac73-7a147cc4c562 tempest-CinderUnicodeTest-858400234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:37 devstack sudo[101867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0 Jul 08 01:48:37 devstack sudo[101867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:38 devstack sudo[101867]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-df12e5e7-e533-4e97-ac73-7a147cc4c562 tempest-CinderUnicodeTest-858400234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ec00dd45-49c6-40d1-b24a-e206da1310c0" returned: 0 in 0.704s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:38 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-df12e5e7-e533-4e97-ac73-7a147cc4c562 tempest-CinderUnicodeTest-858400234 None] Lock "cinder-quobyte-ec00dd45-49c6-40d1-b24a-e206da1310c0" released by "delete_volume" :: held 1.637s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:38 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-df12e5e7-e533-4e97-ac73-7a147cc4c562 tempest-CinderUnicodeTest-858400234 None] Created reservations ['1e70f4bd-9b41-451b-9619-0263b906bc3f', 'abb7bd5f-bbf9-4b5c-9608-ac2c4883ae23', '88c7c79e-a211-4437-adf4-4d8cf2d8ce04', '71a500bc-750b-440b-b482-ab09a8289c25'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:48:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-df12e5e7-e533-4e97-ac73-7a147cc4c562 tempest-CinderUnicodeTest-858400234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-df12e5e7-e533-4e97-ac73-7a147cc4c562 tempest-CinderUnicodeTest-858400234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:38 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-df12e5e7-e533-4e97-ac73-7a147cc4c562 tempest-CinderUnicodeTest-858400234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:38 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-df12e5e7-e533-4e97-ac73-7a147cc4c562 tempest-CinderUnicodeTest-858400234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-df12e5e7-e533-4e97-ac73-7a147cc4c562 tempest-CinderUnicodeTest-858400234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-df12e5e7-e533-4e97-ac73-7a147cc4c562 tempest-CinderUnicodeTest-858400234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:38 devstack sudo[101870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:48:38 devstack sudo[101870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:38 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-dfbeae39-9398-4c63-aa80-f653d4133a61 tempest-CinderUnicodeTest-858400234 None] Acquiring lock "cinder-97478413-b4a8-43f9-9f6c-2e1e61c55a8d-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:38 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-dfbeae39-9398-4c63-aa80-f653d4133a61 tempest-CinderUnicodeTest-858400234 None] Lock "cinder-97478413-b4a8-43f9-9f6c-2e1e61c55a8d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:38 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-dfbeae39-9398-4c63-aa80-f653d4133a61 tempest-CinderUnicodeTest-858400234 None] Acquiring lock "cinder-quobyte-97478413-b4a8-43f9-9f6c-2e1e61c55a8d" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:38 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-dfbeae39-9398-4c63-aa80-f653d4133a61 tempest-CinderUnicodeTest-858400234 None] Lock "cinder-quobyte-97478413-b4a8-43f9-9f6c-2e1e61c55a8d" acquired by "delete_volume" :: waited 0.021s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:38 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e943757-16c3-4353-a74b-abc88cea76c9]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-dfbeae39-9398-4c63-aa80-f653d4133a61 tempest-CinderUnicodeTest-858400234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-97478413-b4a8-43f9-9f6c-2e1e61c55a8d {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:38 devstack sudo[101872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-97478413-b4a8-43f9-9f6c-2e1e61c55a8d Jul 08 01:48:38 devstack sudo[101872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:38 devstack sudo[101870]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-df12e5e7-e533-4e97-ac73-7a147cc4c562 tempest-CinderUnicodeTest-858400234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.762s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:38 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-df12e5e7-e533-4e97-ac73-7a147cc4c562 tempest-CinderUnicodeTest-858400234 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:48:38 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-df12e5e7-e533-4e97-ac73-7a147cc4c562 tempest-CinderUnicodeTest-858400234 None] Deleted volume successfully. Jul 08 01:48:38 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-df12e5e7-e533-4e97-ac73-7a147cc4c562 tempest-CinderUnicodeTest-858400234 None] Lock "cinder-ec00dd45-49c6-40d1-b24a-e206da1310c0-delete_volume" released by "delete_volume" :: held 2.650s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:39 devstack sudo[101872]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-dfbeae39-9398-4c63-aa80-f653d4133a61 tempest-CinderUnicodeTest-858400234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-97478413-b4a8-43f9-9f6c-2e1e61c55a8d" returned: 0 in 0.826s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-dfbeae39-9398-4c63-aa80-f653d4133a61 tempest-CinderUnicodeTest-858400234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-97478413-b4a8-43f9-9f6c-2e1e61c55a8d {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:39 devstack sudo[101878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-97478413-b4a8-43f9-9f6c-2e1e61c55a8d Jul 08 01:48:39 devstack sudo[101878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:40 devstack sudo[101878]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-dfbeae39-9398-4c63-aa80-f653d4133a61 tempest-CinderUnicodeTest-858400234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-97478413-b4a8-43f9-9f6c-2e1e61c55a8d" returned: 0 in 0.696s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:40 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-dfbeae39-9398-4c63-aa80-f653d4133a61 tempest-CinderUnicodeTest-858400234 None] Lock "cinder-quobyte-97478413-b4a8-43f9-9f6c-2e1e61c55a8d" released by "delete_volume" :: held 1.568s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:40 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-dfbeae39-9398-4c63-aa80-f653d4133a61 tempest-CinderUnicodeTest-858400234 None] Created reservations ['e700b7ab-88cb-4cc3-88fc-1e449847665d', '6cfed383-fc50-46f4-8eb9-fedcce48594f', '837ddc46-9d51-4485-811f-02effe9fd4c2', '99df611a-b90d-4624-8557-726e9c5c02c4'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:48:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-dfbeae39-9398-4c63-aa80-f653d4133a61 tempest-CinderUnicodeTest-858400234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-dfbeae39-9398-4c63-aa80-f653d4133a61 tempest-CinderUnicodeTest-858400234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:40 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-dfbeae39-9398-4c63-aa80-f653d4133a61 tempest-CinderUnicodeTest-858400234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:40 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-dfbeae39-9398-4c63-aa80-f653d4133a61 tempest-CinderUnicodeTest-858400234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-dfbeae39-9398-4c63-aa80-f653d4133a61 tempest-CinderUnicodeTest-858400234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-dfbeae39-9398-4c63-aa80-f653d4133a61 tempest-CinderUnicodeTest-858400234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:40 devstack sudo[101881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:48:40 devstack sudo[101881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:41 devstack sudo[101881]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-dfbeae39-9398-4c63-aa80-f653d4133a61 tempest-CinderUnicodeTest-858400234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.804s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:41 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-dfbeae39-9398-4c63-aa80-f653d4133a61 tempest-CinderUnicodeTest-858400234 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:48:41 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-dfbeae39-9398-4c63-aa80-f653d4133a61 tempest-CinderUnicodeTest-858400234 None] Deleted volume successfully. Jul 08 01:48:41 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-dfbeae39-9398-4c63-aa80-f653d4133a61 tempest-CinderUnicodeTest-858400234 None] Lock "cinder-97478413-b4a8-43f9-9f6c-2e1e61c55a8d-delete_volume" released by "delete_volume" :: held 2.603s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:50 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=81,cinder:UPDATE=124,cinder:INSERT=27,cinder:DELETE=9 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:48:50 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b44f15c-eed1-480b-95e0-4489291759d5 tempest-ProjectReaderTests-541608025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:48:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2b44f15c-eed1-480b-95e0-4489291759d5 tempest-ProjectReaderTests-541608025 None] Flow 'volume_create_manager' (a0221791-ed13-4347-866d-81e397e5794d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:48:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2b44f15c-eed1-480b-95e0-4489291759d5 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0ee97bb-325c-4304-9425-a9c1e00215a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:50 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=82,cinder:UPDATE=111,cinder:INSERT=30,cinder:DELETE=11 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:48:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2b44f15c-eed1-480b-95e0-4489291759d5 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0ee97bb-325c-4304-9425-a9c1e00215a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-490462990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85d1e33b-8486-4bae-a077-88f443ae8307,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee61bbee804d4edf97228aafc78bd7bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:48:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:48:50Z,use_quota=True,user_id='c4f337979f3941b7b01461a59890b630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2b44f15c-eed1-480b-95e0-4489291759d5 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76153a22-11c3-48eb-92ed-400ccd9c1528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2b44f15c-eed1-480b-95e0-4489291759d5 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76153a22-11c3-48eb-92ed-400ccd9c1528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2b44f15c-eed1-480b-95e0-4489291759d5 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e99fa0a-1a51-49db-8b41-2832f1964478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2b44f15c-eed1-480b-95e0-4489291759d5 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e99fa0a-1a51-49db-8b41-2832f1964478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85d1e33b-8486-4bae-a077-88f443ae8307', 'volume_name': 'volume-85d1e33b-8486-4bae-a077-88f443ae8307', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2b44f15c-eed1-480b-95e0-4489291759d5 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a93441e-fe6e-44b9-943a-671d243df432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2b44f15c-eed1-480b-95e0-4489291759d5 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a93441e-fe6e-44b9-943a-671d243df432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2b44f15c-eed1-480b-95e0-4489291759d5 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88ad0523-f6ab-4867-b6e8-1d82ceb1791a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:50 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-2b44f15c-eed1-480b-95e0-4489291759d5 tempest-ProjectReaderTests-541608025 None] Volume 85d1e33b-8486-4bae-a077-88f443ae8307: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85d1e33b-8486-4bae-a077-88f443ae8307', 'volume_size': 1} Jul 08 01:48:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2b44f15c-eed1-480b-95e0-4489291759d5 tempest-ProjectReaderTests-541608025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2b44f15c-eed1-480b-95e0-4489291759d5 tempest-ProjectReaderTests-541608025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2b44f15c-eed1-480b-95e0-4489291759d5 tempest-ProjectReaderTests-541608025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-490462990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85d1e33b-8486-4bae-a077-88f443ae8307,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee61bbee804d4edf97228aafc78bd7bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:48:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:48:50Z,use_quota=True,user_id='c4f337979f3941b7b01461a59890b630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:48:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-2b44f15c-eed1-480b-95e0-4489291759d5 tempest-ProjectReaderTests-541608025 None] Creating volume 85d1e33b-8486-4bae-a077-88f443ae8307 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:48:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2b44f15c-eed1-480b-95e0-4489291759d5 tempest-ProjectReaderTests-541608025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2b44f15c-eed1-480b-95e0-4489291759d5 tempest-ProjectReaderTests-541608025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2b44f15c-eed1-480b-95e0-4489291759d5 tempest-ProjectReaderTests-541608025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2b44f15c-eed1-480b-95e0-4489291759d5 tempest-ProjectReaderTests-541608025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2b44f15c-eed1-480b-95e0-4489291759d5 tempest-ProjectReaderTests-541608025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2b44f15c-eed1-480b-95e0-4489291759d5 tempest-ProjectReaderTests-541608025 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:48:50 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-2b44f15c-eed1-480b-95e0-4489291759d5 tempest-ProjectReaderTests-541608025 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:48:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2b44f15c-eed1-480b-95e0-4489291759d5 tempest-ProjectReaderTests-541608025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-85d1e33b-8486-4bae-a077-88f443ae8307 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:50 devstack sudo[101969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-85d1e33b-8486-4bae-a077-88f443ae8307 1073741824 Jul 08 01:48:50 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:50 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-a5e91930-8686-47b1-a775-4017849164d2 tempest-VolumesActionsTest-1890167577 None] Acquiring lock "cinder-0e7e39c6-bc35-44a7-ba0c-3135a1270829" by "attach_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:50 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-a5e91930-8686-47b1-a775-4017849164d2 tempest-VolumesActionsTest-1890167577 None] Lock "cinder-0e7e39c6-bc35-44a7-ba0c-3135a1270829" acquired by "attach_volume" :: waited 0.019s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:50 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-a5e91930-8686-47b1-a775-4017849164d2 tempest-VolumesActionsTest-1890167577 None] Attaching volume 0e7e39c6-bc35-44a7-ba0c-3135a1270829 to instance e1092a60-8b30-4139-9822-090160c135d0 at mountpoint /dev/vdb on host None. Jul 08 01:48:50 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-a5e91930-8686-47b1-a775-4017849164d2 tempest-VolumesActionsTest-1890167577 None] Attach volume completed successfully. Jul 08 01:48:50 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-a5e91930-8686-47b1-a775-4017849164d2 tempest-VolumesActionsTest-1890167577 None] Lock "cinder-0e7e39c6-bc35-44a7-ba0c-3135a1270829" released by "attach_volume" :: held 0.113s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:51 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6a3208af-f6ba-4b07-9e38-304abb911422 tempest-VolumesActionsTest-1890167577 None] Acquiring lock "cinder-0e7e39c6-bc35-44a7-ba0c-3135a1270829-detach_volume" by "detach_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:51 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6a3208af-f6ba-4b07-9e38-304abb911422 tempest-VolumesActionsTest-1890167577 None] Lock "cinder-0e7e39c6-bc35-44a7-ba0c-3135a1270829-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:51 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-6a3208af-f6ba-4b07-9e38-304abb911422 tempest-VolumesActionsTest-1890167577 None] Detaching volume 0e7e39c6-bc35-44a7-ba0c-3135a1270829 from instance e1092a60-8b30-4139-9822-090160c135d0. Jul 08 01:48:51 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-6a3208af-f6ba-4b07-9e38-304abb911422 tempest-VolumesActionsTest-1890167577 None] Detach volume completed successfully. Jul 08 01:48:51 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6a3208af-f6ba-4b07-9e38-304abb911422 tempest-VolumesActionsTest-1890167577 None] Lock "cinder-0e7e39c6-bc35-44a7-ba0c-3135a1270829-detach_volume" released by "detach_volume" :: held 0.089s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:51 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2b44f15c-eed1-480b-95e0-4489291759d5 tempest-ProjectReaderTests-541608025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-85d1e33b-8486-4bae-a077-88f443ae8307 1073741824" returned: 0 in 1.045s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2b44f15c-eed1-480b-95e0-4489291759d5 tempest-ProjectReaderTests-541608025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-85d1e33b-8486-4bae-a077-88f443ae8307 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:51 devstack sudo[101974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-85d1e33b-8486-4bae-a077-88f443ae8307 Jul 08 01:48:51 devstack sudo[101974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:52 devstack sudo[101974]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2b44f15c-eed1-480b-95e0-4489291759d5 tempest-ProjectReaderTests-541608025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-85d1e33b-8486-4bae-a077-88f443ae8307" returned: 0 in 0.757s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2b44f15c-eed1-480b-95e0-4489291759d5 tempest-ProjectReaderTests-541608025 None] <== create_volume: return (1847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:48:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2b44f15c-eed1-480b-95e0-4489291759d5 tempest-ProjectReaderTests-541608025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.852s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:52 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2b44f15c-eed1-480b-95e0-4489291759d5 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88ad0523-f6ab-4867-b6e8-1d82ceb1791a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85d1e33b-8486-4bae-a077-88f443ae8307', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:52 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2b44f15c-eed1-480b-95e0-4489291759d5 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9141dc1-0796-40c9-9d1b-04162216a4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:52 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-2b44f15c-eed1-480b-95e0-4489291759d5 tempest-ProjectReaderTests-541608025 None] Volume volume-85d1e33b-8486-4bae-a077-88f443ae8307 (85d1e33b-8486-4bae-a077-88f443ae8307): created successfully Jul 08 01:48:52 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2b44f15c-eed1-480b-95e0-4489291759d5 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9141dc1-0796-40c9-9d1b-04162216a4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:52 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2b44f15c-eed1-480b-95e0-4489291759d5 tempest-ProjectReaderTests-541608025 None] Flow 'volume_create_manager' (a0221791-ed13-4347-866d-81e397e5794d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:48:52 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-2b44f15c-eed1-480b-95e0-4489291759d5 tempest-ProjectReaderTests-541608025 None] Created volume successfully. Jul 08 01:48:53 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-07528e80-5c66-4681-a990-2b9eab194c2f tempest-ProjectReaderTests-541608025 None] Acquiring lock "cinder-85d1e33b-8486-4bae-a077-88f443ae8307-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:53 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-07528e80-5c66-4681-a990-2b9eab194c2f tempest-ProjectReaderTests-541608025 None] Lock "cinder-85d1e33b-8486-4bae-a077-88f443ae8307-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:53 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-07528e80-5c66-4681-a990-2b9eab194c2f tempest-ProjectReaderTests-541608025 None] Acquiring lock "cinder-quobyte-85d1e33b-8486-4bae-a077-88f443ae8307" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:53 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-07528e80-5c66-4681-a990-2b9eab194c2f tempest-ProjectReaderTests-541608025 None] Lock "cinder-quobyte-85d1e33b-8486-4bae-a077-88f443ae8307" acquired by "delete_volume" :: waited 0.017s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:53 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[3098a79b-5807-4523-8609-182491751d99]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-07528e80-5c66-4681-a990-2b9eab194c2f tempest-ProjectReaderTests-541608025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-85d1e33b-8486-4bae-a077-88f443ae8307 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:54 devstack sudo[101983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-85d1e33b-8486-4bae-a077-88f443ae8307 Jul 08 01:48:54 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:54 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-07528e80-5c66-4681-a990-2b9eab194c2f tempest-ProjectReaderTests-541608025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-85d1e33b-8486-4bae-a077-88f443ae8307" returned: 0 in 0.894s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-07528e80-5c66-4681-a990-2b9eab194c2f tempest-ProjectReaderTests-541608025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-85d1e33b-8486-4bae-a077-88f443ae8307 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:54 devstack sudo[102005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-85d1e33b-8486-4bae-a077-88f443ae8307 Jul 08 01:48:54 devstack sudo[102005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:55 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:48:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:55 devstack sudo[102008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:48:55 devstack sudo[102008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:55 devstack sudo[102005]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-07528e80-5c66-4681-a990-2b9eab194c2f tempest-ProjectReaderTests-541608025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-85d1e33b-8486-4bae-a077-88f443ae8307" returned: 0 in 0.718s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:55 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-07528e80-5c66-4681-a990-2b9eab194c2f tempest-ProjectReaderTests-541608025 None] Lock "cinder-quobyte-85d1e33b-8486-4bae-a077-88f443ae8307" released by "delete_volume" :: held 1.655s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:55 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-07528e80-5c66-4681-a990-2b9eab194c2f tempest-ProjectReaderTests-541608025 None] Created reservations ['d5aaae20-3a7e-45a7-a523-45921b1b2cbc', '798aa9d6-659c-402e-8501-1fb95a27fe87', '1bbfeab0-d3be-4609-b344-614f35a3e442', 'df0783de-00c2-42d7-9658-be23f335f95c'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:48:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-07528e80-5c66-4681-a990-2b9eab194c2f tempest-ProjectReaderTests-541608025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-07528e80-5c66-4681-a990-2b9eab194c2f tempest-ProjectReaderTests-541608025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-07528e80-5c66-4681-a990-2b9eab194c2f tempest-ProjectReaderTests-541608025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-07528e80-5c66-4681-a990-2b9eab194c2f tempest-ProjectReaderTests-541608025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-07528e80-5c66-4681-a990-2b9eab194c2f tempest-ProjectReaderTests-541608025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-07528e80-5c66-4681-a990-2b9eab194c2f tempest-ProjectReaderTests-541608025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:55 devstack sudo[102013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:48:55 devstack sudo[102013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:55 devstack sudo[102008]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.718s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:55 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:48:55 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager._thread_info {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:48:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread count: 29 {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:48:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread info: [<_MainThread(MainThread, started 127058402500736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:48:56 devstack sudo[102013]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-07528e80-5c66-4681-a990-2b9eab194c2f tempest-ProjectReaderTests-541608025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.718s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:56 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-07528e80-5c66-4681-a990-2b9eab194c2f tempest-ProjectReaderTests-541608025 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:48:56 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-07528e80-5c66-4681-a990-2b9eab194c2f tempest-ProjectReaderTests-541608025 None] Deleted volume successfully. Jul 08 01:48:56 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-07528e80-5c66-4681-a990-2b9eab194c2f tempest-ProjectReaderTests-541608025 None] Lock "cinder-85d1e33b-8486-4bae-a077-88f443ae8307-delete_volume" released by "delete_volume" :: held 2.653s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:56 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e035d5c-8b64-41ef-b04f-899b8361ec49 tempest-ProjectReaderTests-541608025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:48:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9e035d5c-8b64-41ef-b04f-899b8361ec49 tempest-ProjectReaderTests-541608025 None] Flow 'volume_create_manager' (fcf26964-d12b-4de5-81aa-63fe6efd98eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:48:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9e035d5c-8b64-41ef-b04f-899b8361ec49 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8831a3a9-2772-4c3a-87c6-a7ea1887d1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9e035d5c-8b64-41ef-b04f-899b8361ec49 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8831a3a9-2772-4c3a-87c6-a7ea1887d1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-463293224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8132a65-083d-45b1-a98f-3886d12cb6d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee61bbee804d4edf97228aafc78bd7bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:48:57Z,use_quota=True,user_id='c4f337979f3941b7b01461a59890b630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9e035d5c-8b64-41ef-b04f-899b8361ec49 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c658aaf3-0e24-4a52-9fe1-869c708d6635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9e035d5c-8b64-41ef-b04f-899b8361ec49 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c658aaf3-0e24-4a52-9fe1-869c708d6635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9e035d5c-8b64-41ef-b04f-899b8361ec49 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69b7d322-b669-4267-97f2-4b785ece50fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9e035d5c-8b64-41ef-b04f-899b8361ec49 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69b7d322-b669-4267-97f2-4b785ece50fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8132a65-083d-45b1-a98f-3886d12cb6d9', 'volume_name': 'volume-e8132a65-083d-45b1-a98f-3886d12cb6d9', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9e035d5c-8b64-41ef-b04f-899b8361ec49 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9afaada7-cd81-4e50-8a81-51c90719703a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9e035d5c-8b64-41ef-b04f-899b8361ec49 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9afaada7-cd81-4e50-8a81-51c90719703a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9e035d5c-8b64-41ef-b04f-899b8361ec49 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a7ec17b-347d-4be8-8acd-95f69ef3718f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:56 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-9e035d5c-8b64-41ef-b04f-899b8361ec49 tempest-ProjectReaderTests-541608025 None] Volume e8132a65-083d-45b1-a98f-3886d12cb6d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8132a65-083d-45b1-a98f-3886d12cb6d9', 'volume_size': 1} Jul 08 01:48:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-9e035d5c-8b64-41ef-b04f-899b8361ec49 tempest-ProjectReaderTests-541608025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-9e035d5c-8b64-41ef-b04f-899b8361ec49 tempest-ProjectReaderTests-541608025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:56 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-9e035d5c-8b64-41ef-b04f-899b8361ec49 tempest-ProjectReaderTests-541608025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-463293224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8132a65-083d-45b1-a98f-3886d12cb6d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee61bbee804d4edf97228aafc78bd7bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:48:57Z,use_quota=True,user_id='c4f337979f3941b7b01461a59890b630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:48:56 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-9e035d5c-8b64-41ef-b04f-899b8361ec49 tempest-ProjectReaderTests-541608025 None] Creating volume e8132a65-083d-45b1-a98f-3886d12cb6d9 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:48:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-9e035d5c-8b64-41ef-b04f-899b8361ec49 tempest-ProjectReaderTests-541608025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-9e035d5c-8b64-41ef-b04f-899b8361ec49 tempest-ProjectReaderTests-541608025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:56 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-9e035d5c-8b64-41ef-b04f-899b8361ec49 tempest-ProjectReaderTests-541608025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:56 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-9e035d5c-8b64-41ef-b04f-899b8361ec49 tempest-ProjectReaderTests-541608025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-9e035d5c-8b64-41ef-b04f-899b8361ec49 tempest-ProjectReaderTests-541608025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:56 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-9e035d5c-8b64-41ef-b04f-899b8361ec49 tempest-ProjectReaderTests-541608025 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:48:56 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-9e035d5c-8b64-41ef-b04f-899b8361ec49 tempest-ProjectReaderTests-541608025 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:48:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9e035d5c-8b64-41ef-b04f-899b8361ec49 tempest-ProjectReaderTests-541608025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-e8132a65-083d-45b1-a98f-3886d12cb6d9 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:56 devstack sudo[102017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-e8132a65-083d-45b1-a98f-3886d12cb6d9 1073741824 Jul 08 01:48:56 devstack sudo[102017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:57 devstack sudo[102017]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9e035d5c-8b64-41ef-b04f-899b8361ec49 tempest-ProjectReaderTests-541608025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-e8132a65-083d-45b1-a98f-3886d12cb6d9 1073741824" returned: 0 in 0.950s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9e035d5c-8b64-41ef-b04f-899b8361ec49 tempest-ProjectReaderTests-541608025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-e8132a65-083d-45b1-a98f-3886d12cb6d9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:57 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-e8132a65-083d-45b1-a98f-3886d12cb6d9 Jul 08 01:48:57 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:58 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9e035d5c-8b64-41ef-b04f-899b8361ec49 tempest-ProjectReaderTests-541608025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-e8132a65-083d-45b1-a98f-3886d12cb6d9" returned: 0 in 0.716s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:58 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-9e035d5c-8b64-41ef-b04f-899b8361ec49 tempest-ProjectReaderTests-541608025 None] <== create_volume: return (1713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:48:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-9e035d5c-8b64-41ef-b04f-899b8361ec49 tempest-ProjectReaderTests-541608025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9e035d5c-8b64-41ef-b04f-899b8361ec49 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a7ec17b-347d-4be8-8acd-95f69ef3718f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8132a65-083d-45b1-a98f-3886d12cb6d9', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9e035d5c-8b64-41ef-b04f-899b8361ec49 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5f3ea2b-5184-4cc6-ba11-6cf568979c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:58 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-9e035d5c-8b64-41ef-b04f-899b8361ec49 tempest-ProjectReaderTests-541608025 None] Volume volume-e8132a65-083d-45b1-a98f-3886d12cb6d9 (e8132a65-083d-45b1-a98f-3886d12cb6d9): created successfully Jul 08 01:48:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9e035d5c-8b64-41ef-b04f-899b8361ec49 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5f3ea2b-5184-4cc6-ba11-6cf568979c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9e035d5c-8b64-41ef-b04f-899b8361ec49 tempest-ProjectReaderTests-541608025 None] Flow 'volume_create_manager' (fcf26964-d12b-4de5-81aa-63fe6efd98eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:48:58 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-9e035d5c-8b64-41ef-b04f-899b8361ec49 tempest-ProjectReaderTests-541608025 None] Created volume successfully. Jul 08 01:48:58 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-247d2b94-fd44-41c5-9711-14de57bb5a9a tempest-ProjectReaderTests-541608025 None] Acquiring lock "cinder-e8132a65-083d-45b1-a98f-3886d12cb6d9-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:58 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-247d2b94-fd44-41c5-9711-14de57bb5a9a tempest-ProjectReaderTests-541608025 None] Lock "cinder-e8132a65-083d-45b1-a98f-3886d12cb6d9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:58 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-247d2b94-fd44-41c5-9711-14de57bb5a9a tempest-ProjectReaderTests-541608025 None] Acquiring lock "cinder-quobyte-e8132a65-083d-45b1-a98f-3886d12cb6d9" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:58 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-247d2b94-fd44-41c5-9711-14de57bb5a9a tempest-ProjectReaderTests-541608025 None] Lock "cinder-quobyte-e8132a65-083d-45b1-a98f-3886d12cb6d9" acquired by "delete_volume" :: waited 0.014s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:58 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93365b4-fd1c-43c6-8dab-80eccd47f4a5]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-247d2b94-fd44-41c5-9711-14de57bb5a9a tempest-ProjectReaderTests-541608025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-e8132a65-083d-45b1-a98f-3886d12cb6d9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:58 devstack sudo[102028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-e8132a65-083d-45b1-a98f-3886d12cb6d9 Jul 08 01:48:58 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:59 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-247d2b94-fd44-41c5-9711-14de57bb5a9a tempest-ProjectReaderTests-541608025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-e8132a65-083d-45b1-a98f-3886d12cb6d9" returned: 0 in 0.792s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-247d2b94-fd44-41c5-9711-14de57bb5a9a tempest-ProjectReaderTests-541608025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-e8132a65-083d-45b1-a98f-3886d12cb6d9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:59 devstack sudo[102034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-e8132a65-083d-45b1-a98f-3886d12cb6d9 Jul 08 01:48:59 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:00 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-247d2b94-fd44-41c5-9711-14de57bb5a9a tempest-ProjectReaderTests-541608025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-e8132a65-083d-45b1-a98f-3886d12cb6d9" returned: 0 in 0.685s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:00 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-247d2b94-fd44-41c5-9711-14de57bb5a9a tempest-ProjectReaderTests-541608025 None] Lock "cinder-quobyte-e8132a65-083d-45b1-a98f-3886d12cb6d9" released by "delete_volume" :: held 1.523s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:49:00 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-247d2b94-fd44-41c5-9711-14de57bb5a9a tempest-ProjectReaderTests-541608025 None] Created reservations ['024d51b0-25a8-4f42-ae01-8ead49636a44', '264b0ae0-9c8c-4169-a52c-974592d4bf9d', '42f5de20-dd2c-4f47-b145-d24896c61d13', 'eb140ba0-16f8-4c32-b5e5-6a059bc1ce76'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:49:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-247d2b94-fd44-41c5-9711-14de57bb5a9a tempest-ProjectReaderTests-541608025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-247d2b94-fd44-41c5-9711-14de57bb5a9a tempest-ProjectReaderTests-541608025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-247d2b94-fd44-41c5-9711-14de57bb5a9a tempest-ProjectReaderTests-541608025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:49:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-247d2b94-fd44-41c5-9711-14de57bb5a9a tempest-ProjectReaderTests-541608025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:49:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-247d2b94-fd44-41c5-9711-14de57bb5a9a tempest-ProjectReaderTests-541608025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-247d2b94-fd44-41c5-9711-14de57bb5a9a tempest-ProjectReaderTests-541608025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:00 devstack sudo[102040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:49:00 devstack sudo[102040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:01 devstack sudo[102040]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-247d2b94-fd44-41c5-9711-14de57bb5a9a tempest-ProjectReaderTests-541608025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.738s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:01 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-247d2b94-fd44-41c5-9711-14de57bb5a9a tempest-ProjectReaderTests-541608025 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:49:01 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-247d2b94-fd44-41c5-9711-14de57bb5a9a tempest-ProjectReaderTests-541608025 None] Deleted volume successfully. Jul 08 01:49:01 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-247d2b94-fd44-41c5-9711-14de57bb5a9a tempest-ProjectReaderTests-541608025 None] Lock "cinder-e8132a65-083d-45b1-a98f-3886d12cb6d9-delete_volume" released by "delete_volume" :: held 2.495s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:49:01 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e24ce8a-3907-4110-8c9e-0d04baede498 tempest-ProjectReaderTests-541608025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:49:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0e24ce8a-3907-4110-8c9e-0d04baede498 tempest-ProjectReaderTests-541608025 None] Flow 'volume_create_manager' (716bf3d7-973a-4a9a-8781-817c09447bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:49:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0e24ce8a-3907-4110-8c9e-0d04baede498 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5493ecd8-13e9-424c-ab3a-b1ac5ba36688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0e24ce8a-3907-4110-8c9e-0d04baede498 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5493ecd8-13e9-424c-ab3a-b1ac5ba36688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-322794456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9773ac77-36b6-4b0e-b7db-855bc2054768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee61bbee804d4edf97228aafc78bd7bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:49:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:49:02Z,use_quota=True,user_id='c4f337979f3941b7b01461a59890b630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0e24ce8a-3907-4110-8c9e-0d04baede498 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c556d82c-320d-4003-9bda-0746483d9132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0e24ce8a-3907-4110-8c9e-0d04baede498 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c556d82c-320d-4003-9bda-0746483d9132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0e24ce8a-3907-4110-8c9e-0d04baede498 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c00306e8-2862-450b-83ad-5b357315dfca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0e24ce8a-3907-4110-8c9e-0d04baede498 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c00306e8-2862-450b-83ad-5b357315dfca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9773ac77-36b6-4b0e-b7db-855bc2054768', 'volume_name': 'volume-9773ac77-36b6-4b0e-b7db-855bc2054768', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0e24ce8a-3907-4110-8c9e-0d04baede498 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9f0c7ab-52c8-49c5-80b9-b079c13c36c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0e24ce8a-3907-4110-8c9e-0d04baede498 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9f0c7ab-52c8-49c5-80b9-b079c13c36c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0e24ce8a-3907-4110-8c9e-0d04baede498 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca86613a-a5be-4f4b-afc7-f02330d1f716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:01 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-0e24ce8a-3907-4110-8c9e-0d04baede498 tempest-ProjectReaderTests-541608025 None] Volume 9773ac77-36b6-4b0e-b7db-855bc2054768: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9773ac77-36b6-4b0e-b7db-855bc2054768', 'volume_size': 1} Jul 08 01:49:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0e24ce8a-3907-4110-8c9e-0d04baede498 tempest-ProjectReaderTests-541608025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0e24ce8a-3907-4110-8c9e-0d04baede498 tempest-ProjectReaderTests-541608025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:01 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0e24ce8a-3907-4110-8c9e-0d04baede498 tempest-ProjectReaderTests-541608025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-322794456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9773ac77-36b6-4b0e-b7db-855bc2054768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee61bbee804d4edf97228aafc78bd7bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:49:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:49:02Z,use_quota=True,user_id='c4f337979f3941b7b01461a59890b630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:49:01 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-0e24ce8a-3907-4110-8c9e-0d04baede498 tempest-ProjectReaderTests-541608025 None] Creating volume 9773ac77-36b6-4b0e-b7db-855bc2054768 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:49:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0e24ce8a-3907-4110-8c9e-0d04baede498 tempest-ProjectReaderTests-541608025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0e24ce8a-3907-4110-8c9e-0d04baede498 tempest-ProjectReaderTests-541608025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:01 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0e24ce8a-3907-4110-8c9e-0d04baede498 tempest-ProjectReaderTests-541608025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:49:01 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0e24ce8a-3907-4110-8c9e-0d04baede498 tempest-ProjectReaderTests-541608025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:49:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0e24ce8a-3907-4110-8c9e-0d04baede498 tempest-ProjectReaderTests-541608025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:01 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0e24ce8a-3907-4110-8c9e-0d04baede498 tempest-ProjectReaderTests-541608025 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:49:01 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-0e24ce8a-3907-4110-8c9e-0d04baede498 tempest-ProjectReaderTests-541608025 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:49:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0e24ce8a-3907-4110-8c9e-0d04baede498 tempest-ProjectReaderTests-541608025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9773ac77-36b6-4b0e-b7db-855bc2054768 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:01 devstack sudo[102044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9773ac77-36b6-4b0e-b7db-855bc2054768 1073741824 Jul 08 01:49:01 devstack sudo[102044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:02 devstack sudo[102044]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0e24ce8a-3907-4110-8c9e-0d04baede498 tempest-ProjectReaderTests-541608025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9773ac77-36b6-4b0e-b7db-855bc2054768 1073741824" returned: 0 in 0.987s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0e24ce8a-3907-4110-8c9e-0d04baede498 tempest-ProjectReaderTests-541608025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9773ac77-36b6-4b0e-b7db-855bc2054768 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:02 devstack sudo[102050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9773ac77-36b6-4b0e-b7db-855bc2054768 Jul 08 01:49:02 devstack sudo[102050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:03 devstack sudo[102050]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0e24ce8a-3907-4110-8c9e-0d04baede498 tempest-ProjectReaderTests-541608025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9773ac77-36b6-4b0e-b7db-855bc2054768" returned: 0 in 0.788s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:03 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0e24ce8a-3907-4110-8c9e-0d04baede498 tempest-ProjectReaderTests-541608025 None] <== create_volume: return (1822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:49:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0e24ce8a-3907-4110-8c9e-0d04baede498 tempest-ProjectReaderTests-541608025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.825s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0e24ce8a-3907-4110-8c9e-0d04baede498 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca86613a-a5be-4f4b-afc7-f02330d1f716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9773ac77-36b6-4b0e-b7db-855bc2054768', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0e24ce8a-3907-4110-8c9e-0d04baede498 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b6facbf-f0f2-4ce2-92bd-f104aefaa95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:03 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-0e24ce8a-3907-4110-8c9e-0d04baede498 tempest-ProjectReaderTests-541608025 None] Volume volume-9773ac77-36b6-4b0e-b7db-855bc2054768 (9773ac77-36b6-4b0e-b7db-855bc2054768): created successfully Jul 08 01:49:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0e24ce8a-3907-4110-8c9e-0d04baede498 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b6facbf-f0f2-4ce2-92bd-f104aefaa95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0e24ce8a-3907-4110-8c9e-0d04baede498 tempest-ProjectReaderTests-541608025 None] Flow 'volume_create_manager' (716bf3d7-973a-4a9a-8781-817c09447bad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:49:03 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-0e24ce8a-3907-4110-8c9e-0d04baede498 tempest-ProjectReaderTests-541608025 None] Created volume successfully. Jul 08 01:49:03 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-071f1b1d-eae3-4a4e-a96c-9062b566b059 tempest-ProjectReaderTests-541608025 None] Acquiring lock "cinder-9773ac77-36b6-4b0e-b7db-855bc2054768-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:49:03 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-071f1b1d-eae3-4a4e-a96c-9062b566b059 tempest-ProjectReaderTests-541608025 None] Lock "cinder-9773ac77-36b6-4b0e-b7db-855bc2054768-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:49:03 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-071f1b1d-eae3-4a4e-a96c-9062b566b059 tempest-ProjectReaderTests-541608025 None] Acquiring lock "cinder-quobyte-9773ac77-36b6-4b0e-b7db-855bc2054768" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:49:03 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-071f1b1d-eae3-4a4e-a96c-9062b566b059 tempest-ProjectReaderTests-541608025 None] Lock "cinder-quobyte-9773ac77-36b6-4b0e-b7db-855bc2054768" acquired by "delete_volume" :: waited 0.015s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:49:03 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ee2f20-34fe-455f-b1e0-64f65a26a6ca]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:49:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-071f1b1d-eae3-4a4e-a96c-9062b566b059 tempest-ProjectReaderTests-541608025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9773ac77-36b6-4b0e-b7db-855bc2054768 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:03 devstack sudo[102053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9773ac77-36b6-4b0e-b7db-855bc2054768 Jul 08 01:49:03 devstack sudo[102053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:04 devstack sudo[102053]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-071f1b1d-eae3-4a4e-a96c-9062b566b059 tempest-ProjectReaderTests-541608025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9773ac77-36b6-4b0e-b7db-855bc2054768" returned: 0 in 0.841s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-071f1b1d-eae3-4a4e-a96c-9062b566b059 tempest-ProjectReaderTests-541608025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9773ac77-36b6-4b0e-b7db-855bc2054768 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:04 devstack sudo[102058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9773ac77-36b6-4b0e-b7db-855bc2054768 Jul 08 01:49:04 devstack sudo[102058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:05 devstack sudo[102058]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-071f1b1d-eae3-4a4e-a96c-9062b566b059 tempest-ProjectReaderTests-541608025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9773ac77-36b6-4b0e-b7db-855bc2054768" returned: 0 in 0.814s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:05 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-071f1b1d-eae3-4a4e-a96c-9062b566b059 tempest-ProjectReaderTests-541608025 None] Lock "cinder-quobyte-9773ac77-36b6-4b0e-b7db-855bc2054768" released by "delete_volume" :: held 1.697s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:49:05 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-071f1b1d-eae3-4a4e-a96c-9062b566b059 tempest-ProjectReaderTests-541608025 None] Created reservations ['83762e14-7002-47bb-9a50-5d4fbfadf6a6', '0021703f-5b0f-44f4-8243-925f709825ef', '0f1d1d96-b5b3-4091-96a7-95ad19365466', '34307f26-d49c-4734-8a0d-6d8d5978bd0a'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:49:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-071f1b1d-eae3-4a4e-a96c-9062b566b059 tempest-ProjectReaderTests-541608025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-071f1b1d-eae3-4a4e-a96c-9062b566b059 tempest-ProjectReaderTests-541608025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:05 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-071f1b1d-eae3-4a4e-a96c-9062b566b059 tempest-ProjectReaderTests-541608025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:49:05 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-071f1b1d-eae3-4a4e-a96c-9062b566b059 tempest-ProjectReaderTests-541608025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:49:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-071f1b1d-eae3-4a4e-a96c-9062b566b059 tempest-ProjectReaderTests-541608025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-071f1b1d-eae3-4a4e-a96c-9062b566b059 tempest-ProjectReaderTests-541608025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:05 devstack sudo[102062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:49:05 devstack sudo[102062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:06 devstack sudo[102062]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-071f1b1d-eae3-4a4e-a96c-9062b566b059 tempest-ProjectReaderTests-541608025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.955s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:06 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-071f1b1d-eae3-4a4e-a96c-9062b566b059 tempest-ProjectReaderTests-541608025 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:49:06 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-071f1b1d-eae3-4a4e-a96c-9062b566b059 tempest-ProjectReaderTests-541608025 None] Deleted volume successfully. Jul 08 01:49:06 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-071f1b1d-eae3-4a4e-a96c-9062b566b059 tempest-ProjectReaderTests-541608025 None] Lock "cinder-9773ac77-36b6-4b0e-b7db-855bc2054768-delete_volume" released by "delete_volume" :: held 2.896s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:49:06 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc2837b7-df8e-4f6c-b549-c90ca946c267 tempest-ProjectReaderTests-541608025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:49:06 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fc2837b7-df8e-4f6c-b549-c90ca946c267 tempest-ProjectReaderTests-541608025 None] Flow 'volume_create_manager' (c49e6d65-09e2-40ba-b1c0-f396243d98cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:49:06 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fc2837b7-df8e-4f6c-b549-c90ca946c267 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a21573c4-1d4c-4f35-af15-d1e639bf7950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:06 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fc2837b7-df8e-4f6c-b549-c90ca946c267 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a21573c4-1d4c-4f35-af15-d1e639bf7950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:49:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-951715884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e9aa7eb-e439-4ae0-9ec2-b5c78793d703,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee61bbee804d4edf97228aafc78bd7bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:49:07Z,use_quota=True,user_id='c4f337979f3941b7b01461a59890b630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:06 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fc2837b7-df8e-4f6c-b549-c90ca946c267 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a09ea4d-e7b0-4dc9-bf27-74ec2df186f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:06 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fc2837b7-df8e-4f6c-b549-c90ca946c267 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a09ea4d-e7b0-4dc9-bf27-74ec2df186f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:06 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fc2837b7-df8e-4f6c-b549-c90ca946c267 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8afed5db-6255-4826-9250-6a0d3e6a1e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:06 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fc2837b7-df8e-4f6c-b549-c90ca946c267 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8afed5db-6255-4826-9250-6a0d3e6a1e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e9aa7eb-e439-4ae0-9ec2-b5c78793d703', 'volume_name': 'volume-0e9aa7eb-e439-4ae0-9ec2-b5c78793d703', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:06 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fc2837b7-df8e-4f6c-b549-c90ca946c267 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b471932-93ac-448c-8ed9-d43bbb86d665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:06 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fc2837b7-df8e-4f6c-b549-c90ca946c267 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b471932-93ac-448c-8ed9-d43bbb86d665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:06 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fc2837b7-df8e-4f6c-b549-c90ca946c267 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6be9e950-b7ac-446f-9687-649d4001a89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:06 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-fc2837b7-df8e-4f6c-b549-c90ca946c267 tempest-ProjectReaderTests-541608025 None] Volume 0e9aa7eb-e439-4ae0-9ec2-b5c78793d703: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e9aa7eb-e439-4ae0-9ec2-b5c78793d703', 'volume_size': 1} Jul 08 01:49:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-fc2837b7-df8e-4f6c-b549-c90ca946c267 tempest-ProjectReaderTests-541608025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-fc2837b7-df8e-4f6c-b549-c90ca946c267 tempest-ProjectReaderTests-541608025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:06 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-fc2837b7-df8e-4f6c-b549-c90ca946c267 tempest-ProjectReaderTests-541608025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:49:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-951715884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e9aa7eb-e439-4ae0-9ec2-b5c78793d703,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee61bbee804d4edf97228aafc78bd7bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:49:07Z,use_quota=True,user_id='c4f337979f3941b7b01461a59890b630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:49:06 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-fc2837b7-df8e-4f6c-b549-c90ca946c267 tempest-ProjectReaderTests-541608025 None] Creating volume 0e9aa7eb-e439-4ae0-9ec2-b5c78793d703 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:49:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-fc2837b7-df8e-4f6c-b549-c90ca946c267 tempest-ProjectReaderTests-541608025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-fc2837b7-df8e-4f6c-b549-c90ca946c267 tempest-ProjectReaderTests-541608025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:06 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-fc2837b7-df8e-4f6c-b549-c90ca946c267 tempest-ProjectReaderTests-541608025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:49:06 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-fc2837b7-df8e-4f6c-b549-c90ca946c267 tempest-ProjectReaderTests-541608025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:49:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-fc2837b7-df8e-4f6c-b549-c90ca946c267 tempest-ProjectReaderTests-541608025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:06 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-fc2837b7-df8e-4f6c-b549-c90ca946c267 tempest-ProjectReaderTests-541608025 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:49:06 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-fc2837b7-df8e-4f6c-b549-c90ca946c267 tempest-ProjectReaderTests-541608025 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:49:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-fc2837b7-df8e-4f6c-b549-c90ca946c267 tempest-ProjectReaderTests-541608025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e9aa7eb-e439-4ae0-9ec2-b5c78793d703 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:06 devstack sudo[102065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e9aa7eb-e439-4ae0-9ec2-b5c78793d703 1073741824 Jul 08 01:49:06 devstack sudo[102065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:07 devstack sudo[102065]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-fc2837b7-df8e-4f6c-b549-c90ca946c267 tempest-ProjectReaderTests-541608025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e9aa7eb-e439-4ae0-9ec2-b5c78793d703 1073741824" returned: 0 in 1.007s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-fc2837b7-df8e-4f6c-b549-c90ca946c267 tempest-ProjectReaderTests-541608025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e9aa7eb-e439-4ae0-9ec2-b5c78793d703 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:07 devstack sudo[102087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e9aa7eb-e439-4ae0-9ec2-b5c78793d703 Jul 08 01:49:07 devstack sudo[102087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:08 devstack sudo[102087]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-fc2837b7-df8e-4f6c-b549-c90ca946c267 tempest-ProjectReaderTests-541608025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e9aa7eb-e439-4ae0-9ec2-b5c78793d703" returned: 0 in 0.679s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:08 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-fc2837b7-df8e-4f6c-b549-c90ca946c267 tempest-ProjectReaderTests-541608025 None] <== create_volume: return (1730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:49:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-fc2837b7-df8e-4f6c-b549-c90ca946c267 tempest-ProjectReaderTests-541608025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.733s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:08 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fc2837b7-df8e-4f6c-b549-c90ca946c267 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6be9e950-b7ac-446f-9687-649d4001a89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e9aa7eb-e439-4ae0-9ec2-b5c78793d703', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:08 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fc2837b7-df8e-4f6c-b549-c90ca946c267 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50d6b3b0-0291-4e19-a025-aa2f2fe08d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:08 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-fc2837b7-df8e-4f6c-b549-c90ca946c267 tempest-ProjectReaderTests-541608025 None] Volume volume-0e9aa7eb-e439-4ae0-9ec2-b5c78793d703 (0e9aa7eb-e439-4ae0-9ec2-b5c78793d703): created successfully Jul 08 01:49:08 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fc2837b7-df8e-4f6c-b549-c90ca946c267 tempest-ProjectReaderTests-541608025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50d6b3b0-0291-4e19-a025-aa2f2fe08d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:08 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-fc2837b7-df8e-4f6c-b549-c90ca946c267 tempest-ProjectReaderTests-541608025 None] Flow 'volume_create_manager' (c49e6d65-09e2-40ba-b1c0-f396243d98cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:49:08 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-fc2837b7-df8e-4f6c-b549-c90ca946c267 tempest-ProjectReaderTests-541608025 None] Created volume successfully. Jul 08 01:49:08 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d5cae231-fcd4-417a-8ba4-e0cc23783fc8 tempest-ProjectReaderTests-541608025 None] Acquiring lock "cinder-0e9aa7eb-e439-4ae0-9ec2-b5c78793d703-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:49:08 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d5cae231-fcd4-417a-8ba4-e0cc23783fc8 tempest-ProjectReaderTests-541608025 None] Lock "cinder-0e9aa7eb-e439-4ae0-9ec2-b5c78793d703-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:49:08 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d5cae231-fcd4-417a-8ba4-e0cc23783fc8 tempest-ProjectReaderTests-541608025 None] Acquiring lock "cinder-quobyte-0e9aa7eb-e439-4ae0-9ec2-b5c78793d703" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:49:08 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d5cae231-fcd4-417a-8ba4-e0cc23783fc8 tempest-ProjectReaderTests-541608025 None] Lock "cinder-quobyte-0e9aa7eb-e439-4ae0-9ec2-b5c78793d703" acquired by "delete_volume" :: waited 0.025s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:49:09 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e31eab-dd7e-47a1-b367-8ebc0c2dc650]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:49:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d5cae231-fcd4-417a-8ba4-e0cc23783fc8 tempest-ProjectReaderTests-541608025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e9aa7eb-e439-4ae0-9ec2-b5c78793d703 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:09 devstack sudo[102090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e9aa7eb-e439-4ae0-9ec2-b5c78793d703 Jul 08 01:49:09 devstack sudo[102090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:09 devstack sudo[102090]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d5cae231-fcd4-417a-8ba4-e0cc23783fc8 tempest-ProjectReaderTests-541608025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e9aa7eb-e439-4ae0-9ec2-b5c78793d703" returned: 0 in 0.853s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d5cae231-fcd4-417a-8ba4-e0cc23783fc8 tempest-ProjectReaderTests-541608025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e9aa7eb-e439-4ae0-9ec2-b5c78793d703 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:09 devstack sudo[102095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e9aa7eb-e439-4ae0-9ec2-b5c78793d703 Jul 08 01:49:09 devstack sudo[102095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:10 devstack sudo[102095]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d5cae231-fcd4-417a-8ba4-e0cc23783fc8 tempest-ProjectReaderTests-541608025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e9aa7eb-e439-4ae0-9ec2-b5c78793d703" returned: 0 in 0.678s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:10 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d5cae231-fcd4-417a-8ba4-e0cc23783fc8 tempest-ProjectReaderTests-541608025 None] Lock "cinder-quobyte-0e9aa7eb-e439-4ae0-9ec2-b5c78793d703" released by "delete_volume" :: held 1.577s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:49:10 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-d5cae231-fcd4-417a-8ba4-e0cc23783fc8 tempest-ProjectReaderTests-541608025 None] Created reservations ['fb8590fb-789d-47ba-a568-7257a55fd30b', '68e4f963-e21a-4873-89dd-a4bf47b8bf0f', '4e5d7dc6-19db-40a5-8e43-1adaa9d40fdc', 'f9796ce3-6ea0-4c17-bb55-2e71fa712a46'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:49:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-d5cae231-fcd4-417a-8ba4-e0cc23783fc8 tempest-ProjectReaderTests-541608025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-d5cae231-fcd4-417a-8ba4-e0cc23783fc8 tempest-ProjectReaderTests-541608025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:10 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-d5cae231-fcd4-417a-8ba4-e0cc23783fc8 tempest-ProjectReaderTests-541608025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:49:10 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-d5cae231-fcd4-417a-8ba4-e0cc23783fc8 tempest-ProjectReaderTests-541608025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:49:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-d5cae231-fcd4-417a-8ba4-e0cc23783fc8 tempest-ProjectReaderTests-541608025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d5cae231-fcd4-417a-8ba4-e0cc23783fc8 tempest-ProjectReaderTests-541608025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:10 devstack sudo[102098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:49:10 devstack sudo[102098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:11 devstack sudo[102098]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d5cae231-fcd4-417a-8ba4-e0cc23783fc8 tempest-ProjectReaderTests-541608025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.963s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:11 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-d5cae231-fcd4-417a-8ba4-e0cc23783fc8 tempest-ProjectReaderTests-541608025 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:49:11 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-d5cae231-fcd4-417a-8ba4-e0cc23783fc8 tempest-ProjectReaderTests-541608025 None] Deleted volume successfully. Jul 08 01:49:11 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d5cae231-fcd4-417a-8ba4-e0cc23783fc8 tempest-ProjectReaderTests-541608025 None] Lock "cinder-0e9aa7eb-e439-4ae0-9ec2-b5c78793d703-delete_volume" released by "delete_volume" :: held 2.834s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:49:15 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-30da8b6a-78fb-4cbf-9094-2dd5ccb7c2fb tempest-VolumesActionsTest-1890167577 None] Acquiring lock "cinder-0e7e39c6-bc35-44a7-ba0c-3135a1270829" by "attach_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:49:15 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-30da8b6a-78fb-4cbf-9094-2dd5ccb7c2fb tempest-VolumesActionsTest-1890167577 None] Lock "cinder-0e7e39c6-bc35-44a7-ba0c-3135a1270829" acquired by "attach_volume" :: waited 0.019s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:49:15 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-30da8b6a-78fb-4cbf-9094-2dd5ccb7c2fb tempest-VolumesActionsTest-1890167577 None] Attaching volume 0e7e39c6-bc35-44a7-ba0c-3135a1270829 to instance e4c541d6-8cf7-42da-8c02-19cdaeafa32d at mountpoint /dev/vdb on host None. Jul 08 01:49:15 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-30da8b6a-78fb-4cbf-9094-2dd5ccb7c2fb tempest-VolumesActionsTest-1890167577 None] Attach volume completed successfully. Jul 08 01:49:15 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-30da8b6a-78fb-4cbf-9094-2dd5ccb7c2fb tempest-VolumesActionsTest-1890167577 None] Lock "cinder-0e7e39c6-bc35-44a7-ba0c-3135a1270829" released by "attach_volume" :: held 0.106s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:49:16 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f729179d-a1bb-42e0-93f3-882b955bf762 tempest-VolumesActionsTest-1890167577 None] Acquiring lock "cinder-0e7e39c6-bc35-44a7-ba0c-3135a1270829-detach_volume" by "detach_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:49:16 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f729179d-a1bb-42e0-93f3-882b955bf762 tempest-VolumesActionsTest-1890167577 None] Lock "cinder-0e7e39c6-bc35-44a7-ba0c-3135a1270829-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:49:16 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-f729179d-a1bb-42e0-93f3-882b955bf762 tempest-VolumesActionsTest-1890167577 None] Detaching volume 0e7e39c6-bc35-44a7-ba0c-3135a1270829 from instance e4c541d6-8cf7-42da-8c02-19cdaeafa32d. Jul 08 01:49:16 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-f729179d-a1bb-42e0-93f3-882b955bf762 tempest-VolumesActionsTest-1890167577 None] Detach volume completed successfully. Jul 08 01:49:16 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f729179d-a1bb-42e0-93f3-882b955bf762 tempest-VolumesActionsTest-1890167577 None] Lock "cinder-0e7e39c6-bc35-44a7-ba0c-3135a1270829-detach_volume" released by "detach_volume" :: held 0.067s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:49:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e91b2f47-2e6f-4649-a09a-91556f8203bd tempest-VolumesActionsTest-1890167577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e91b2f47-2e6f-4649-a09a-91556f8203bd tempest-VolumesActionsTest-1890167577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:26 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[caab7a88-121c-440f-9b00-ab649756ebf2]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:49:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e91b2f47-2e6f-4649-a09a-91556f8203bd tempest-VolumesActionsTest-1890167577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:26 devstack sudo[102199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829 Jul 08 01:49:26 devstack sudo[102199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:26 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=31,cinder:UPDATE=53,cinder:INSERT=12,cinder:DELETE=4 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:49:27 devstack sudo[102199]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e91b2f47-2e6f-4649-a09a-91556f8203bd tempest-VolumesActionsTest-1890167577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829" returned: 0 in 0.792s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:27 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e054ecd-08db-4168-af47-acf95bb35be3]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:49:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e91b2f47-2e6f-4649-a09a-91556f8203bd tempest-VolumesActionsTest-1890167577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:27 devstack sudo[102210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829 Jul 08 01:49:27 devstack sudo[102210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:27 devstack sudo[102210]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e91b2f47-2e6f-4649-a09a-91556f8203bd tempest-VolumesActionsTest-1890167577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829" returned: 0 in 0.796s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e91b2f47-2e6f-4649-a09a-91556f8203bd tempest-VolumesActionsTest-1890167577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829 /opt/stack/data/cinder/conversion/0e7e39c6-bc35-44a7-ba0c-3135a1270829.temp_image.c64c147d-dac5-4e34-9a8e-1bb3970f3077gm4plej8.img {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:27 devstack sudo[102215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829 /opt/stack/data/cinder/conversion/0e7e39c6-bc35-44a7-ba0c-3135a1270829.temp_image.c64c147d-dac5-4e34-9a8e-1bb3970f3077gm4plej8.img Jul 08 01:49:27 devstack sudo[102215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:32 devstack sudo[102215]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e91b2f47-2e6f-4649-a09a-91556f8203bd tempest-VolumesActionsTest-1890167577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829 /opt/stack/data/cinder/conversion/0e7e39c6-bc35-44a7-ba0c-3135a1270829.temp_image.c64c147d-dac5-4e34-9a8e-1bb3970f3077gm4plej8.img" returned: 0 in 4.303s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:32 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b470e33-b16d-4fab-9009-75fcdb44542f]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:49:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e91b2f47-2e6f-4649-a09a-91556f8203bd tempest-VolumesActionsTest-1890167577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:32 devstack sudo[102227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829 Jul 08 01:49:32 devstack sudo[102227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:33 devstack sudo[102227]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e91b2f47-2e6f-4649-a09a-91556f8203bd tempest-VolumesActionsTest-1890167577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829" returned: 0 in 0.903s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:33 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-e91b2f47-2e6f-4649-a09a-91556f8203bd tempest-VolumesActionsTest-1890167577 None] Image conversion details: src /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829, size 1024.00 MB, duration 4.31 sec, destination /opt/stack/data/cinder/conversion/0e7e39c6-bc35-44a7-ba0c-3135a1270829.temp_image.c64c147d-dac5-4e34-9a8e-1bb3970f3077gm4plej8.img {{(pid=87284) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:49:33 devstack cinder-volume[87284]: INFO cinder.image.image_utils [None req-e91b2f47-2e6f-4649-a09a-91556f8203bd tempest-VolumesActionsTest-1890167577 None] Converted 1024.00 MB image at 237.81 MB/s Jul 08 01:49:33 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-e91b2f47-2e6f-4649-a09a-91556f8203bd tempest-VolumesActionsTest-1890167577 None] c64c147d-dac5-4e34-9a8e-1bb3970f3077 was raw, no need to convert to raw {{(pid=87284) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 08 01:49:43 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=52,cinder:UPDATE=47,cinder:INSERT=12,cinder:DELETE=4 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:49:43 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=1 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:49:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e91b2f47-2e6f-4649-a09a-91556f8203bd tempest-VolumesActionsTest-1890167577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.750s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:52 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e91b2f47-2e6f-4649-a09a-91556f8203bd tempest-VolumesActionsTest-1890167577 None] Uploaded volume to glance image-id: c64c147d-dac5-4e34-9a8e-1bb3970f3077. {{(pid=87284) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 08 01:49:52 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-e91b2f47-2e6f-4649-a09a-91556f8203bd tempest-VolumesActionsTest-1890167577 None] Copy volume to image completed successfully. Jul 08 01:49:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-931c7baf-11ba-4a0d-9019-5055bd74212c tempest-VolumesActionsTest-1890167577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-931c7baf-11ba-4a0d-9019-5055bd74212c tempest-VolumesActionsTest-1890167577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:53 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[afef3271-d986-4eee-8e11-8c95a83f4272]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:49:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-931c7baf-11ba-4a0d-9019-5055bd74212c tempest-VolumesActionsTest-1890167577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:53 devstack sudo[102272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829 Jul 08 01:49:53 devstack sudo[102272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:54 devstack sudo[102272]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-931c7baf-11ba-4a0d-9019-5055bd74212c tempest-VolumesActionsTest-1890167577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829" returned: 0 in 0.809s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:54 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0e3a57-0374-4348-a293-fa8ac31ec6ff]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:49:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-931c7baf-11ba-4a0d-9019-5055bd74212c tempest-VolumesActionsTest-1890167577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:54 devstack sudo[102277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829 Jul 08 01:49:54 devstack sudo[102277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:54 devstack sudo[102277]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-931c7baf-11ba-4a0d-9019-5055bd74212c tempest-VolumesActionsTest-1890167577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829" returned: 0 in 0.791s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-931c7baf-11ba-4a0d-9019-5055bd74212c tempest-VolumesActionsTest-1890167577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829 /opt/stack/data/cinder/conversion/0e7e39c6-bc35-44a7-ba0c-3135a1270829.temp_image.49402770-3729-4c86-8f21-eb025be7045c0s_fcck_.img {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:54 devstack sudo[102282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829 /opt/stack/data/cinder/conversion/0e7e39c6-bc35-44a7-ba0c-3135a1270829.temp_image.49402770-3729-4c86-8f21-eb025be7045c0s_fcck_.img Jul 08 01:49:54 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:55 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:49:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:49:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:49:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:55 devstack sudo[102284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:49:55 devstack sudo[102284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:56 devstack sudo[102284]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.923s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:56 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:49:56 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager._thread_info {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:49:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread count: 29 {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:49:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread info: [<_MainThread(MainThread, started 127058402500736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:49:59 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-931c7baf-11ba-4a0d-9019-5055bd74212c tempest-VolumesActionsTest-1890167577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829 /opt/stack/data/cinder/conversion/0e7e39c6-bc35-44a7-ba0c-3135a1270829.temp_image.49402770-3729-4c86-8f21-eb025be7045c0s_fcck_.img" returned: 0 in 4.430s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:59 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf0cbc1-9156-4aac-8a50-57e5f9562770]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:49:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-931c7baf-11ba-4a0d-9019-5055bd74212c tempest-VolumesActionsTest-1890167577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:59 devstack sudo[102302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829 Jul 08 01:49:59 devstack sudo[102302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:00 devstack sudo[102302]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-931c7baf-11ba-4a0d-9019-5055bd74212c tempest-VolumesActionsTest-1890167577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829" returned: 0 in 0.987s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:00 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-931c7baf-11ba-4a0d-9019-5055bd74212c tempest-VolumesActionsTest-1890167577 None] Image conversion details: src /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829, size 1024.00 MB, duration 4.43 sec, destination /opt/stack/data/cinder/conversion/0e7e39c6-bc35-44a7-ba0c-3135a1270829.temp_image.49402770-3729-4c86-8f21-eb025be7045c0s_fcck_.img {{(pid=87284) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:50:00 devstack cinder-volume[87284]: INFO cinder.image.image_utils [None req-931c7baf-11ba-4a0d-9019-5055bd74212c tempest-VolumesActionsTest-1890167577 None] Converted 1024.00 MB image at 231.08 MB/s Jul 08 01:50:00 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-931c7baf-11ba-4a0d-9019-5055bd74212c tempest-VolumesActionsTest-1890167577 None] 49402770-3729-4c86-8f21-eb025be7045c was raw, converting to qcow2 {{(pid=87284) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 08 01:50:00 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddee086e-aad8-473b-8544-01e689bce2d7]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:50:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-931c7baf-11ba-4a0d-9019-5055bd74212c tempest-VolumesActionsTest-1890167577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0e7e39c6-bc35-44a7-ba0c-3135a1270829.temp_image.49402770-3729-4c86-8f21-eb025be7045c0s_fcck_.img {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:00 devstack sudo[102307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0e7e39c6-bc35-44a7-ba0c-3135a1270829.temp_image.49402770-3729-4c86-8f21-eb025be7045c0s_fcck_.img Jul 08 01:50:00 devstack sudo[102307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:01 devstack sudo[102307]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-931c7baf-11ba-4a0d-9019-5055bd74212c tempest-VolumesActionsTest-1890167577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0e7e39c6-bc35-44a7-ba0c-3135a1270829.temp_image.49402770-3729-4c86-8f21-eb025be7045c0s_fcck_.img" returned: 0 in 0.802s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-931c7baf-11ba-4a0d-9019-5055bd74212c tempest-VolumesActionsTest-1890167577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0e7e39c6-bc35-44a7-ba0c-3135a1270829.temp_image.49402770-3729-4c86-8f21-eb025be7045c0s_fcck_.img {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:01 devstack sudo[102312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0e7e39c6-bc35-44a7-ba0c-3135a1270829.temp_image.49402770-3729-4c86-8f21-eb025be7045c0s_fcck_.img Jul 08 01:50:01 devstack sudo[102312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:01 devstack sudo[102312]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-931c7baf-11ba-4a0d-9019-5055bd74212c tempest-VolumesActionsTest-1890167577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0e7e39c6-bc35-44a7-ba0c-3135a1270829.temp_image.49402770-3729-4c86-8f21-eb025be7045c0s_fcck_.img" returned: 1 in 0.738s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-931c7baf-11ba-4a0d-9019-5055bd74212c tempest-VolumesActionsTest-1890167577 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0e7e39c6-bc35-44a7-ba0c-3135a1270829.temp_image.49402770-3729-4c86-8f21-eb025be7045c0s_fcck_.img' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:50:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-931c7baf-11ba-4a0d-9019-5055bd74212c tempest-VolumesActionsTest-1890167577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0e7e39c6-bc35-44a7-ba0c-3135a1270829.temp_image.49402770-3729-4c86-8f21-eb025be7045c0s_fcck_.img /opt/stack/data/cinder/conversion/vol_upload_ikn5stg5 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:01 devstack sudo[102317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0e7e39c6-bc35-44a7-ba0c-3135a1270829.temp_image.49402770-3729-4c86-8f21-eb025be7045c0s_fcck_.img /opt/stack/data/cinder/conversion/vol_upload_ikn5stg5 Jul 08 01:50:01 devstack sudo[102317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:02 devstack sudo[102317]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-931c7baf-11ba-4a0d-9019-5055bd74212c tempest-VolumesActionsTest-1890167577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0e7e39c6-bc35-44a7-ba0c-3135a1270829.temp_image.49402770-3729-4c86-8f21-eb025be7045c0s_fcck_.img /opt/stack/data/cinder/conversion/vol_upload_ikn5stg5" returned: 0 in 0.696s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:02 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-931c7baf-11ba-4a0d-9019-5055bd74212c tempest-VolumesActionsTest-1890167577 None] Image conversion details: src /opt/stack/data/cinder/conversion/0e7e39c6-bc35-44a7-ba0c-3135a1270829.temp_image.49402770-3729-4c86-8f21-eb025be7045c0s_fcck_.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_ikn5stg5 {{(pid=87284) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:50:02 devstack cinder-volume[87284]: INFO cinder.image.image_utils [None req-931c7baf-11ba-4a0d-9019-5055bd74212c tempest-VolumesActionsTest-1890167577 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 08 01:50:02 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[1565392a-e781-46d0-9965-a464e438ddb1]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:50:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-931c7baf-11ba-4a0d-9019-5055bd74212c tempest-VolumesActionsTest-1890167577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ikn5stg5 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:02 devstack sudo[102323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ikn5stg5 Jul 08 01:50:02 devstack sudo[102323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:03 devstack sudo[102323]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-931c7baf-11ba-4a0d-9019-5055bd74212c tempest-VolumesActionsTest-1890167577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ikn5stg5" returned: 0 in 0.759s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-931c7baf-11ba-4a0d-9019-5055bd74212c tempest-VolumesActionsTest-1890167577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.512s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:04 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-931c7baf-11ba-4a0d-9019-5055bd74212c tempest-VolumesActionsTest-1890167577 None] Uploaded volume to glance image-id: 49402770-3729-4c86-8f21-eb025be7045c. {{(pid=87284) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 08 01:50:04 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-931c7baf-11ba-4a0d-9019-5055bd74212c tempest-VolumesActionsTest-1890167577 None] Copy volume to image completed successfully. Jul 08 01:50:06 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-11cae199-265c-4ebe-80c5-e7b77b18b277 tempest-VolumesActionsTest-1890167577 None] Acquiring lock "cinder-0e7e39c6-bc35-44a7-ba0c-3135a1270829-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:06 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-11cae199-265c-4ebe-80c5-e7b77b18b277 tempest-VolumesActionsTest-1890167577 None] Lock "cinder-0e7e39c6-bc35-44a7-ba0c-3135a1270829-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:06 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-11cae199-265c-4ebe-80c5-e7b77b18b277 tempest-VolumesActionsTest-1890167577 None] Acquiring lock "cinder-quobyte-0e7e39c6-bc35-44a7-ba0c-3135a1270829" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:06 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-11cae199-265c-4ebe-80c5-e7b77b18b277 tempest-VolumesActionsTest-1890167577 None] Lock "cinder-quobyte-0e7e39c6-bc35-44a7-ba0c-3135a1270829" acquired by "delete_volume" :: waited 0.018s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:06 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bc0b99-512d-4152-bde4-c0db3d47ab58]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:50:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-11cae199-265c-4ebe-80c5-e7b77b18b277 tempest-VolumesActionsTest-1890167577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:06 devstack sudo[102329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829 Jul 08 01:50:06 devstack sudo[102329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:07 devstack sudo[102329]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-11cae199-265c-4ebe-80c5-e7b77b18b277 tempest-VolumesActionsTest-1890167577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829" returned: 0 in 0.844s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-11cae199-265c-4ebe-80c5-e7b77b18b277 tempest-VolumesActionsTest-1890167577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:07 devstack sudo[102336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829 Jul 08 01:50:07 devstack sudo[102336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:08 devstack sudo[102336]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-11cae199-265c-4ebe-80c5-e7b77b18b277 tempest-VolumesActionsTest-1890167577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0e7e39c6-bc35-44a7-ba0c-3135a1270829" returned: 0 in 0.680s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:08 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-11cae199-265c-4ebe-80c5-e7b77b18b277 tempest-VolumesActionsTest-1890167577 None] Lock "cinder-quobyte-0e7e39c6-bc35-44a7-ba0c-3135a1270829" released by "delete_volume" :: held 1.569s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:08 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-11cae199-265c-4ebe-80c5-e7b77b18b277 tempest-VolumesActionsTest-1890167577 None] Created reservations ['fdc637a7-2ea9-4ad1-815b-dfec88b405ca', '7b6d9310-b417-4dfb-9700-c885277e5da9', '2d4cf83c-acbf-4521-9fde-99c728d94f4a', '5cce3995-3646-4908-9289-5e97bae05205'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:50:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-11cae199-265c-4ebe-80c5-e7b77b18b277 tempest-VolumesActionsTest-1890167577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-11cae199-265c-4ebe-80c5-e7b77b18b277 tempest-VolumesActionsTest-1890167577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:08 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-11cae199-265c-4ebe-80c5-e7b77b18b277 tempest-VolumesActionsTest-1890167577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:50:08 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-11cae199-265c-4ebe-80c5-e7b77b18b277 tempest-VolumesActionsTest-1890167577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:50:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-11cae199-265c-4ebe-80c5-e7b77b18b277 tempest-VolumesActionsTest-1890167577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-11cae199-265c-4ebe-80c5-e7b77b18b277 tempest-VolumesActionsTest-1890167577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:08 devstack sudo[102340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:50:08 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:09 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-11cae199-265c-4ebe-80c5-e7b77b18b277 tempest-VolumesActionsTest-1890167577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.736s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:09 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-11cae199-265c-4ebe-80c5-e7b77b18b277 tempest-VolumesActionsTest-1890167577 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:50:09 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-11cae199-265c-4ebe-80c5-e7b77b18b277 tempest-VolumesActionsTest-1890167577 None] Deleted volume successfully. Jul 08 01:50:09 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-11cae199-265c-4ebe-80c5-e7b77b18b277 tempest-VolumesActionsTest-1890167577 None] Lock "cinder-0e7e39c6-bc35-44a7-ba0c-3135a1270829-delete_volume" released by "delete_volume" :: held 2.549s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:16 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b68d21e-1e1c-4040-b22d-2bb4bfcfbf7f tempest-VolumesCloneTest-1977122413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:50:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4b68d21e-1e1c-4040-b22d-2bb4bfcfbf7f tempest-VolumesCloneTest-1977122413 None] Flow 'volume_create_manager' (792f763c-3973-401e-b192-671e3b442a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:50:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4b68d21e-1e1c-4040-b22d-2bb4bfcfbf7f tempest-VolumesCloneTest-1977122413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e519a11e-9e15-4796-b4f5-ec9574d9b083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4b68d21e-1e1c-4040-b22d-2bb4bfcfbf7f tempest-VolumesCloneTest-1977122413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e519a11e-9e15-4796-b4f5-ec9574d9b083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1037339244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2600c8a3-074b-411d-a9f2-eca8fecf2196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f983f300c8246b5a8e5de5cc261a6f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:50:16Z,use_quota=True,user_id='c1fa99fce7d9485ea89fd4a387369d31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4b68d21e-1e1c-4040-b22d-2bb4bfcfbf7f tempest-VolumesCloneTest-1977122413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c3690e-fdc0-4a00-9e9a-0e3e79ed0eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4b68d21e-1e1c-4040-b22d-2bb4bfcfbf7f tempest-VolumesCloneTest-1977122413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c3690e-fdc0-4a00-9e9a-0e3e79ed0eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4b68d21e-1e1c-4040-b22d-2bb4bfcfbf7f tempest-VolumesCloneTest-1977122413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (985b12cd-05bb-4ba1-b0f9-352243905cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4b68d21e-1e1c-4040-b22d-2bb4bfcfbf7f tempest-VolumesCloneTest-1977122413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (985b12cd-05bb-4ba1-b0f9-352243905cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2600c8a3-074b-411d-a9f2-eca8fecf2196', 'volume_name': 'volume-2600c8a3-074b-411d-a9f2-eca8fecf2196', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4b68d21e-1e1c-4040-b22d-2bb4bfcfbf7f tempest-VolumesCloneTest-1977122413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1853e068-d6a2-4c84-9296-a3901881494e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4b68d21e-1e1c-4040-b22d-2bb4bfcfbf7f tempest-VolumesCloneTest-1977122413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1853e068-d6a2-4c84-9296-a3901881494e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4b68d21e-1e1c-4040-b22d-2bb4bfcfbf7f tempest-VolumesCloneTest-1977122413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5872712e-5cd7-432d-8e82-711fc4d9f3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:16 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-4b68d21e-1e1c-4040-b22d-2bb4bfcfbf7f tempest-VolumesCloneTest-1977122413 None] Volume 2600c8a3-074b-411d-a9f2-eca8fecf2196: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2600c8a3-074b-411d-a9f2-eca8fecf2196', 'volume_size': 1} Jul 08 01:50:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4b68d21e-1e1c-4040-b22d-2bb4bfcfbf7f tempest-VolumesCloneTest-1977122413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4b68d21e-1e1c-4040-b22d-2bb4bfcfbf7f tempest-VolumesCloneTest-1977122413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:16 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-4b68d21e-1e1c-4040-b22d-2bb4bfcfbf7f tempest-VolumesCloneTest-1977122413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1037339244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2600c8a3-074b-411d-a9f2-eca8fecf2196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f983f300c8246b5a8e5de5cc261a6f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:50:16Z,use_quota=True,user_id='c1fa99fce7d9485ea89fd4a387369d31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:50:16 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-4b68d21e-1e1c-4040-b22d-2bb4bfcfbf7f tempest-VolumesCloneTest-1977122413 None] Creating volume 2600c8a3-074b-411d-a9f2-eca8fecf2196 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:50:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4b68d21e-1e1c-4040-b22d-2bb4bfcfbf7f tempest-VolumesCloneTest-1977122413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4b68d21e-1e1c-4040-b22d-2bb4bfcfbf7f tempest-VolumesCloneTest-1977122413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:16 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-4b68d21e-1e1c-4040-b22d-2bb4bfcfbf7f tempest-VolumesCloneTest-1977122413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:50:16 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-4b68d21e-1e1c-4040-b22d-2bb4bfcfbf7f tempest-VolumesCloneTest-1977122413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:50:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4b68d21e-1e1c-4040-b22d-2bb4bfcfbf7f tempest-VolumesCloneTest-1977122413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:16 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-4b68d21e-1e1c-4040-b22d-2bb4bfcfbf7f tempest-VolumesCloneTest-1977122413 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:50:16 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-4b68d21e-1e1c-4040-b22d-2bb4bfcfbf7f tempest-VolumesCloneTest-1977122413 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:50:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4b68d21e-1e1c-4040-b22d-2bb4bfcfbf7f tempest-VolumesCloneTest-1977122413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:16 devstack sudo[102347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196 1073741824 Jul 08 01:50:16 devstack sudo[102347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:17 devstack sudo[102347]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4b68d21e-1e1c-4040-b22d-2bb4bfcfbf7f tempest-VolumesCloneTest-1977122413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196 1073741824" returned: 0 in 1.006s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4b68d21e-1e1c-4040-b22d-2bb4bfcfbf7f tempest-VolumesCloneTest-1977122413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:17 devstack sudo[102353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196 Jul 08 01:50:17 devstack sudo[102353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:17 devstack sudo[102353]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4b68d21e-1e1c-4040-b22d-2bb4bfcfbf7f tempest-VolumesCloneTest-1977122413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196" returned: 0 in 0.674s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:17 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-4b68d21e-1e1c-4040-b22d-2bb4bfcfbf7f tempest-VolumesCloneTest-1977122413 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:50:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4b68d21e-1e1c-4040-b22d-2bb4bfcfbf7f tempest-VolumesCloneTest-1977122413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:17 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4b68d21e-1e1c-4040-b22d-2bb4bfcfbf7f tempest-VolumesCloneTest-1977122413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5872712e-5cd7-432d-8e82-711fc4d9f3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2600c8a3-074b-411d-a9f2-eca8fecf2196', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:17 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4b68d21e-1e1c-4040-b22d-2bb4bfcfbf7f tempest-VolumesCloneTest-1977122413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e9a72a-04ba-4364-9c30-9902ead34e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:18 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-4b68d21e-1e1c-4040-b22d-2bb4bfcfbf7f tempest-VolumesCloneTest-1977122413 None] Volume volume-2600c8a3-074b-411d-a9f2-eca8fecf2196 (2600c8a3-074b-411d-a9f2-eca8fecf2196): created successfully Jul 08 01:50:18 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4b68d21e-1e1c-4040-b22d-2bb4bfcfbf7f tempest-VolumesCloneTest-1977122413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e9a72a-04ba-4364-9c30-9902ead34e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:18 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4b68d21e-1e1c-4040-b22d-2bb4bfcfbf7f tempest-VolumesCloneTest-1977122413 None] Flow 'volume_create_manager' (792f763c-3973-401e-b192-671e3b442a68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:50:18 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-4b68d21e-1e1c-4040-b22d-2bb4bfcfbf7f tempest-VolumesCloneTest-1977122413 None] Created volume successfully. Jul 08 01:50:18 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:50:18 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Flow 'volume_create_manager' (bd89108c-cf4e-4ddf-a5a0-70fecd3fba39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:50:18 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5d55ae6-dc77-490c-b64c-5574fd0843f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:18 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5d55ae6-dc77-490c-b64c-5574fd0843f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-787813382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1db913ea-f1e8-4ef8-b7fd-9925cad8e14e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f983f300c8246b5a8e5de5cc261a6f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:50:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=2600c8a3-074b-411d-a9f2-eca8fecf2196,status='creating',terminated_at=None,updated_at=2026-07-07T23:50:19Z,use_quota=True,user_id='c1fa99fce7d9485ea89fd4a387369d31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:18 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbb3bfb2-6fe9-4cd0-93d2-33ac45101c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:18 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbb3bfb2-6fe9-4cd0-93d2-33ac45101c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:18 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5bfe530-6c1c-4d48-92b8-c4f37c20ea63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:18 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5bfe530-6c1c-4d48-92b8-c4f37c20ea63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1db913ea-f1e8-4ef8-b7fd-9925cad8e14e', 'volume_name': 'volume-1db913ea-f1e8-4ef8-b7fd-9925cad8e14e', 'volume_size': 2, 'source_volid': '2600c8a3-074b-411d-a9f2-eca8fecf2196', 'source_volstatus': 'available'}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:18 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa1eaf8-8340-49fc-b016-cab3f4ff1e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:18 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa1eaf8-8340-49fc-b016-cab3f4ff1e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:18 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24dadc45-a23f-467b-8f9e-12c519c51d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:18 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Volume 1db913ea-f1e8-4ef8-b7fd-9925cad8e14e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1db913ea-f1e8-4ef8-b7fd-9925cad8e14e', 'volume_size': 2, 'source_volid': '2600c8a3-074b-411d-a9f2-eca8fecf2196', 'source_volstatus': 'available'} Jul 08 01:50:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:18 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Cloning volume 2600c8a3-074b-411d-a9f2-eca8fecf2196 to volume 1db913ea-f1e8-4ef8-b7fd-9925cad8e14e Jul 08 01:50:18 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Creating offline snapshot 1c466545-e216-4c10-9c01-77b5e28c73a9 of volume 2600c8a3-074b-411d-a9f2-eca8fecf2196 {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:50:18 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[929af549-b834-4f3a-9f3b-68fb949ec20d]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:50:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:19 devstack sudo[102356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196 Jul 08 01:50:19 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:19 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196" returned: 0 in 0.841s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196.1c466545-e216-4c10-9c01-77b5e28c73a9 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:19 devstack sudo[102361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196.1c466545-e216-4c10-9c01-77b5e28c73a9 1G Jul 08 01:50:19 devstack sudo[102361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:20 devstack sudo[102361]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196.1c466545-e216-4c10-9c01-77b5e28c73a9 1G" returned: 0 in 1.043s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2600c8a3-074b-411d-a9f2-eca8fecf2196 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196.1c466545-e216-4c10-9c01-77b5e28c73a9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:20 devstack sudo[102366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2600c8a3-074b-411d-a9f2-eca8fecf2196 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196.1c466545-e216-4c10-9c01-77b5e28c73a9 Jul 08 01:50:20 devstack sudo[102366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:21 devstack sudo[102366]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2600c8a3-074b-411d-a9f2-eca8fecf2196 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196.1c466545-e216-4c10-9c01-77b5e28c73a9" returned: 0 in 0.849s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:21 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196.1c466545-e216-4c10-9c01-77b5e28c73a9 is being set with open permissions: ugo+rw Jul 08 01:50:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196.1c466545-e216-4c10-9c01-77b5e28c73a9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:21 devstack sudo[102371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196.1c466545-e216-4c10-9c01-77b5e28c73a9 Jul 08 01:50:21 devstack sudo[102371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:22 devstack sudo[102371]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196.1c466545-e216-4c10-9c01-77b5e28c73a9" returned: 0 in 0.732s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:22 devstack sudo[102374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196.info Jul 08 01:50:22 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:23 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196.info" returned: 0 in 0.753s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:23 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196.info is being set with open permissions: ugo+rw Jul 08 01:50:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:23 devstack sudo[102377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196.info Jul 08 01:50:23 devstack sudo[102377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:23 devstack sudo[102377]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196.info" returned: 0 in 0.717s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:24 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Acquiring lock "cinder-quobyte-1db913ea-f1e8-4ef8-b7fd-9925cad8e14e" by "_copy_volume_from_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:24 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Lock "cinder-quobyte-1db913ea-f1e8-4ef8-b7fd-9925cad8e14e" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:24 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] snapshot: 1c466545-e216-4c10-9c01-77b5e28c73a9, volume: 1db913ea-f1e8-4ef8-b7fd-9925cad8e14e, {{(pid=87284) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:50:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:24 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:50:24 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:50:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:24 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e6cc3e-27a6-4273-b1e4-818a5e489a3f]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:50:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196.1c466545-e216-4c10-9c01-77b5e28c73a9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:24 devstack sudo[102380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196.1c466545-e216-4c10-9c01-77b5e28c73a9 Jul 08 01:50:24 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:24 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196.1c466545-e216-4c10-9c01-77b5e28c73a9" returned: 0 in 0.789s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:24 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2600c8a3-074b-411d-a9f2-eca8fecf2196(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:50:24 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196 {{(pid=87284) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:50:24 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Creating direct copy from snapshot {{(pid=87284) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:50:24 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e57f6b-ca1a-43c8-a129-87a3871b20f7]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:50:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:24 devstack sudo[102385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196 Jul 08 01:50:24 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:25 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196" returned: 0 in 0.947s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:25 devstack cinder-volume[87284]: DEBUG cinder.utils [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Path /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1db913ea-f1e8-4ef8-b7fd-9925cad8e14e not found in is_blk_device check {{(pid=87284) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:50:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1db913ea-f1e8-4ef8-b7fd-9925cad8e14e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:25 devstack sudo[102391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1db913ea-f1e8-4ef8-b7fd-9925cad8e14e Jul 08 01:50:25 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:30 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1db913ea-f1e8-4ef8-b7fd-9925cad8e14e" returned: 0 in 4.975s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:30 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2e6348-c05d-4321-9bf7-d8301b865cf0]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:50:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:30 devstack sudo[102410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196 Jul 08 01:50:30 devstack sudo[102410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:31 devstack sudo[102410]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196" returned: 0 in 1.094s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:31 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Image conversion details: src /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196, size 1024.00 MB, duration 4.98 sec, destination /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1db913ea-f1e8-4ef8-b7fd-9925cad8e14e {{(pid=87284) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:50:31 devstack cinder-volume[87284]: INFO cinder.image.image_utils [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Converted 1024.00 MB image at 205.76 MB/s Jul 08 01:50:31 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1db913ea-f1e8-4ef8-b7fd-9925cad8e14e is being set with open permissions: ugo+rw Jul 08 01:50:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1db913ea-f1e8-4ef8-b7fd-9925cad8e14e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:31 devstack sudo[102415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1db913ea-f1e8-4ef8-b7fd-9925cad8e14e Jul 08 01:50:31 devstack sudo[102415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:32 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=14,cinder:INSERT=3,cinder:UPDATE=12 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:50:32 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=13,cinder:UPDATE=14,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:50:32 devstack sudo[102415]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1db913ea-f1e8-4ef8-b7fd-9925cad8e14e" returned: 0 in 0.742s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:32 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Lock "cinder-quobyte-1db913ea-f1e8-4ef8-b7fd-9925cad8e14e" released by "_copy_volume_from_snapshot" :: held 8.646s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:32 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Acquiring lock "cinder-quobyte-1c466545-e216-4c10-9c01-77b5e28c73a9" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:32 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Lock "cinder-quobyte-1c466545-e216-4c10-9c01-77b5e28c73a9" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:32 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Deleting offline snapshot 1c466545-e216-4c10-9c01-77b5e28c73a9 of volume 2600c8a3-074b-411d-a9f2-eca8fecf2196 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:50:32 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] snapshot_file for this snap is: volume-2600c8a3-074b-411d-a9f2-eca8fecf2196.1c466545-e216-4c10-9c01-77b5e28c73a9 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:50:32 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[285e1a13-e87d-476f-b1ca-18522856666d]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:50:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196.1c466545-e216-4c10-9c01-77b5e28c73a9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:32 devstack sudo[102418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196.1c466545-e216-4c10-9c01-77b5e28c73a9 Jul 08 01:50:32 devstack sudo[102418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:33 devstack sudo[102418]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196.1c466545-e216-4c10-9c01-77b5e28c73a9" returned: 0 in 0.859s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:33 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2600c8a3-074b-411d-a9f2-eca8fecf2196(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:50:33 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[455ff645-bad6-47f5-93e1-af25537a9999]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:50:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:33 devstack sudo[102423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196 Jul 08 01:50:33 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:34 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196" returned: 0 in 0.879s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196.1c466545-e216-4c10-9c01-77b5e28c73a9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:34 devstack sudo[102428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196.1c466545-e216-4c10-9c01-77b5e28c73a9 Jul 08 01:50:34 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:35 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196.1c466545-e216-4c10-9c01-77b5e28c73a9" returned: 0 in 0.773s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196.1c466545-e216-4c10-9c01-77b5e28c73a9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:35 devstack sudo[102433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196.1c466545-e216-4c10-9c01-77b5e28c73a9 Jul 08 01:50:35 devstack sudo[102433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:36 devstack sudo[102433]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196.1c466545-e216-4c10-9c01-77b5e28c73a9" returned: 0 in 0.725s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:36 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Lock "cinder-quobyte-1c466545-e216-4c10-9c01-77b5e28c73a9" released by "_delete_snapshot" :: held 3.340s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.188s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24dadc45-a23f-467b-8f9e-12c519c51d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1db913ea-f1e8-4ef8-b7fd-9925cad8e14e', 'volume_size': 2, 'source_volid': '2600c8a3-074b-411d-a9f2-eca8fecf2196', 'source_volstatus': 'available'}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f633c60-eba4-4a3b-ae21-9a40bbcda5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:36 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Volume volume-1db913ea-f1e8-4ef8-b7fd-9925cad8e14e (1db913ea-f1e8-4ef8-b7fd-9925cad8e14e): created successfully Jul 08 01:50:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f633c60-eba4-4a3b-ae21-9a40bbcda5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Flow 'volume_create_manager' (bd89108c-cf4e-4ddf-a5a0-70fecd3fba39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:50:36 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-e6a5e5fb-f8be-475d-ab4c-dc5696d55e80 tempest-VolumesCloneTest-1977122413 None] Created volume successfully. Jul 08 01:50:37 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f49772fe-516f-4443-9e66-6ebd493b94fa tempest-VolumesCloneTest-1977122413 None] Acquiring lock "cinder-1db913ea-f1e8-4ef8-b7fd-9925cad8e14e-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:37 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f49772fe-516f-4443-9e66-6ebd493b94fa tempest-VolumesCloneTest-1977122413 None] Lock "cinder-1db913ea-f1e8-4ef8-b7fd-9925cad8e14e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:37 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f49772fe-516f-4443-9e66-6ebd493b94fa tempest-VolumesCloneTest-1977122413 None] Acquiring lock "cinder-quobyte-1db913ea-f1e8-4ef8-b7fd-9925cad8e14e" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:37 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f49772fe-516f-4443-9e66-6ebd493b94fa tempest-VolumesCloneTest-1977122413 None] Lock "cinder-quobyte-1db913ea-f1e8-4ef8-b7fd-9925cad8e14e" acquired by "delete_volume" :: waited 0.019s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:37 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97415dc-77c9-442e-9cdd-6701f5cd6990]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:50:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f49772fe-516f-4443-9e66-6ebd493b94fa tempest-VolumesCloneTest-1977122413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1db913ea-f1e8-4ef8-b7fd-9925cad8e14e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:37 devstack sudo[102471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1db913ea-f1e8-4ef8-b7fd-9925cad8e14e Jul 08 01:50:37 devstack sudo[102471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:38 devstack sudo[102471]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f49772fe-516f-4443-9e66-6ebd493b94fa tempest-VolumesCloneTest-1977122413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1db913ea-f1e8-4ef8-b7fd-9925cad8e14e" returned: 0 in 0.851s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f49772fe-516f-4443-9e66-6ebd493b94fa tempest-VolumesCloneTest-1977122413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1db913ea-f1e8-4ef8-b7fd-9925cad8e14e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:38 devstack sudo[102478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1db913ea-f1e8-4ef8-b7fd-9925cad8e14e Jul 08 01:50:38 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:39 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f49772fe-516f-4443-9e66-6ebd493b94fa tempest-VolumesCloneTest-1977122413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1db913ea-f1e8-4ef8-b7fd-9925cad8e14e" returned: 0 in 0.703s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:39 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f49772fe-516f-4443-9e66-6ebd493b94fa tempest-VolumesCloneTest-1977122413 None] Lock "cinder-quobyte-1db913ea-f1e8-4ef8-b7fd-9925cad8e14e" released by "delete_volume" :: held 1.605s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:39 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-f49772fe-516f-4443-9e66-6ebd493b94fa tempest-VolumesCloneTest-1977122413 None] Created reservations ['ad9cbebd-310b-4ece-a52b-672b6e2f9872', '0defc65f-e623-42c1-b362-82f6acce2ddf', '603da624-e26d-45b5-9ca8-53fd580af514', 'f28d220a-9654-4e47-a85d-05b83cab3a00'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:50:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f49772fe-516f-4443-9e66-6ebd493b94fa tempest-VolumesCloneTest-1977122413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f49772fe-516f-4443-9e66-6ebd493b94fa tempest-VolumesCloneTest-1977122413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:39 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f49772fe-516f-4443-9e66-6ebd493b94fa tempest-VolumesCloneTest-1977122413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:50:39 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f49772fe-516f-4443-9e66-6ebd493b94fa tempest-VolumesCloneTest-1977122413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:50:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f49772fe-516f-4443-9e66-6ebd493b94fa tempest-VolumesCloneTest-1977122413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f49772fe-516f-4443-9e66-6ebd493b94fa tempest-VolumesCloneTest-1977122413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:39 devstack sudo[102481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:50:39 devstack sudo[102481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:39 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-0ea9e3c4-86af-4827-b865-228573edc1b0 tempest-VolumesCloneTest-1977122413 None] Acquiring lock "cinder-2600c8a3-074b-411d-a9f2-eca8fecf2196-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:39 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-0ea9e3c4-86af-4827-b865-228573edc1b0 tempest-VolumesCloneTest-1977122413 None] Lock "cinder-2600c8a3-074b-411d-a9f2-eca8fecf2196-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:39 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-0ea9e3c4-86af-4827-b865-228573edc1b0 tempest-VolumesCloneTest-1977122413 None] Acquiring lock "cinder-quobyte-2600c8a3-074b-411d-a9f2-eca8fecf2196" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:39 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-0ea9e3c4-86af-4827-b865-228573edc1b0 tempest-VolumesCloneTest-1977122413 None] Lock "cinder-quobyte-2600c8a3-074b-411d-a9f2-eca8fecf2196" acquired by "delete_volume" :: waited 0.025s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:40 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e147e9c-07f3-4696-8583-b4f3a6e8fc8e]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:50:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0ea9e3c4-86af-4827-b865-228573edc1b0 tempest-VolumesCloneTest-1977122413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:40 devstack sudo[102481]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f49772fe-516f-4443-9e66-6ebd493b94fa tempest-VolumesCloneTest-1977122413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.761s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:40 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-f49772fe-516f-4443-9e66-6ebd493b94fa tempest-VolumesCloneTest-1977122413 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:50:40 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-f49772fe-516f-4443-9e66-6ebd493b94fa tempest-VolumesCloneTest-1977122413 None] Deleted volume successfully. Jul 08 01:50:40 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f49772fe-516f-4443-9e66-6ebd493b94fa tempest-VolumesCloneTest-1977122413 None] Lock "cinder-1db913ea-f1e8-4ef8-b7fd-9925cad8e14e-delete_volume" released by "delete_volume" :: held 2.635s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:40 devstack sudo[102484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196 Jul 08 01:50:40 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:40 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0ea9e3c4-86af-4827-b865-228573edc1b0 tempest-VolumesCloneTest-1977122413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196" returned: 0 in 0.906s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0ea9e3c4-86af-4827-b865-228573edc1b0 tempest-VolumesCloneTest-1977122413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:40 devstack sudo[102489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196 Jul 08 01:50:40 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:41 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0ea9e3c4-86af-4827-b865-228573edc1b0 tempest-VolumesCloneTest-1977122413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2600c8a3-074b-411d-a9f2-eca8fecf2196" returned: 0 in 0.683s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:41 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-0ea9e3c4-86af-4827-b865-228573edc1b0 tempest-VolumesCloneTest-1977122413 None] Lock "cinder-quobyte-2600c8a3-074b-411d-a9f2-eca8fecf2196" released by "delete_volume" :: held 1.674s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:41 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-0ea9e3c4-86af-4827-b865-228573edc1b0 tempest-VolumesCloneTest-1977122413 None] Created reservations ['cd157a71-4dc4-4d71-8176-2ca48955b15d', 'd39792b8-6010-457b-b255-fbe06a063e45', 'ddd16727-9832-449d-8074-cc4169578c46', 'ca803970-05b1-4a27-a603-8a5113f42c02'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:50:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0ea9e3c4-86af-4827-b865-228573edc1b0 tempest-VolumesCloneTest-1977122413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0ea9e3c4-86af-4827-b865-228573edc1b0 tempest-VolumesCloneTest-1977122413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:41 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0ea9e3c4-86af-4827-b865-228573edc1b0 tempest-VolumesCloneTest-1977122413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:50:41 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0ea9e3c4-86af-4827-b865-228573edc1b0 tempest-VolumesCloneTest-1977122413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:50:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0ea9e3c4-86af-4827-b865-228573edc1b0 tempest-VolumesCloneTest-1977122413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0ea9e3c4-86af-4827-b865-228573edc1b0 tempest-VolumesCloneTest-1977122413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:41 devstack sudo[102492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:50:41 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:42 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0ea9e3c4-86af-4827-b865-228573edc1b0 tempest-VolumesCloneTest-1977122413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.734s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:42 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-0ea9e3c4-86af-4827-b865-228573edc1b0 tempest-VolumesCloneTest-1977122413 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:50:42 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-0ea9e3c4-86af-4827-b865-228573edc1b0 tempest-VolumesCloneTest-1977122413 None] Deleted volume successfully. Jul 08 01:50:42 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-0ea9e3c4-86af-4827-b865-228573edc1b0 tempest-VolumesCloneTest-1977122413 None] Lock "cinder-2600c8a3-074b-411d-a9f2-eca8fecf2196-delete_volume" released by "delete_volume" :: held 2.665s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:45 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-2db60f2c-7721-40f8-9fcf-546788ebca9d tempest-VolumesGetTest-903145024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:50:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2db60f2c-7721-40f8-9fcf-546788ebca9d tempest-VolumesGetTest-903145024 None] Flow 'volume_create_manager' (855b9529-d975-4de5-83e5-414ddff03516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:50:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2db60f2c-7721-40f8-9fcf-546788ebca9d tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f2bc1b0-5995-4519-bdca-0a2f4ed1c1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2db60f2c-7721-40f8-9fcf-546788ebca9d tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f2bc1b0-5995-4519-bdca-0a2f4ed1c1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1187098279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b349644b-d385-43cc-bddd-c27d8b8f99c8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='beeba2059c0a4654bf9afe0364d0f518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:50:45Z,use_quota=True,user_id='a8d30b0dc18249c4bf2869d08aeffcec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2db60f2c-7721-40f8-9fcf-546788ebca9d tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61544da4-c33f-47f4-818e-b674a4aebc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2db60f2c-7721-40f8-9fcf-546788ebca9d tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61544da4-c33f-47f4-818e-b674a4aebc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2db60f2c-7721-40f8-9fcf-546788ebca9d tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18381a91-4481-4093-96c8-c9659391ce51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2db60f2c-7721-40f8-9fcf-546788ebca9d tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18381a91-4481-4093-96c8-c9659391ce51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b349644b-d385-43cc-bddd-c27d8b8f99c8', 'volume_name': 'volume-b349644b-d385-43cc-bddd-c27d8b8f99c8', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2db60f2c-7721-40f8-9fcf-546788ebca9d tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40884d1a-b948-4ebc-ba02-569688db2929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2db60f2c-7721-40f8-9fcf-546788ebca9d tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40884d1a-b948-4ebc-ba02-569688db2929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2db60f2c-7721-40f8-9fcf-546788ebca9d tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e62a0035-802c-4e8a-adbc-65f4126611d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:45 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-2db60f2c-7721-40f8-9fcf-546788ebca9d tempest-VolumesGetTest-903145024 None] Volume b349644b-d385-43cc-bddd-c27d8b8f99c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b349644b-d385-43cc-bddd-c27d8b8f99c8', 'volume_size': 1} Jul 08 01:50:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2db60f2c-7721-40f8-9fcf-546788ebca9d tempest-VolumesGetTest-903145024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2db60f2c-7721-40f8-9fcf-546788ebca9d tempest-VolumesGetTest-903145024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:45 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2db60f2c-7721-40f8-9fcf-546788ebca9d tempest-VolumesGetTest-903145024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1187098279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b349644b-d385-43cc-bddd-c27d8b8f99c8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='beeba2059c0a4654bf9afe0364d0f518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:50:45Z,use_quota=True,user_id='a8d30b0dc18249c4bf2869d08aeffcec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:50:45 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-2db60f2c-7721-40f8-9fcf-546788ebca9d tempest-VolumesGetTest-903145024 None] Creating volume b349644b-d385-43cc-bddd-c27d8b8f99c8 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:50:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2db60f2c-7721-40f8-9fcf-546788ebca9d tempest-VolumesGetTest-903145024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2db60f2c-7721-40f8-9fcf-546788ebca9d tempest-VolumesGetTest-903145024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:45 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2db60f2c-7721-40f8-9fcf-546788ebca9d tempest-VolumesGetTest-903145024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:50:45 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2db60f2c-7721-40f8-9fcf-546788ebca9d tempest-VolumesGetTest-903145024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:50:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2db60f2c-7721-40f8-9fcf-546788ebca9d tempest-VolumesGetTest-903145024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:45 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2db60f2c-7721-40f8-9fcf-546788ebca9d tempest-VolumesGetTest-903145024 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:50:45 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-2db60f2c-7721-40f8-9fcf-546788ebca9d tempest-VolumesGetTest-903145024 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:50:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2db60f2c-7721-40f8-9fcf-546788ebca9d tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b349644b-d385-43cc-bddd-c27d8b8f99c8 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:45 devstack sudo[102495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b349644b-d385-43cc-bddd-c27d8b8f99c8 1073741824 Jul 08 01:50:45 devstack sudo[102495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:46 devstack sudo[102495]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2db60f2c-7721-40f8-9fcf-546788ebca9d tempest-VolumesGetTest-903145024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b349644b-d385-43cc-bddd-c27d8b8f99c8 1073741824" returned: 0 in 0.895s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2db60f2c-7721-40f8-9fcf-546788ebca9d tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b349644b-d385-43cc-bddd-c27d8b8f99c8 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:46 devstack sudo[102502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b349644b-d385-43cc-bddd-c27d8b8f99c8 Jul 08 01:50:46 devstack sudo[102502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:46 devstack sudo[102502]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2db60f2c-7721-40f8-9fcf-546788ebca9d tempest-VolumesGetTest-903145024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b349644b-d385-43cc-bddd-c27d8b8f99c8" returned: 0 in 0.669s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:46 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2db60f2c-7721-40f8-9fcf-546788ebca9d tempest-VolumesGetTest-903145024 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:50:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2db60f2c-7721-40f8-9fcf-546788ebca9d tempest-VolumesGetTest-903145024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2db60f2c-7721-40f8-9fcf-546788ebca9d tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e62a0035-802c-4e8a-adbc-65f4126611d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b349644b-d385-43cc-bddd-c27d8b8f99c8', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2db60f2c-7721-40f8-9fcf-546788ebca9d tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41b967e6-12f2-4bd7-8079-e251bec289e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:46 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-2db60f2c-7721-40f8-9fcf-546788ebca9d tempest-VolumesGetTest-903145024 None] Volume volume-b349644b-d385-43cc-bddd-c27d8b8f99c8 (b349644b-d385-43cc-bddd-c27d8b8f99c8): created successfully Jul 08 01:50:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2db60f2c-7721-40f8-9fcf-546788ebca9d tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41b967e6-12f2-4bd7-8079-e251bec289e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2db60f2c-7721-40f8-9fcf-546788ebca9d tempest-VolumesGetTest-903145024 None] Flow 'volume_create_manager' (855b9529-d975-4de5-83e5-414ddff03516) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:50:46 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-2db60f2c-7721-40f8-9fcf-546788ebca9d tempest-VolumesGetTest-903145024 None] Created volume successfully. Jul 08 01:50:48 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-c92e74f9-0a97-4adf-a0df-eb28a3a24e8e tempest-VolumesGetTest-903145024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:50:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c92e74f9-0a97-4adf-a0df-eb28a3a24e8e tempest-VolumesGetTest-903145024 None] Flow 'volume_create_manager' (66803072-e199-48fd-afb0-d997caaf3227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:50:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c92e74f9-0a97-4adf-a0df-eb28a3a24e8e tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c0e38ee-9a0c-4025-a999-1d21d8d3cfe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c92e74f9-0a97-4adf-a0df-eb28a3a24e8e tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c0e38ee-9a0c-4025-a999-1d21d8d3cfe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:50:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-476661664',display_name='tempest-VolumesGetTest-Volume-81299718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0dc21c3-5ebf-4386-b2b9-4b107ba9b474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='beeba2059c0a4654bf9afe0364d0f518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:50:48Z,use_quota=True,user_id='a8d30b0dc18249c4bf2869d08aeffcec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c92e74f9-0a97-4adf-a0df-eb28a3a24e8e tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2110aac-d1dd-4925-930f-209e620a2e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c92e74f9-0a97-4adf-a0df-eb28a3a24e8e tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2110aac-d1dd-4925-930f-209e620a2e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c92e74f9-0a97-4adf-a0df-eb28a3a24e8e tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c55d13-007c-4f15-94fb-6969c070a102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c92e74f9-0a97-4adf-a0df-eb28a3a24e8e tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c55d13-007c-4f15-94fb-6969c070a102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0dc21c3-5ebf-4386-b2b9-4b107ba9b474', 'volume_name': 'volume-a0dc21c3-5ebf-4386-b2b9-4b107ba9b474', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c92e74f9-0a97-4adf-a0df-eb28a3a24e8e tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44b13f18-8c66-4f02-b67e-b1d2a747db94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c92e74f9-0a97-4adf-a0df-eb28a3a24e8e tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44b13f18-8c66-4f02-b67e-b1d2a747db94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c92e74f9-0a97-4adf-a0df-eb28a3a24e8e tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5926741-b8ce-45b3-9931-cb2bb7ef3555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:48 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-c92e74f9-0a97-4adf-a0df-eb28a3a24e8e tempest-VolumesGetTest-903145024 None] Volume a0dc21c3-5ebf-4386-b2b9-4b107ba9b474: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0dc21c3-5ebf-4386-b2b9-4b107ba9b474', 'volume_size': 1} Jul 08 01:50:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c92e74f9-0a97-4adf-a0df-eb28a3a24e8e tempest-VolumesGetTest-903145024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c92e74f9-0a97-4adf-a0df-eb28a3a24e8e tempest-VolumesGetTest-903145024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:48 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c92e74f9-0a97-4adf-a0df-eb28a3a24e8e tempest-VolumesGetTest-903145024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:50:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-476661664',display_name='tempest-VolumesGetTest-Volume-81299718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0dc21c3-5ebf-4386-b2b9-4b107ba9b474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='beeba2059c0a4654bf9afe0364d0f518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:50:48Z,use_quota=True,user_id='a8d30b0dc18249c4bf2869d08aeffcec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:50:48 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-c92e74f9-0a97-4adf-a0df-eb28a3a24e8e tempest-VolumesGetTest-903145024 None] Creating volume a0dc21c3-5ebf-4386-b2b9-4b107ba9b474 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:50:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c92e74f9-0a97-4adf-a0df-eb28a3a24e8e tempest-VolumesGetTest-903145024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c92e74f9-0a97-4adf-a0df-eb28a3a24e8e tempest-VolumesGetTest-903145024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:48 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c92e74f9-0a97-4adf-a0df-eb28a3a24e8e tempest-VolumesGetTest-903145024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:50:48 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c92e74f9-0a97-4adf-a0df-eb28a3a24e8e tempest-VolumesGetTest-903145024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:50:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c92e74f9-0a97-4adf-a0df-eb28a3a24e8e tempest-VolumesGetTest-903145024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:48 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c92e74f9-0a97-4adf-a0df-eb28a3a24e8e tempest-VolumesGetTest-903145024 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:50:48 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-c92e74f9-0a97-4adf-a0df-eb28a3a24e8e tempest-VolumesGetTest-903145024 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:50:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c92e74f9-0a97-4adf-a0df-eb28a3a24e8e tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a0dc21c3-5ebf-4386-b2b9-4b107ba9b474 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:48 devstack sudo[102505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a0dc21c3-5ebf-4386-b2b9-4b107ba9b474 1073741824 Jul 08 01:50:48 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:49 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c92e74f9-0a97-4adf-a0df-eb28a3a24e8e tempest-VolumesGetTest-903145024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a0dc21c3-5ebf-4386-b2b9-4b107ba9b474 1073741824" returned: 0 in 0.959s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c92e74f9-0a97-4adf-a0df-eb28a3a24e8e tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a0dc21c3-5ebf-4386-b2b9-4b107ba9b474 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:49 devstack sudo[102512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a0dc21c3-5ebf-4386-b2b9-4b107ba9b474 Jul 08 01:50:49 devstack sudo[102512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:49 devstack sudo[102512]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c92e74f9-0a97-4adf-a0df-eb28a3a24e8e tempest-VolumesGetTest-903145024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a0dc21c3-5ebf-4386-b2b9-4b107ba9b474" returned: 0 in 0.703s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:49 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c92e74f9-0a97-4adf-a0df-eb28a3a24e8e tempest-VolumesGetTest-903145024 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:50:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c92e74f9-0a97-4adf-a0df-eb28a3a24e8e tempest-VolumesGetTest-903145024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c92e74f9-0a97-4adf-a0df-eb28a3a24e8e tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5926741-b8ce-45b3-9931-cb2bb7ef3555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0dc21c3-5ebf-4386-b2b9-4b107ba9b474', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c92e74f9-0a97-4adf-a0df-eb28a3a24e8e tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72afba70-cc3f-4926-b454-4f2d6120df0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:49 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-c92e74f9-0a97-4adf-a0df-eb28a3a24e8e tempest-VolumesGetTest-903145024 None] Volume volume-a0dc21c3-5ebf-4386-b2b9-4b107ba9b474 (a0dc21c3-5ebf-4386-b2b9-4b107ba9b474): created successfully Jul 08 01:50:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c92e74f9-0a97-4adf-a0df-eb28a3a24e8e tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72afba70-cc3f-4926-b454-4f2d6120df0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c92e74f9-0a97-4adf-a0df-eb28a3a24e8e tempest-VolumesGetTest-903145024 None] Flow 'volume_create_manager' (66803072-e199-48fd-afb0-d997caaf3227) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:50:49 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-c92e74f9-0a97-4adf-a0df-eb28a3a24e8e tempest-VolumesGetTest-903145024 None] Created volume successfully. Jul 08 01:50:50 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e8b92af1-9181-477b-8f80-30e30c00fe5d tempest-VolumesGetTest-903145024 None] Acquiring lock "cinder-a0dc21c3-5ebf-4386-b2b9-4b107ba9b474-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:50 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e8b92af1-9181-477b-8f80-30e30c00fe5d tempest-VolumesGetTest-903145024 None] Lock "cinder-a0dc21c3-5ebf-4386-b2b9-4b107ba9b474-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:50 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e8b92af1-9181-477b-8f80-30e30c00fe5d tempest-VolumesGetTest-903145024 None] Acquiring lock "cinder-quobyte-a0dc21c3-5ebf-4386-b2b9-4b107ba9b474" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:50 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e8b92af1-9181-477b-8f80-30e30c00fe5d tempest-VolumesGetTest-903145024 None] Lock "cinder-quobyte-a0dc21c3-5ebf-4386-b2b9-4b107ba9b474" acquired by "delete_volume" :: waited 0.018s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:50 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[393b7422-4dfb-40af-95f1-c2e9318405af]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:50:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e8b92af1-9181-477b-8f80-30e30c00fe5d tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a0dc21c3-5ebf-4386-b2b9-4b107ba9b474 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:50 devstack sudo[102515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a0dc21c3-5ebf-4386-b2b9-4b107ba9b474 Jul 08 01:50:50 devstack sudo[102515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:51 devstack sudo[102515]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e8b92af1-9181-477b-8f80-30e30c00fe5d tempest-VolumesGetTest-903145024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a0dc21c3-5ebf-4386-b2b9-4b107ba9b474" returned: 0 in 0.847s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e8b92af1-9181-477b-8f80-30e30c00fe5d tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a0dc21c3-5ebf-4386-b2b9-4b107ba9b474 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:51 devstack sudo[102520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a0dc21c3-5ebf-4386-b2b9-4b107ba9b474 Jul 08 01:50:51 devstack sudo[102520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:52 devstack sudo[102520]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e8b92af1-9181-477b-8f80-30e30c00fe5d tempest-VolumesGetTest-903145024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a0dc21c3-5ebf-4386-b2b9-4b107ba9b474" returned: 0 in 0.712s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:52 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e8b92af1-9181-477b-8f80-30e30c00fe5d tempest-VolumesGetTest-903145024 None] Lock "cinder-quobyte-a0dc21c3-5ebf-4386-b2b9-4b107ba9b474" released by "delete_volume" :: held 1.604s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:52 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-e8b92af1-9181-477b-8f80-30e30c00fe5d tempest-VolumesGetTest-903145024 None] Created reservations ['c0e45589-6694-475e-8ac2-8d2a2683b71a', '4d90d468-07ff-4e4a-8bf4-046b620bc0c6', '0e3876c2-67a9-4367-8eaa-4eccda266bef', 'f50cb858-e57a-444a-af2d-bcc2df3fc6cf'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:50:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e8b92af1-9181-477b-8f80-30e30c00fe5d tempest-VolumesGetTest-903145024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e8b92af1-9181-477b-8f80-30e30c00fe5d tempest-VolumesGetTest-903145024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e8b92af1-9181-477b-8f80-30e30c00fe5d tempest-VolumesGetTest-903145024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:50:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e8b92af1-9181-477b-8f80-30e30c00fe5d tempest-VolumesGetTest-903145024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:50:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e8b92af1-9181-477b-8f80-30e30c00fe5d tempest-VolumesGetTest-903145024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e8b92af1-9181-477b-8f80-30e30c00fe5d tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:52 devstack sudo[102523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:50:52 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:52 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-74b4d723-cd48-46a8-814c-f8f461131d6c tempest-VolumesGetTest-903145024 None] Acquiring lock "cinder-b349644b-d385-43cc-bddd-c27d8b8f99c8-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:52 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-74b4d723-cd48-46a8-814c-f8f461131d6c tempest-VolumesGetTest-903145024 None] Lock "cinder-b349644b-d385-43cc-bddd-c27d8b8f99c8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:52 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-74b4d723-cd48-46a8-814c-f8f461131d6c tempest-VolumesGetTest-903145024 None] Acquiring lock "cinder-quobyte-b349644b-d385-43cc-bddd-c27d8b8f99c8" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:52 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-74b4d723-cd48-46a8-814c-f8f461131d6c tempest-VolumesGetTest-903145024 None] Lock "cinder-quobyte-b349644b-d385-43cc-bddd-c27d8b8f99c8" acquired by "delete_volume" :: waited 0.020s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:52 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9ebbb9-3477-4244-a701-3a16897a9504]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:50:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-74b4d723-cd48-46a8-814c-f8f461131d6c tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b349644b-d385-43cc-bddd-c27d8b8f99c8 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:52 devstack sudo[102526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b349644b-d385-43cc-bddd-c27d8b8f99c8 Jul 08 01:50:52 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:52 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e8b92af1-9181-477b-8f80-30e30c00fe5d tempest-VolumesGetTest-903145024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.771s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:52 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-e8b92af1-9181-477b-8f80-30e30c00fe5d tempest-VolumesGetTest-903145024 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:50:52 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-e8b92af1-9181-477b-8f80-30e30c00fe5d tempest-VolumesGetTest-903145024 None] Deleted volume successfully. Jul 08 01:50:52 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e8b92af1-9181-477b-8f80-30e30c00fe5d tempest-VolumesGetTest-903145024 None] Lock "cinder-a0dc21c3-5ebf-4386-b2b9-4b107ba9b474-delete_volume" released by "delete_volume" :: held 2.600s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:53 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-74b4d723-cd48-46a8-814c-f8f461131d6c tempest-VolumesGetTest-903145024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b349644b-d385-43cc-bddd-c27d8b8f99c8" returned: 0 in 0.809s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-74b4d723-cd48-46a8-814c-f8f461131d6c tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b349644b-d385-43cc-bddd-c27d8b8f99c8 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:53 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b349644b-d385-43cc-bddd-c27d8b8f99c8 Jul 08 01:50:53 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:54 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-74b4d723-cd48-46a8-814c-f8f461131d6c tempest-VolumesGetTest-903145024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b349644b-d385-43cc-bddd-c27d8b8f99c8" returned: 0 in 0.707s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:54 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-74b4d723-cd48-46a8-814c-f8f461131d6c tempest-VolumesGetTest-903145024 None] Lock "cinder-quobyte-b349644b-d385-43cc-bddd-c27d8b8f99c8" released by "delete_volume" :: held 1.563s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:54 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-74b4d723-cd48-46a8-814c-f8f461131d6c tempest-VolumesGetTest-903145024 None] Created reservations ['fd8dff39-0849-4b84-abff-d74e0936f72b', '5a8af764-2c16-4e4c-a5fc-f6b87e7c633b', '697d3f06-a38f-48a1-834d-16aca1d3d69e', '0715e0e5-ab66-403e-ba6f-1b7f0e977761'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:50:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-74b4d723-cd48-46a8-814c-f8f461131d6c tempest-VolumesGetTest-903145024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-74b4d723-cd48-46a8-814c-f8f461131d6c tempest-VolumesGetTest-903145024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:54 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-74b4d723-cd48-46a8-814c-f8f461131d6c tempest-VolumesGetTest-903145024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:50:54 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-74b4d723-cd48-46a8-814c-f8f461131d6c tempest-VolumesGetTest-903145024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:50:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-74b4d723-cd48-46a8-814c-f8f461131d6c tempest-VolumesGetTest-903145024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-74b4d723-cd48-46a8-814c-f8f461131d6c tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:54 devstack sudo[102535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:50:54 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:55 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:50:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:50:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:50:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:55 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-74b4d723-cd48-46a8-814c-f8f461131d6c tempest-VolumesGetTest-903145024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.733s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:55 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-74b4d723-cd48-46a8-814c-f8f461131d6c tempest-VolumesGetTest-903145024 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:50:55 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-74b4d723-cd48-46a8-814c-f8f461131d6c tempest-VolumesGetTest-903145024 None] Deleted volume successfully. Jul 08 01:50:55 devstack sudo[102538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:50:55 devstack sudo[102538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:55 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-74b4d723-cd48-46a8-814c-f8f461131d6c tempest-VolumesGetTest-903145024 None] Lock "cinder-b349644b-d385-43cc-bddd-c27d8b8f99c8-delete_volume" released by "delete_volume" :: held 2.546s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:55 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-5569b0ee-b337-4f45-93da-37346ec63916 tempest-VolumesGetTest-903145024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:50:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5569b0ee-b337-4f45-93da-37346ec63916 tempest-VolumesGetTest-903145024 None] Flow 'volume_create_manager' (2c6a3acb-7cf4-42c2-b9c1-f704017fa98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:50:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5569b0ee-b337-4f45-93da-37346ec63916 tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9957db4b-38e6-4def-9976-3a3288cfa065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5569b0ee-b337-4f45-93da-37346ec63916 tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9957db4b-38e6-4def-9976-3a3288cfa065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-324638871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0b45284-c4e3-4923-b086-acb386f15859,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='beeba2059c0a4654bf9afe0364d0f518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:50:55Z,use_quota=True,user_id='a8d30b0dc18249c4bf2869d08aeffcec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5569b0ee-b337-4f45-93da-37346ec63916 tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7e21bb0-a858-4c7c-a54d-89f4165e4cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5569b0ee-b337-4f45-93da-37346ec63916 tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7e21bb0-a858-4c7c-a54d-89f4165e4cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5569b0ee-b337-4f45-93da-37346ec63916 tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12f2803b-17e3-4f50-adeb-0652bd162fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5569b0ee-b337-4f45-93da-37346ec63916 tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12f2803b-17e3-4f50-adeb-0652bd162fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0b45284-c4e3-4923-b086-acb386f15859', 'volume_name': 'volume-c0b45284-c4e3-4923-b086-acb386f15859', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5569b0ee-b337-4f45-93da-37346ec63916 tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2865f5fc-6553-42cf-8824-e505f9826f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5569b0ee-b337-4f45-93da-37346ec63916 tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2865f5fc-6553-42cf-8824-e505f9826f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5569b0ee-b337-4f45-93da-37346ec63916 tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bde697a5-79eb-45ca-99db-d16d6b01e07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:55 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-5569b0ee-b337-4f45-93da-37346ec63916 tempest-VolumesGetTest-903145024 None] Volume c0b45284-c4e3-4923-b086-acb386f15859: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0b45284-c4e3-4923-b086-acb386f15859', 'volume_size': 1} Jul 08 01:50:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5569b0ee-b337-4f45-93da-37346ec63916 tempest-VolumesGetTest-903145024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5569b0ee-b337-4f45-93da-37346ec63916 tempest-VolumesGetTest-903145024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5569b0ee-b337-4f45-93da-37346ec63916 tempest-VolumesGetTest-903145024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-324638871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0b45284-c4e3-4923-b086-acb386f15859,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='beeba2059c0a4654bf9afe0364d0f518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:50:55Z,use_quota=True,user_id='a8d30b0dc18249c4bf2869d08aeffcec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:50:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-5569b0ee-b337-4f45-93da-37346ec63916 tempest-VolumesGetTest-903145024 None] Creating volume c0b45284-c4e3-4923-b086-acb386f15859 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:50:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5569b0ee-b337-4f45-93da-37346ec63916 tempest-VolumesGetTest-903145024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5569b0ee-b337-4f45-93da-37346ec63916 tempest-VolumesGetTest-903145024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5569b0ee-b337-4f45-93da-37346ec63916 tempest-VolumesGetTest-903145024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:50:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5569b0ee-b337-4f45-93da-37346ec63916 tempest-VolumesGetTest-903145024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:50:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5569b0ee-b337-4f45-93da-37346ec63916 tempest-VolumesGetTest-903145024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5569b0ee-b337-4f45-93da-37346ec63916 tempest-VolumesGetTest-903145024 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:50:55 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-5569b0ee-b337-4f45-93da-37346ec63916 tempest-VolumesGetTest-903145024 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:50:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5569b0ee-b337-4f45-93da-37346ec63916 tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:55 devstack sudo[102542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859 1073741824 Jul 08 01:50:55 devstack sudo[102542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:55 devstack sudo[102538]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.766s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:55 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:50:55 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager._thread_info {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:50:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread count: 29 {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:50:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread info: [<_MainThread(MainThread, started 127058402500736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:50:56 devstack sudo[102542]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5569b0ee-b337-4f45-93da-37346ec63916 tempest-VolumesGetTest-903145024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859 1073741824" returned: 0 in 0.907s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5569b0ee-b337-4f45-93da-37346ec63916 tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:56 devstack sudo[102548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859 Jul 08 01:50:56 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:57 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5569b0ee-b337-4f45-93da-37346ec63916 tempest-VolumesGetTest-903145024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859" returned: 0 in 0.726s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5569b0ee-b337-4f45-93da-37346ec63916 tempest-VolumesGetTest-903145024 None] <== create_volume: return (1682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:50:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5569b0ee-b337-4f45-93da-37346ec63916 tempest-VolumesGetTest-903145024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5569b0ee-b337-4f45-93da-37346ec63916 tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bde697a5-79eb-45ca-99db-d16d6b01e07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0b45284-c4e3-4923-b086-acb386f15859', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5569b0ee-b337-4f45-93da-37346ec63916 tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0984c3b6-406a-4df5-921f-3f6f22976402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:57 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-5569b0ee-b337-4f45-93da-37346ec63916 tempest-VolumesGetTest-903145024 None] Volume volume-c0b45284-c4e3-4923-b086-acb386f15859 (c0b45284-c4e3-4923-b086-acb386f15859): created successfully Jul 08 01:50:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5569b0ee-b337-4f45-93da-37346ec63916 tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0984c3b6-406a-4df5-921f-3f6f22976402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5569b0ee-b337-4f45-93da-37346ec63916 tempest-VolumesGetTest-903145024 None] Flow 'volume_create_manager' (2c6a3acb-7cf4-42c2-b9c1-f704017fa98b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:50:57 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-5569b0ee-b337-4f45-93da-37346ec63916 tempest-VolumesGetTest-903145024 None] Created volume successfully. Jul 08 01:50:58 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:50:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Flow 'volume_create_manager' (5df49eeb-4816-4d5b-abb9-702a1d9cf825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:50:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c37fdef-f02d-4ebe-826d-02c333ecb13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c37fdef-f02d-4ebe-826d-02c333ecb13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-654665837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc137443-1a9b-4e78-9323-360b59c1480b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='beeba2059c0a4654bf9afe0364d0f518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=c0b45284-c4e3-4923-b086-acb386f15859,status='creating',terminated_at=None,updated_at=2026-07-07T23:50:58Z,use_quota=True,user_id='a8d30b0dc18249c4bf2869d08aeffcec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b11a016-dcd2-4a64-a5c1-cc7df00dc002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b11a016-dcd2-4a64-a5c1-cc7df00dc002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5655653e-ffb7-4995-936e-2125a1d043b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5655653e-ffb7-4995-936e-2125a1d043b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'cc137443-1a9b-4e78-9323-360b59c1480b', 'volume_name': 'volume-cc137443-1a9b-4e78-9323-360b59c1480b', 'volume_size': 1, 'source_volid': 'c0b45284-c4e3-4923-b086-acb386f15859', 'source_volstatus': 'available'}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50870740-343b-4124-a883-cdc6d43f5002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50870740-343b-4124-a883-cdc6d43f5002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (016cca83-49e8-4bd1-9d6f-c3247f1d3a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:58 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Volume cc137443-1a9b-4e78-9323-360b59c1480b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-cc137443-1a9b-4e78-9323-360b59c1480b', 'volume_size': 1, 'source_volid': 'c0b45284-c4e3-4923-b086-acb386f15859', 'source_volstatus': 'available'} Jul 08 01:50:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:58 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Cloning volume c0b45284-c4e3-4923-b086-acb386f15859 to volume cc137443-1a9b-4e78-9323-360b59c1480b Jul 08 01:50:58 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Creating offline snapshot ee6d8ccc-eae8-4b87-a034-05771c282f3e of volume c0b45284-c4e3-4923-b086-acb386f15859 {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:50:58 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[d752b91c-57c0-45a5-9559-5b9b2000d900]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:50:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:58 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859 Jul 08 01:50:58 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:59 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859" returned: 0 in 0.918s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859.ee6d8ccc-eae8-4b87-a034-05771c282f3e 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:59 devstack sudo[102558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859.ee6d8ccc-eae8-4b87-a034-05771c282f3e 1G Jul 08 01:50:59 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:00 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859.ee6d8ccc-eae8-4b87-a034-05771c282f3e 1G" returned: 0 in 0.891s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0b45284-c4e3-4923-b086-acb386f15859 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859.ee6d8ccc-eae8-4b87-a034-05771c282f3e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:00 devstack sudo[102564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0b45284-c4e3-4923-b086-acb386f15859 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859.ee6d8ccc-eae8-4b87-a034-05771c282f3e Jul 08 01:51:00 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:00 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0b45284-c4e3-4923-b086-acb386f15859 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859.ee6d8ccc-eae8-4b87-a034-05771c282f3e" returned: 0 in 0.756s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:00 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859.ee6d8ccc-eae8-4b87-a034-05771c282f3e is being set with open permissions: ugo+rw Jul 08 01:51:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859.ee6d8ccc-eae8-4b87-a034-05771c282f3e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:01 devstack sudo[102570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859.ee6d8ccc-eae8-4b87-a034-05771c282f3e Jul 08 01:51:01 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:01 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859.ee6d8ccc-eae8-4b87-a034-05771c282f3e" returned: 0 in 0.693s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:01 devstack sudo[102573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859.info Jul 08 01:51:01 devstack sudo[102573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:02 devstack sudo[102573]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859.info" returned: 0 in 0.680s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:02 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859.info is being set with open permissions: ugo+rw Jul 08 01:51:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:02 devstack sudo[102576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859.info Jul 08 01:51:02 devstack sudo[102576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:03 devstack sudo[102576]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859.info" returned: 0 in 0.654s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:03 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Acquiring lock "cinder-quobyte-cc137443-1a9b-4e78-9323-360b59c1480b" by "_copy_volume_from_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:51:03 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Lock "cinder-quobyte-cc137443-1a9b-4e78-9323-360b59c1480b" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:51:03 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] snapshot: ee6d8ccc-eae8-4b87-a034-05771c282f3e, volume: cc137443-1a9b-4e78-9323-360b59c1480b, {{(pid=87284) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:51:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:51:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:51:03 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:51:03 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:51:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:51:03 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad621d17-1e2a-4064-be16-c4c935851ef2]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:51:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859.ee6d8ccc-eae8-4b87-a034-05771c282f3e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:03 devstack sudo[102579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859.ee6d8ccc-eae8-4b87-a034-05771c282f3e Jul 08 01:51:03 devstack sudo[102579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:03 devstack sudo[102579]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859.ee6d8ccc-eae8-4b87-a034-05771c282f3e" returned: 0 in 0.834s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:03 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0b45284-c4e3-4923-b086-acb386f15859(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:51:03 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859 {{(pid=87284) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:51:03 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Creating direct copy from snapshot {{(pid=87284) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:51:03 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9f0396-b61b-4bb3-bdd1-a6e78ef93ce0]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:51:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:04 devstack sudo[102584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859 Jul 08 01:51:04 devstack sudo[102584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:04 devstack sudo[102584]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859" returned: 0 in 0.824s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:04 devstack cinder-volume[87284]: DEBUG cinder.utils [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Path /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-cc137443-1a9b-4e78-9323-360b59c1480b not found in is_blk_device check {{(pid=87284) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:51:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-cc137443-1a9b-4e78-9323-360b59c1480b {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:04 devstack sudo[102589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-cc137443-1a9b-4e78-9323-360b59c1480b Jul 08 01:51:04 devstack sudo[102589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:09 devstack sudo[102589]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-cc137443-1a9b-4e78-9323-360b59c1480b" returned: 0 in 4.604s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:09 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32fa40a-f2d8-49d3-bb00-ba93dd84b91b]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:51:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:09 devstack sudo[102603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859 Jul 08 01:51:09 devstack sudo[102603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:10 devstack sudo[102603]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859" returned: 0 in 0.959s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:10 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Image conversion details: src /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859, size 1024.00 MB, duration 4.61 sec, destination /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-cc137443-1a9b-4e78-9323-360b59c1480b {{(pid=87284) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:51:10 devstack cinder-volume[87284]: INFO cinder.image.image_utils [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Converted 1024.00 MB image at 222.31 MB/s Jul 08 01:51:10 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-cc137443-1a9b-4e78-9323-360b59c1480b is being set with open permissions: ugo+rw Jul 08 01:51:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-cc137443-1a9b-4e78-9323-360b59c1480b {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:10 devstack sudo[102608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-cc137443-1a9b-4e78-9323-360b59c1480b Jul 08 01:51:10 devstack sudo[102608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:11 devstack sudo[102608]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-cc137443-1a9b-4e78-9323-360b59c1480b" returned: 0 in 0.645s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:11 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Lock "cinder-quobyte-cc137443-1a9b-4e78-9323-360b59c1480b" released by "_copy_volume_from_snapshot" :: held 7.955s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:51:11 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Acquiring lock "cinder-quobyte-ee6d8ccc-eae8-4b87-a034-05771c282f3e" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:51:11 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Lock "cinder-quobyte-ee6d8ccc-eae8-4b87-a034-05771c282f3e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:51:11 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Deleting offline snapshot ee6d8ccc-eae8-4b87-a034-05771c282f3e of volume c0b45284-c4e3-4923-b086-acb386f15859 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:51:11 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] snapshot_file for this snap is: volume-c0b45284-c4e3-4923-b086-acb386f15859.ee6d8ccc-eae8-4b87-a034-05771c282f3e {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:51:11 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1a4893-9091-4a77-8a77-5dd5d4f27a58]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:51:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859.ee6d8ccc-eae8-4b87-a034-05771c282f3e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:11 devstack sudo[102611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859.ee6d8ccc-eae8-4b87-a034-05771c282f3e Jul 08 01:51:11 devstack sudo[102611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:11 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:UPDATE=46,cinder:SELECT=27,cinder:INSERT=9,cinder:DELETE=3 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:51:12 devstack sudo[102611]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859.ee6d8ccc-eae8-4b87-a034-05771c282f3e" returned: 0 in 0.910s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:12 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0b45284-c4e3-4923-b086-acb386f15859(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:51:12 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae0aab9-9261-4750-bcdb-2a84d600c3db]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:51:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:12 devstack sudo[102616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859 Jul 08 01:51:12 devstack sudo[102616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:12 devstack sudo[102616]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859" returned: 0 in 0.818s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859.ee6d8ccc-eae8-4b87-a034-05771c282f3e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:12 devstack sudo[102621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859.ee6d8ccc-eae8-4b87-a034-05771c282f3e Jul 08 01:51:12 devstack sudo[102621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:13 devstack sudo[102621]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859.ee6d8ccc-eae8-4b87-a034-05771c282f3e" returned: 0 in 0.804s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859.ee6d8ccc-eae8-4b87-a034-05771c282f3e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:13 devstack sudo[102626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859.ee6d8ccc-eae8-4b87-a034-05771c282f3e Jul 08 01:51:13 devstack sudo[102626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:14 devstack sudo[102626]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859.ee6d8ccc-eae8-4b87-a034-05771c282f3e" returned: 0 in 0.712s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:14 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Lock "cinder-quobyte-ee6d8ccc-eae8-4b87-a034-05771c282f3e" released by "_delete_snapshot" :: held 3.340s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:51:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.091s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:51:14 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (016cca83-49e8-4bd1-9d6f-c3247f1d3a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc137443-1a9b-4e78-9323-360b59c1480b', 'volume_size': 1, 'source_volid': 'c0b45284-c4e3-4923-b086-acb386f15859', 'source_volstatus': 'available'}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:14 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee671f6a-ba6c-4c2b-afa2-156c4ec2331f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:14 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Volume volume-cc137443-1a9b-4e78-9323-360b59c1480b (cc137443-1a9b-4e78-9323-360b59c1480b): created successfully Jul 08 01:51:14 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee671f6a-ba6c-4c2b-afa2-156c4ec2331f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:14 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Flow 'volume_create_manager' (5df49eeb-4816-4d5b-abb9-702a1d9cf825) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:51:14 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-95cb34f3-f598-414e-af62-ecb58efe20b0 tempest-VolumesGetTest-903145024 None] Created volume successfully. Jul 08 01:51:16 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e452403-11be-49d8-aa6e-883ad2a8e144 tempest-VolumesGetTest-903145024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:51:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4e452403-11be-49d8-aa6e-883ad2a8e144 tempest-VolumesGetTest-903145024 None] Flow 'volume_create_manager' (724b2c0d-4ceb-4fca-ac74-8c1751006baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:51:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4e452403-11be-49d8-aa6e-883ad2a8e144 tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ae265da-99a0-433a-bec5-b07c018077c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4e452403-11be-49d8-aa6e-883ad2a8e144 tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ae265da-99a0-433a-bec5-b07c018077c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:51:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-124856132',display_name='tempest-VolumesGetTest-Volume-597497769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d73638fa-14a0-4496-9d2c-9b457d184bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='beeba2059c0a4654bf9afe0364d0f518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:51:16Z,use_quota=True,user_id='a8d30b0dc18249c4bf2869d08aeffcec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4e452403-11be-49d8-aa6e-883ad2a8e144 tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edacde34-a197-44b7-acd4-c9d7a537e0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4e452403-11be-49d8-aa6e-883ad2a8e144 tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edacde34-a197-44b7-acd4-c9d7a537e0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4e452403-11be-49d8-aa6e-883ad2a8e144 tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (528b1796-d33c-4559-805a-883c623fda7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4e452403-11be-49d8-aa6e-883ad2a8e144 tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (528b1796-d33c-4559-805a-883c623fda7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd73638fa-14a0-4496-9d2c-9b457d184bd1', 'volume_name': 'volume-d73638fa-14a0-4496-9d2c-9b457d184bd1', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4e452403-11be-49d8-aa6e-883ad2a8e144 tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f081ebec-8538-4b9a-a9f3-69ac8e30d320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4e452403-11be-49d8-aa6e-883ad2a8e144 tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f081ebec-8538-4b9a-a9f3-69ac8e30d320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4e452403-11be-49d8-aa6e-883ad2a8e144 tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4333a86-9795-46f6-93bd-6b36bd6e3c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:16 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-4e452403-11be-49d8-aa6e-883ad2a8e144 tempest-VolumesGetTest-903145024 None] Volume d73638fa-14a0-4496-9d2c-9b457d184bd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d73638fa-14a0-4496-9d2c-9b457d184bd1', 'volume_size': 1} Jul 08 01:51:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4e452403-11be-49d8-aa6e-883ad2a8e144 tempest-VolumesGetTest-903145024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:51:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4e452403-11be-49d8-aa6e-883ad2a8e144 tempest-VolumesGetTest-903145024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:51:16 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-4e452403-11be-49d8-aa6e-883ad2a8e144 tempest-VolumesGetTest-903145024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:51:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-124856132',display_name='tempest-VolumesGetTest-Volume-597497769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d73638fa-14a0-4496-9d2c-9b457d184bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='beeba2059c0a4654bf9afe0364d0f518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:51:16Z,use_quota=True,user_id='a8d30b0dc18249c4bf2869d08aeffcec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:51:16 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-4e452403-11be-49d8-aa6e-883ad2a8e144 tempest-VolumesGetTest-903145024 None] Creating volume d73638fa-14a0-4496-9d2c-9b457d184bd1 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:51:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4e452403-11be-49d8-aa6e-883ad2a8e144 tempest-VolumesGetTest-903145024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:51:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4e452403-11be-49d8-aa6e-883ad2a8e144 tempest-VolumesGetTest-903145024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:51:16 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-4e452403-11be-49d8-aa6e-883ad2a8e144 tempest-VolumesGetTest-903145024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:51:16 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-4e452403-11be-49d8-aa6e-883ad2a8e144 tempest-VolumesGetTest-903145024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:51:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4e452403-11be-49d8-aa6e-883ad2a8e144 tempest-VolumesGetTest-903145024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:51:16 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-4e452403-11be-49d8-aa6e-883ad2a8e144 tempest-VolumesGetTest-903145024 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:51:16 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-4e452403-11be-49d8-aa6e-883ad2a8e144 tempest-VolumesGetTest-903145024 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:51:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4e452403-11be-49d8-aa6e-883ad2a8e144 tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d73638fa-14a0-4496-9d2c-9b457d184bd1 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:16 devstack sudo[102630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d73638fa-14a0-4496-9d2c-9b457d184bd1 1073741824 Jul 08 01:51:16 devstack sudo[102630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:17 devstack sudo[102630]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4e452403-11be-49d8-aa6e-883ad2a8e144 tempest-VolumesGetTest-903145024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d73638fa-14a0-4496-9d2c-9b457d184bd1 1073741824" returned: 0 in 0.948s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4e452403-11be-49d8-aa6e-883ad2a8e144 tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d73638fa-14a0-4496-9d2c-9b457d184bd1 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:17 devstack sudo[102636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d73638fa-14a0-4496-9d2c-9b457d184bd1 Jul 08 01:51:17 devstack sudo[102636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:18 devstack sudo[102636]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4e452403-11be-49d8-aa6e-883ad2a8e144 tempest-VolumesGetTest-903145024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d73638fa-14a0-4496-9d2c-9b457d184bd1" returned: 0 in 0.742s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:18 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-4e452403-11be-49d8-aa6e-883ad2a8e144 tempest-VolumesGetTest-903145024 None] <== create_volume: return (1742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:51:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4e452403-11be-49d8-aa6e-883ad2a8e144 tempest-VolumesGetTest-903145024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:51:18 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4e452403-11be-49d8-aa6e-883ad2a8e144 tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4333a86-9795-46f6-93bd-6b36bd6e3c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d73638fa-14a0-4496-9d2c-9b457d184bd1', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:18 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4e452403-11be-49d8-aa6e-883ad2a8e144 tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5446597c-749e-47cd-81cd-a0c7b04fc6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:18 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-4e452403-11be-49d8-aa6e-883ad2a8e144 tempest-VolumesGetTest-903145024 None] Volume volume-d73638fa-14a0-4496-9d2c-9b457d184bd1 (d73638fa-14a0-4496-9d2c-9b457d184bd1): created successfully Jul 08 01:51:18 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4e452403-11be-49d8-aa6e-883ad2a8e144 tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5446597c-749e-47cd-81cd-a0c7b04fc6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:18 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4e452403-11be-49d8-aa6e-883ad2a8e144 tempest-VolumesGetTest-903145024 None] Flow 'volume_create_manager' (724b2c0d-4ceb-4fca-ac74-8c1751006baf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:51:18 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-4e452403-11be-49d8-aa6e-883ad2a8e144 tempest-VolumesGetTest-903145024 None] Created volume successfully. Jul 08 01:51:18 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3a34df4b-07de-4b4c-a626-78169c2f086e tempest-VolumesGetTest-903145024 None] Acquiring lock "cinder-d73638fa-14a0-4496-9d2c-9b457d184bd1-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:51:18 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3a34df4b-07de-4b4c-a626-78169c2f086e tempest-VolumesGetTest-903145024 None] Lock "cinder-d73638fa-14a0-4496-9d2c-9b457d184bd1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:51:18 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3a34df4b-07de-4b4c-a626-78169c2f086e tempest-VolumesGetTest-903145024 None] Acquiring lock "cinder-quobyte-d73638fa-14a0-4496-9d2c-9b457d184bd1" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:51:18 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3a34df4b-07de-4b4c-a626-78169c2f086e tempest-VolumesGetTest-903145024 None] Lock "cinder-quobyte-d73638fa-14a0-4496-9d2c-9b457d184bd1" acquired by "delete_volume" :: waited 0.019s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:51:18 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f62a5b-4352-4880-81f2-08afb96a3edc]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:51:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3a34df4b-07de-4b4c-a626-78169c2f086e tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d73638fa-14a0-4496-9d2c-9b457d184bd1 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:18 devstack sudo[102639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d73638fa-14a0-4496-9d2c-9b457d184bd1 Jul 08 01:51:18 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:19 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3a34df4b-07de-4b4c-a626-78169c2f086e tempest-VolumesGetTest-903145024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d73638fa-14a0-4496-9d2c-9b457d184bd1" returned: 0 in 0.826s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3a34df4b-07de-4b4c-a626-78169c2f086e tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d73638fa-14a0-4496-9d2c-9b457d184bd1 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:19 devstack sudo[102644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d73638fa-14a0-4496-9d2c-9b457d184bd1 Jul 08 01:51:19 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:20 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3a34df4b-07de-4b4c-a626-78169c2f086e tempest-VolumesGetTest-903145024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d73638fa-14a0-4496-9d2c-9b457d184bd1" returned: 0 in 0.734s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:20 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3a34df4b-07de-4b4c-a626-78169c2f086e tempest-VolumesGetTest-903145024 None] Lock "cinder-quobyte-d73638fa-14a0-4496-9d2c-9b457d184bd1" released by "delete_volume" :: held 1.609s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:51:20 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-3a34df4b-07de-4b4c-a626-78169c2f086e tempest-VolumesGetTest-903145024 None] Created reservations ['77520388-071d-4bef-af4d-0e402d418170', 'a9a0ff5c-1409-41ab-b065-e0dde39f8690', '54b54f8f-09dc-4c15-b933-2ba065414360', '02cab97d-046f-4841-bd32-0be42dc09b12'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:51:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3a34df4b-07de-4b4c-a626-78169c2f086e tempest-VolumesGetTest-903145024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:51:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3a34df4b-07de-4b4c-a626-78169c2f086e tempest-VolumesGetTest-903145024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:51:20 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3a34df4b-07de-4b4c-a626-78169c2f086e tempest-VolumesGetTest-903145024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:51:20 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3a34df4b-07de-4b4c-a626-78169c2f086e tempest-VolumesGetTest-903145024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:51:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3a34df4b-07de-4b4c-a626-78169c2f086e tempest-VolumesGetTest-903145024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:51:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3a34df4b-07de-4b4c-a626-78169c2f086e tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:20 devstack sudo[102647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:51:20 devstack sudo[102647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:20 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-77a7f757-9ad0-49c3-b43c-8278ec5fa3c6 tempest-VolumesGetTest-903145024 None] Acquiring lock "cinder-cc137443-1a9b-4e78-9323-360b59c1480b-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:51:20 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-77a7f757-9ad0-49c3-b43c-8278ec5fa3c6 tempest-VolumesGetTest-903145024 None] Lock "cinder-cc137443-1a9b-4e78-9323-360b59c1480b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:51:21 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-77a7f757-9ad0-49c3-b43c-8278ec5fa3c6 tempest-VolumesGetTest-903145024 None] Acquiring lock "cinder-quobyte-cc137443-1a9b-4e78-9323-360b59c1480b" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:51:21 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-77a7f757-9ad0-49c3-b43c-8278ec5fa3c6 tempest-VolumesGetTest-903145024 None] Lock "cinder-quobyte-cc137443-1a9b-4e78-9323-360b59c1480b" acquired by "delete_volume" :: waited 0.036s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:51:21 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d12da3-5037-4a5e-987e-c211f1be97be]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:51:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-77a7f757-9ad0-49c3-b43c-8278ec5fa3c6 tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-cc137443-1a9b-4e78-9323-360b59c1480b {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:21 devstack sudo[102647]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3a34df4b-07de-4b4c-a626-78169c2f086e tempest-VolumesGetTest-903145024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.718s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:21 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-3a34df4b-07de-4b4c-a626-78169c2f086e tempest-VolumesGetTest-903145024 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:51:21 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-3a34df4b-07de-4b4c-a626-78169c2f086e tempest-VolumesGetTest-903145024 None] Deleted volume successfully. Jul 08 01:51:21 devstack sudo[102650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-cc137443-1a9b-4e78-9323-360b59c1480b Jul 08 01:51:21 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3a34df4b-07de-4b4c-a626-78169c2f086e tempest-VolumesGetTest-903145024 None] Lock "cinder-d73638fa-14a0-4496-9d2c-9b457d184bd1-delete_volume" released by "delete_volume" :: held 2.559s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:51:21 devstack sudo[102650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:21 devstack sudo[102650]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-77a7f757-9ad0-49c3-b43c-8278ec5fa3c6 tempest-VolumesGetTest-903145024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-cc137443-1a9b-4e78-9323-360b59c1480b" returned: 0 in 0.805s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-77a7f757-9ad0-49c3-b43c-8278ec5fa3c6 tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-cc137443-1a9b-4e78-9323-360b59c1480b {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:21 devstack sudo[102655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-cc137443-1a9b-4e78-9323-360b59c1480b Jul 08 01:51:21 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:22 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-77a7f757-9ad0-49c3-b43c-8278ec5fa3c6 tempest-VolumesGetTest-903145024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-cc137443-1a9b-4e78-9323-360b59c1480b" returned: 0 in 0.745s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:22 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-77a7f757-9ad0-49c3-b43c-8278ec5fa3c6 tempest-VolumesGetTest-903145024 None] Lock "cinder-quobyte-cc137443-1a9b-4e78-9323-360b59c1480b" released by "delete_volume" :: held 1.598s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:51:22 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-77a7f757-9ad0-49c3-b43c-8278ec5fa3c6 tempest-VolumesGetTest-903145024 None] Created reservations ['ee48a47a-dbfb-4b8b-9508-7fff4ce32b7e', '7561229a-ddb8-44cf-ac14-027a91b4fd4f', '00bd82c5-980e-4e05-8785-70418450dd80', 'a4eb0feb-5be6-4ecc-b4c1-2ad8256634d4'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:51:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-77a7f757-9ad0-49c3-b43c-8278ec5fa3c6 tempest-VolumesGetTest-903145024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:51:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-77a7f757-9ad0-49c3-b43c-8278ec5fa3c6 tempest-VolumesGetTest-903145024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:51:22 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-77a7f757-9ad0-49c3-b43c-8278ec5fa3c6 tempest-VolumesGetTest-903145024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:51:22 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-77a7f757-9ad0-49c3-b43c-8278ec5fa3c6 tempest-VolumesGetTest-903145024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:51:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-77a7f757-9ad0-49c3-b43c-8278ec5fa3c6 tempest-VolumesGetTest-903145024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:51:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-77a7f757-9ad0-49c3-b43c-8278ec5fa3c6 tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:22 devstack sudo[102658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:51:22 devstack sudo[102658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:23 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3afb6e9c-83b1-4659-a751-c1f8131c6e40 tempest-VolumesGetTest-903145024 None] Acquiring lock "cinder-c0b45284-c4e3-4923-b086-acb386f15859-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:51:23 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3afb6e9c-83b1-4659-a751-c1f8131c6e40 tempest-VolumesGetTest-903145024 None] Lock "cinder-c0b45284-c4e3-4923-b086-acb386f15859-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:51:23 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3afb6e9c-83b1-4659-a751-c1f8131c6e40 tempest-VolumesGetTest-903145024 None] Acquiring lock "cinder-quobyte-c0b45284-c4e3-4923-b086-acb386f15859" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:51:23 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3afb6e9c-83b1-4659-a751-c1f8131c6e40 tempest-VolumesGetTest-903145024 None] Lock "cinder-quobyte-c0b45284-c4e3-4923-b086-acb386f15859" acquired by "delete_volume" :: waited 0.023s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:51:23 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8ef381-c7b8-4874-9a43-89da6ed18047]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:51:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3afb6e9c-83b1-4659-a751-c1f8131c6e40 tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:23 devstack sudo[102658]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-77a7f757-9ad0-49c3-b43c-8278ec5fa3c6 tempest-VolumesGetTest-903145024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.713s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:23 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-77a7f757-9ad0-49c3-b43c-8278ec5fa3c6 tempest-VolumesGetTest-903145024 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:51:23 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-77a7f757-9ad0-49c3-b43c-8278ec5fa3c6 tempest-VolumesGetTest-903145024 None] Deleted volume successfully. Jul 08 01:51:23 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-77a7f757-9ad0-49c3-b43c-8278ec5fa3c6 tempest-VolumesGetTest-903145024 None] Lock "cinder-cc137443-1a9b-4e78-9323-360b59c1480b-delete_volume" released by "delete_volume" :: held 2.587s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:51:23 devstack sudo[102661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859 Jul 08 01:51:23 devstack sudo[102661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:24 devstack sudo[102661]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3afb6e9c-83b1-4659-a751-c1f8131c6e40 tempest-VolumesGetTest-903145024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859" returned: 0 in 0.807s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3afb6e9c-83b1-4659-a751-c1f8131c6e40 tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:24 devstack sudo[102666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859 Jul 08 01:51:24 devstack sudo[102666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:24 devstack sudo[102666]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3afb6e9c-83b1-4659-a751-c1f8131c6e40 tempest-VolumesGetTest-903145024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0b45284-c4e3-4923-b086-acb386f15859" returned: 0 in 0.669s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:24 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3afb6e9c-83b1-4659-a751-c1f8131c6e40 tempest-VolumesGetTest-903145024 None] Lock "cinder-quobyte-c0b45284-c4e3-4923-b086-acb386f15859" released by "delete_volume" :: held 1.556s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:51:25 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-3afb6e9c-83b1-4659-a751-c1f8131c6e40 tempest-VolumesGetTest-903145024 None] Created reservations ['4fdcf743-08e9-45d3-9bf5-83f858bb06b8', '8eb9c9b1-14cb-4998-ad94-1927f6b3f770', '4278233c-bf5c-48bf-9b3b-62386afeee88', 'd8fecd26-30e6-4b91-b066-61d843cba471'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:51:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3afb6e9c-83b1-4659-a751-c1f8131c6e40 tempest-VolumesGetTest-903145024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:51:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3afb6e9c-83b1-4659-a751-c1f8131c6e40 tempest-VolumesGetTest-903145024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:51:25 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3afb6e9c-83b1-4659-a751-c1f8131c6e40 tempest-VolumesGetTest-903145024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:51:25 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3afb6e9c-83b1-4659-a751-c1f8131c6e40 tempest-VolumesGetTest-903145024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:51:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3afb6e9c-83b1-4659-a751-c1f8131c6e40 tempest-VolumesGetTest-903145024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:51:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3afb6e9c-83b1-4659-a751-c1f8131c6e40 tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:25 devstack sudo[102669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:51:25 devstack sudo[102669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:25 devstack sudo[102669]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3afb6e9c-83b1-4659-a751-c1f8131c6e40 tempest-VolumesGetTest-903145024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.724s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:25 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-3afb6e9c-83b1-4659-a751-c1f8131c6e40 tempest-VolumesGetTest-903145024 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:51:25 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-3afb6e9c-83b1-4659-a751-c1f8131c6e40 tempest-VolumesGetTest-903145024 None] Deleted volume successfully. Jul 08 01:51:25 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3afb6e9c-83b1-4659-a751-c1f8131c6e40 tempest-VolumesGetTest-903145024 None] Lock "cinder-c0b45284-c4e3-4923-b086-acb386f15859-delete_volume" released by "delete_volume" :: held 2.525s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:51:26 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:51:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Flow 'volume_create_manager' (008a6d89-1ad2-4dee-8442-dac09ca2ea34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:51:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edafd736-af13-48a8-8a09-7f2a1e710d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edafd736-af13-48a8-8a09-7f2a1e710d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1724664447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f04a7dc-1350-4058-83b4-86155d109282,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='beeba2059c0a4654bf9afe0364d0f518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:51:27Z,use_quota=True,user_id='a8d30b0dc18249c4bf2869d08aeffcec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d4ca548-72ca-405b-a3e9-5411a3b96dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d4ca548-72ca-405b-a3e9-5411a3b96dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6df68746-930b-4518-a8a4-01cdfdb9c6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:26 devstack cinder-volume[87284]: DEBUG cinder.image.glance [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Creating Keystone auth plugin from conf {{(pid=87284) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:51:27 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6df68746-930b-4518-a8a4-01cdfdb9c6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9f04a7dc-1350-4058-83b4-86155d109282', 'volume_name': 'volume-9f04a7dc-1350-4058-83b4-86155d109282', 'volume_size': 1, 'image_id': '24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '083157d49fd649eb95508535e9c547e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'created_at': datetime.datetime(2026, 7, 7, 23, 23, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 23, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24b75d01-af4a-40ff-909b-cfbb4c8e9193/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:27 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a18763c4-4a6a-4241-a052-9a96044124fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:27 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a18763c4-4a6a-4241-a052-9a96044124fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:27 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6e3e148-873a-4fae-816b-d5ecf6e25f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:27 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Volume 9f04a7dc-1350-4058-83b4-86155d109282: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9f04a7dc-1350-4058-83b4-86155d109282', 'volume_size': 1, 'image_id': '24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '083157d49fd649eb95508535e9c547e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'created_at': datetime.datetime(2026, 7, 7, 23, 23, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 23, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24b75d01-af4a-40ff-909b-cfbb4c8e9193/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 01:51:27 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Trying to clone 9f04a7dc-1350-4058-83b4-86155d109282 from image 24b75d01-af4a-40ff-909b-cfbb4c8e9193 at location (None, [{'url': 'file:///opt/stack/data/glance/images/24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'metadata': {}}]). {{(pid=87284) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:51:27 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_njwb2gvedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87284) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:51:27 devstack cinder-volume[87284]: INFO cinder.image.image_utils [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Image download 20.69 MB at 20.69 MB/s Jul 08 01:51:27 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[24667a0c-54dc-4572-a5a5-62cb0c2a25fc]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:51:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_njwb2gvedevstack@QuobyteHD {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:27 devstack sudo[102680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_njwb2gvedevstack@QuobyteHD Jul 08 01:51:27 devstack sudo[102680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:28 devstack sudo[102680]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_njwb2gvedevstack@QuobyteHD" returned: 0 in 0.811s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:28 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Temporary image 24b75d01-af4a-40ff-909b-cfbb4c8e9193 is fetched for user a8d30b0dc18249c4bf2869d08aeffcec. {{(pid=87284) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:51:28 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9951ff-f0d5-4e22-b4bb-6a7b6c89ed74]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:51:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_njwb2gvedevstack@QuobyteHD {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:28 devstack sudo[102685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_njwb2gvedevstack@QuobyteHD Jul 08 01:51:28 devstack sudo[102685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:29 devstack sudo[102685]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_njwb2gvedevstack@QuobyteHD" returned: 0 in 0.849s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:51:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:51:29 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1724664447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f04a7dc-1350-4058-83b4-86155d109282,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='beeba2059c0a4654bf9afe0364d0f518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:51:27Z,use_quota=True,user_id='a8d30b0dc18249c4bf2869d08aeffcec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:51:29 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Creating volume 9f04a7dc-1350-4058-83b4-86155d109282 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:51:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:51:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:51:29 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:51:29 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:51:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:51:29 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:51:29 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:51:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f04a7dc-1350-4058-83b4-86155d109282 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:29 devstack sudo[102691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f04a7dc-1350-4058-83b4-86155d109282 1073741824 Jul 08 01:51:29 devstack sudo[102691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:30 devstack sudo[102691]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f04a7dc-1350-4058-83b4-86155d109282 1073741824" returned: 0 in 0.913s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f04a7dc-1350-4058-83b4-86155d109282 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:30 devstack sudo[102696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f04a7dc-1350-4058-83b4-86155d109282 Jul 08 01:51:30 devstack sudo[102696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:30 devstack sudo[102696]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f04a7dc-1350-4058-83b4-86155d109282" returned: 0 in 0.678s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:30 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:51:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:51:30 devstack cinder-volume[87284]: DEBUG cinder.volume.volume_utils [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Attempting download of 24b75d01-af4a-40ff-909b-cfbb4c8e9193 ((None, [{'url': 'file:///opt/stack/data/glance/images/24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'metadata': {}}])) to volume 9f04a7dc-1350-4058-83b4-86155d109282. {{(pid=87284) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:51:30 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe73213-7fe3-4123-8f93-09861ecbf852]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:51:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24b75d01-af4a-40ff-909b-cfbb4c8e9193_wt4f91s0 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:31 devstack sudo[102699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24b75d01-af4a-40ff-909b-cfbb4c8e9193_wt4f91s0 Jul 08 01:51:31 devstack sudo[102699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:31 devstack sudo[102699]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24b75d01-af4a-40ff-909b-cfbb4c8e9193_wt4f91s0" returned: 0 in 0.771s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24b75d01-af4a-40ff-909b-cfbb4c8e9193_wt4f91s0 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:31 devstack sudo[102703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24b75d01-af4a-40ff-909b-cfbb4c8e9193_wt4f91s0 Jul 08 01:51:31 devstack sudo[102703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:32 devstack sudo[102703]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24b75d01-af4a-40ff-909b-cfbb4c8e9193_wt4f91s0" returned: 1 in 0.809s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24b75d01-af4a-40ff-909b-cfbb4c8e9193_wt4f91s0' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:51:32 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4fe933-a09d-450c-9a7e-d62b0e73da33]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:51:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_njwb2gvedevstack@QuobyteHD {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:32 devstack sudo[102707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_njwb2gvedevstack@QuobyteHD Jul 08 01:51:32 devstack sudo[102707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:33 devstack sudo[102707]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_njwb2gvedevstack@QuobyteHD" returned: 0 in 0.806s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:33 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] 24b75d01-af4a-40ff-909b-cfbb4c8e9193 was qcow2, converting to raw {{(pid=87284) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:51:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_njwb2gvedevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f04a7dc-1350-4058-83b4-86155d109282 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:33 devstack sudo[102712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_njwb2gvedevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f04a7dc-1350-4058-83b4-86155d109282 Jul 08 01:51:33 devstack sudo[102712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:35 devstack sudo[102712]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_njwb2gvedevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f04a7dc-1350-4058-83b4-86155d109282" returned: 0 in 2.175s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:35 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_24b75d01-af4a-40ff-909b-cfbb4c8e9193_njwb2gvedevstack@QuobyteHD, size 112.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f04a7dc-1350-4058-83b4-86155d109282 {{(pid=87284) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:51:35 devstack cinder-volume[87284]: INFO cinder.image.image_utils [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Converted 112.00 MB image at 51.45 MB/s Jul 08 01:51:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f04a7dc-1350-4058-83b4-86155d109282 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:35 devstack sudo[102722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f04a7dc-1350-4058-83b4-86155d109282 1G Jul 08 01:51:35 devstack sudo[102722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:36 devstack sudo[102722]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f04a7dc-1350-4058-83b4-86155d109282 1G" returned: 0 in 0.746s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:36 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[b612b5ab-4624-4e4c-8536-5609f9dfbf22]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:51:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f04a7dc-1350-4058-83b4-86155d109282 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:36 devstack sudo[102727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f04a7dc-1350-4058-83b4-86155d109282 Jul 08 01:51:36 devstack sudo[102727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:37 devstack sudo[102727]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f04a7dc-1350-4058-83b4-86155d109282" returned: 0 in 0.820s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f04a7dc-1350-4058-83b4-86155d109282 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:37 devstack sudo[102731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f04a7dc-1350-4058-83b4-86155d109282 Jul 08 01:51:37 devstack sudo[102731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:37 devstack sudo[102731]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f04a7dc-1350-4058-83b4-86155d109282" returned: 1 in 0.778s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f04a7dc-1350-4058-83b4-86155d109282' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:51:37 devstack cinder-volume[87284]: DEBUG cinder.volume.volume_utils [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Downloaded image 24b75d01-af4a-40ff-909b-cfbb4c8e9193 ((None, [{'url': 'file:///opt/stack/data/glance/images/24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'metadata': {}}])) to volume 9f04a7dc-1350-4058-83b4-86155d109282 successfully. {{(pid=87284) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:51:37 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Temporary image 24b75d01-af4a-40ff-909b-cfbb4c8e9193 for user a8d30b0dc18249c4bf2869d08aeffcec is deleted. {{(pid=87284) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:51:37 devstack cinder-volume[87284]: DEBUG cinder.volume.volume_utils [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Marking volume 9f04a7dc-1350-4058-83b4-86155d109282 as bootable. {{(pid=87284) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:51:37 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:UPDATE=79,cinder:SELECT=56,cinder:INSERT=22,cinder:DELETE=7 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:51:37 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Copying metadata from image 24b75d01-af4a-40ff-909b-cfbb4c8e9193 to 9f04a7dc-1350-4058-83b4-86155d109282. {{(pid=87284) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:51:37 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Creating volume glance metadata for volume 9f04a7dc-1350-4058-83b4-86155d109282 backed by image 24b75d01-af4a-40ff-909b-cfbb4c8e9193 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87284) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:51:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6e3e148-873a-4fae-816b-d5ecf6e25f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f04a7dc-1350-4058-83b4-86155d109282', 'volume_size': 1, 'image_id': '24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '083157d49fd649eb95508535e9c547e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24b75d01-af4a-40ff-909b-cfbb4c8e9193', 'created_at': datetime.datetime(2026, 7, 7, 23, 23, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 23, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24b75d01-af4a-40ff-909b-cfbb4c8e9193/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88d7cad4-c2b5-4f19-b64c-c2beb46c698f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:38 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Volume volume-9f04a7dc-1350-4058-83b4-86155d109282 (9f04a7dc-1350-4058-83b4-86155d109282): created successfully Jul 08 01:51:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88d7cad4-c2b5-4f19-b64c-c2beb46c698f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Flow 'volume_create_manager' (008a6d89-1ad2-4dee-8442-dac09ca2ea34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:51:38 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-381a84ce-3024-4a3e-8ef9-3ffed37a536d tempest-VolumesGetTest-903145024 None] Created volume successfully. Jul 08 01:51:39 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f7a76dc-81d5-460c-ac2d-d32d7be5071b tempest-VolumesGetTest-903145024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:51:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4f7a76dc-81d5-460c-ac2d-d32d7be5071b tempest-VolumesGetTest-903145024 None] Flow 'volume_create_manager' (db2864da-9277-4188-92a6-886ac87f2c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:51:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4f7a76dc-81d5-460c-ac2d-d32d7be5071b tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (116f539c-9bae-4fc7-90cf-1456f75afce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4f7a76dc-81d5-460c-ac2d-d32d7be5071b tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (116f539c-9bae-4fc7-90cf-1456f75afce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:51:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-167908292',display_name='tempest-VolumesGetTest-Volume-1854924301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c44b0c0a-1c62-4cd8-9c08-6827cc4cf8ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='beeba2059c0a4654bf9afe0364d0f518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:51:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:51:39Z,use_quota=True,user_id='a8d30b0dc18249c4bf2869d08aeffcec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4f7a76dc-81d5-460c-ac2d-d32d7be5071b tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de9717b8-507e-4590-936c-2b4a5c59990c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4f7a76dc-81d5-460c-ac2d-d32d7be5071b tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de9717b8-507e-4590-936c-2b4a5c59990c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4f7a76dc-81d5-460c-ac2d-d32d7be5071b tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78015d80-e8d0-4817-907a-439bef1b8b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4f7a76dc-81d5-460c-ac2d-d32d7be5071b tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78015d80-e8d0-4817-907a-439bef1b8b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c44b0c0a-1c62-4cd8-9c08-6827cc4cf8ed', 'volume_name': 'volume-c44b0c0a-1c62-4cd8-9c08-6827cc4cf8ed', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4f7a76dc-81d5-460c-ac2d-d32d7be5071b tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da61ebd3-2416-414e-9574-0f07be966a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4f7a76dc-81d5-460c-ac2d-d32d7be5071b tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da61ebd3-2416-414e-9574-0f07be966a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4f7a76dc-81d5-460c-ac2d-d32d7be5071b tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36f236ac-a2fc-4a31-bf3f-71904160be9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:39 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-4f7a76dc-81d5-460c-ac2d-d32d7be5071b tempest-VolumesGetTest-903145024 None] Volume c44b0c0a-1c62-4cd8-9c08-6827cc4cf8ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c44b0c0a-1c62-4cd8-9c08-6827cc4cf8ed', 'volume_size': 1} Jul 08 01:51:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4f7a76dc-81d5-460c-ac2d-d32d7be5071b tempest-VolumesGetTest-903145024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:51:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4f7a76dc-81d5-460c-ac2d-d32d7be5071b tempest-VolumesGetTest-903145024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:51:39 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-4f7a76dc-81d5-460c-ac2d-d32d7be5071b tempest-VolumesGetTest-903145024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:51:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-167908292',display_name='tempest-VolumesGetTest-Volume-1854924301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c44b0c0a-1c62-4cd8-9c08-6827cc4cf8ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='beeba2059c0a4654bf9afe0364d0f518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:51:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:51:39Z,use_quota=True,user_id='a8d30b0dc18249c4bf2869d08aeffcec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:51:39 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-4f7a76dc-81d5-460c-ac2d-d32d7be5071b tempest-VolumesGetTest-903145024 None] Creating volume c44b0c0a-1c62-4cd8-9c08-6827cc4cf8ed {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:51:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4f7a76dc-81d5-460c-ac2d-d32d7be5071b tempest-VolumesGetTest-903145024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:51:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4f7a76dc-81d5-460c-ac2d-d32d7be5071b tempest-VolumesGetTest-903145024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:51:39 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-4f7a76dc-81d5-460c-ac2d-d32d7be5071b tempest-VolumesGetTest-903145024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:51:39 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-4f7a76dc-81d5-460c-ac2d-d32d7be5071b tempest-VolumesGetTest-903145024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:51:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4f7a76dc-81d5-460c-ac2d-d32d7be5071b tempest-VolumesGetTest-903145024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:51:39 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-4f7a76dc-81d5-460c-ac2d-d32d7be5071b tempest-VolumesGetTest-903145024 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:51:39 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-4f7a76dc-81d5-460c-ac2d-d32d7be5071b tempest-VolumesGetTest-903145024 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:51:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4f7a76dc-81d5-460c-ac2d-d32d7be5071b tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c44b0c0a-1c62-4cd8-9c08-6827cc4cf8ed 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:39 devstack sudo[102772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c44b0c0a-1c62-4cd8-9c08-6827cc4cf8ed 1073741824 Jul 08 01:51:39 devstack sudo[102772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:40 devstack sudo[102772]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4f7a76dc-81d5-460c-ac2d-d32d7be5071b tempest-VolumesGetTest-903145024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c44b0c0a-1c62-4cd8-9c08-6827cc4cf8ed 1073741824" returned: 0 in 0.872s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4f7a76dc-81d5-460c-ac2d-d32d7be5071b tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c44b0c0a-1c62-4cd8-9c08-6827cc4cf8ed {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:42 devstack sudo[102777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c44b0c0a-1c62-4cd8-9c08-6827cc4cf8ed Jul 08 01:51:42 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:43 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4f7a76dc-81d5-460c-ac2d-d32d7be5071b tempest-VolumesGetTest-903145024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c44b0c0a-1c62-4cd8-9c08-6827cc4cf8ed" returned: 0 in 0.671s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:43 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-4f7a76dc-81d5-460c-ac2d-d32d7be5071b tempest-VolumesGetTest-903145024 None] <== create_volume: return (3666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:51:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4f7a76dc-81d5-460c-ac2d-d32d7be5071b tempest-VolumesGetTest-903145024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.669s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:51:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4f7a76dc-81d5-460c-ac2d-d32d7be5071b tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36f236ac-a2fc-4a31-bf3f-71904160be9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c44b0c0a-1c62-4cd8-9c08-6827cc4cf8ed', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4f7a76dc-81d5-460c-ac2d-d32d7be5071b tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b6b6cd5-880a-486c-8dc0-931224ab901e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:45 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-4f7a76dc-81d5-460c-ac2d-d32d7be5071b tempest-VolumesGetTest-903145024 None] Volume volume-c44b0c0a-1c62-4cd8-9c08-6827cc4cf8ed (c44b0c0a-1c62-4cd8-9c08-6827cc4cf8ed): created successfully Jul 08 01:51:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4f7a76dc-81d5-460c-ac2d-d32d7be5071b tempest-VolumesGetTest-903145024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b6b6cd5-880a-486c-8dc0-931224ab901e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-4f7a76dc-81d5-460c-ac2d-d32d7be5071b tempest-VolumesGetTest-903145024 None] Flow 'volume_create_manager' (db2864da-9277-4188-92a6-886ac87f2c78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:51:45 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-4f7a76dc-81d5-460c-ac2d-d32d7be5071b tempest-VolumesGetTest-903145024 None] Created volume successfully. Jul 08 01:51:45 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-4ffeae05-93f7-47a4-ba31-d470a67c7a67 tempest-VolumesGetTest-903145024 None] Acquiring lock "cinder-c44b0c0a-1c62-4cd8-9c08-6827cc4cf8ed-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:51:46 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-4ffeae05-93f7-47a4-ba31-d470a67c7a67 tempest-VolumesGetTest-903145024 None] Lock "cinder-c44b0c0a-1c62-4cd8-9c08-6827cc4cf8ed-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:51:46 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-4ffeae05-93f7-47a4-ba31-d470a67c7a67 tempest-VolumesGetTest-903145024 None] Acquiring lock "cinder-quobyte-c44b0c0a-1c62-4cd8-9c08-6827cc4cf8ed" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:51:46 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-4ffeae05-93f7-47a4-ba31-d470a67c7a67 tempest-VolumesGetTest-903145024 None] Lock "cinder-quobyte-c44b0c0a-1c62-4cd8-9c08-6827cc4cf8ed" acquired by "delete_volume" :: waited 0.016s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:51:46 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b92706-25e2-4a18-a167-d57f0a3d9039]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:51:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4ffeae05-93f7-47a4-ba31-d470a67c7a67 tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c44b0c0a-1c62-4cd8-9c08-6827cc4cf8ed {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:46 devstack sudo[102781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c44b0c0a-1c62-4cd8-9c08-6827cc4cf8ed Jul 08 01:51:46 devstack sudo[102781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:46 devstack sudo[102781]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4ffeae05-93f7-47a4-ba31-d470a67c7a67 tempest-VolumesGetTest-903145024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c44b0c0a-1c62-4cd8-9c08-6827cc4cf8ed" returned: 0 in 0.797s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4ffeae05-93f7-47a4-ba31-d470a67c7a67 tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c44b0c0a-1c62-4cd8-9c08-6827cc4cf8ed {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:46 devstack sudo[102786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c44b0c0a-1c62-4cd8-9c08-6827cc4cf8ed Jul 08 01:51:46 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:47 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4ffeae05-93f7-47a4-ba31-d470a67c7a67 tempest-VolumesGetTest-903145024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c44b0c0a-1c62-4cd8-9c08-6827cc4cf8ed" returned: 0 in 0.675s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:47 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-4ffeae05-93f7-47a4-ba31-d470a67c7a67 tempest-VolumesGetTest-903145024 None] Lock "cinder-quobyte-c44b0c0a-1c62-4cd8-9c08-6827cc4cf8ed" released by "delete_volume" :: held 1.518s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:51:47 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-4ffeae05-93f7-47a4-ba31-d470a67c7a67 tempest-VolumesGetTest-903145024 None] Created reservations ['7e060ac8-db08-4c08-a6f3-463c73c79df5', 'a316d20c-17f6-4656-a3f4-3269d2b694bd', '6a081ec7-ecec-4be1-a7cb-66046917cc46', 'be3f2c0c-09c2-485f-bf17-1a25935208bf'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:51:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4ffeae05-93f7-47a4-ba31-d470a67c7a67 tempest-VolumesGetTest-903145024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:51:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4ffeae05-93f7-47a4-ba31-d470a67c7a67 tempest-VolumesGetTest-903145024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:51:47 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-4ffeae05-93f7-47a4-ba31-d470a67c7a67 tempest-VolumesGetTest-903145024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:51:47 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-4ffeae05-93f7-47a4-ba31-d470a67c7a67 tempest-VolumesGetTest-903145024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:51:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4ffeae05-93f7-47a4-ba31-d470a67c7a67 tempest-VolumesGetTest-903145024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:51:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4ffeae05-93f7-47a4-ba31-d470a67c7a67 tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:47 devstack sudo[102789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:51:47 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:48 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-bc36fd76-924a-4dd5-af3e-21991d89d942 tempest-VolumesGetTest-903145024 None] Acquiring lock "cinder-9f04a7dc-1350-4058-83b4-86155d109282-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:51:48 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-bc36fd76-924a-4dd5-af3e-21991d89d942 tempest-VolumesGetTest-903145024 None] Lock "cinder-9f04a7dc-1350-4058-83b4-86155d109282-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:51:48 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-bc36fd76-924a-4dd5-af3e-21991d89d942 tempest-VolumesGetTest-903145024 None] Acquiring lock "cinder-quobyte-9f04a7dc-1350-4058-83b4-86155d109282" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:51:48 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-bc36fd76-924a-4dd5-af3e-21991d89d942 tempest-VolumesGetTest-903145024 None] Lock "cinder-quobyte-9f04a7dc-1350-4058-83b4-86155d109282" acquired by "delete_volume" :: waited 0.020s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:51:48 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a32fd4-aed8-4055-a511-4556e9f56e84]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:51:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-bc36fd76-924a-4dd5-af3e-21991d89d942 tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f04a7dc-1350-4058-83b4-86155d109282 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:48 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4ffeae05-93f7-47a4-ba31-d470a67c7a67 tempest-VolumesGetTest-903145024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.819s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:48 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-4ffeae05-93f7-47a4-ba31-d470a67c7a67 tempest-VolumesGetTest-903145024 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:51:48 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-4ffeae05-93f7-47a4-ba31-d470a67c7a67 tempest-VolumesGetTest-903145024 None] Deleted volume successfully. Jul 08 01:51:48 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-4ffeae05-93f7-47a4-ba31-d470a67c7a67 tempest-VolumesGetTest-903145024 None] Lock "cinder-c44b0c0a-1c62-4cd8-9c08-6827cc4cf8ed-delete_volume" released by "delete_volume" :: held 2.586s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:51:48 devstack sudo[102792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f04a7dc-1350-4058-83b4-86155d109282 Jul 08 01:51:48 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:49 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-bc36fd76-924a-4dd5-af3e-21991d89d942 tempest-VolumesGetTest-903145024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f04a7dc-1350-4058-83b4-86155d109282" returned: 0 in 0.821s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-bc36fd76-924a-4dd5-af3e-21991d89d942 tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f04a7dc-1350-4058-83b4-86155d109282 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:49 devstack sudo[102796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f04a7dc-1350-4058-83b4-86155d109282 Jul 08 01:51:49 devstack sudo[102796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:50 devstack sudo[102796]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-bc36fd76-924a-4dd5-af3e-21991d89d942 tempest-VolumesGetTest-903145024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f04a7dc-1350-4058-83b4-86155d109282" returned: 1 in 0.812s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-bc36fd76-924a-4dd5-af3e-21991d89d942 tempest-VolumesGetTest-903145024 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f04a7dc-1350-4058-83b4-86155d109282' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:51:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-bc36fd76-924a-4dd5-af3e-21991d89d942 tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f04a7dc-1350-4058-83b4-86155d109282 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:50 devstack sudo[102801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f04a7dc-1350-4058-83b4-86155d109282 Jul 08 01:51:50 devstack sudo[102801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:50 devstack sudo[102801]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-bc36fd76-924a-4dd5-af3e-21991d89d942 tempest-VolumesGetTest-903145024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f04a7dc-1350-4058-83b4-86155d109282" returned: 0 in 0.727s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:50 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-bc36fd76-924a-4dd5-af3e-21991d89d942 tempest-VolumesGetTest-903145024 None] Lock "cinder-quobyte-9f04a7dc-1350-4058-83b4-86155d109282" released by "delete_volume" :: held 2.447s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:51:50 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-bc36fd76-924a-4dd5-af3e-21991d89d942 tempest-VolumesGetTest-903145024 None] Created reservations ['0e8c3e98-239a-4e77-939f-ce4e01b9472e', 'c9254542-ba70-4ed3-92fc-7539b3faa121', 'd3a61595-946b-4dcc-92c6-45a626d2b100', 'b6f10e44-04f2-4ff0-9e94-0fa2f3e21515'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:51:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-bc36fd76-924a-4dd5-af3e-21991d89d942 tempest-VolumesGetTest-903145024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:51:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-bc36fd76-924a-4dd5-af3e-21991d89d942 tempest-VolumesGetTest-903145024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:51:51 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-bc36fd76-924a-4dd5-af3e-21991d89d942 tempest-VolumesGetTest-903145024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:51:51 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-bc36fd76-924a-4dd5-af3e-21991d89d942 tempest-VolumesGetTest-903145024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:51:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-bc36fd76-924a-4dd5-af3e-21991d89d942 tempest-VolumesGetTest-903145024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:51:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-bc36fd76-924a-4dd5-af3e-21991d89d942 tempest-VolumesGetTest-903145024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:51 devstack sudo[102804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:51:51 devstack sudo[102804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:51 devstack sudo[102804]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-bc36fd76-924a-4dd5-af3e-21991d89d942 tempest-VolumesGetTest-903145024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.792s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:51 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-bc36fd76-924a-4dd5-af3e-21991d89d942 tempest-VolumesGetTest-903145024 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:51:51 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-bc36fd76-924a-4dd5-af3e-21991d89d942 tempest-VolumesGetTest-903145024 None] Deleted volume successfully. Jul 08 01:51:51 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-bc36fd76-924a-4dd5-af3e-21991d89d942 tempest-VolumesGetTest-903145024 None] Lock "cinder-9f04a7dc-1350-4058-83b4-86155d109282-delete_volume" released by "delete_volume" :: held 3.519s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:51:55 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager._thread_info {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:51:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread count: 29 {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:51:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread info: [<_MainThread(MainThread, started 127058402500736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:51:57 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee36d6cf-40e3-4db8-84d8-217ba617e548 tempest-VolumesNegativeTest-1250689470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:51:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ee36d6cf-40e3-4db8-84d8-217ba617e548 tempest-VolumesNegativeTest-1250689470 None] Flow 'volume_create_manager' (670d9187-9845-4da0-977b-4cd2307472e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:51:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ee36d6cf-40e3-4db8-84d8-217ba617e548 tempest-VolumesNegativeTest-1250689470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09024552-2eba-4d2e-a4fc-93d4a1c9954a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ee36d6cf-40e3-4db8-84d8-217ba617e548 tempest-VolumesNegativeTest-1250689470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09024552-2eba-4d2e-a4fc-93d4a1c9954a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1932288638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3726c0c4-d5f9-4c90-b03d-bd6af544a515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd13f8dcc31d43be9b12e6b84b6a2de9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:51:58Z,use_quota=True,user_id='40791139164943a590d19f414db33534',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ee36d6cf-40e3-4db8-84d8-217ba617e548 tempest-VolumesNegativeTest-1250689470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e112201e-1ff4-4ff6-9ece-91cfa8da895e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ee36d6cf-40e3-4db8-84d8-217ba617e548 tempest-VolumesNegativeTest-1250689470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e112201e-1ff4-4ff6-9ece-91cfa8da895e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ee36d6cf-40e3-4db8-84d8-217ba617e548 tempest-VolumesNegativeTest-1250689470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b948bb6-2727-4d6f-bee9-52d5ff9ac83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ee36d6cf-40e3-4db8-84d8-217ba617e548 tempest-VolumesNegativeTest-1250689470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b948bb6-2727-4d6f-bee9-52d5ff9ac83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3726c0c4-d5f9-4c90-b03d-bd6af544a515', 'volume_name': 'volume-3726c0c4-d5f9-4c90-b03d-bd6af544a515', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ee36d6cf-40e3-4db8-84d8-217ba617e548 tempest-VolumesNegativeTest-1250689470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c84819c0-8ade-4978-920d-666b84696916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ee36d6cf-40e3-4db8-84d8-217ba617e548 tempest-VolumesNegativeTest-1250689470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c84819c0-8ade-4978-920d-666b84696916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ee36d6cf-40e3-4db8-84d8-217ba617e548 tempest-VolumesNegativeTest-1250689470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccf1d249-2a5f-483d-8077-eafbdfaacc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:57 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-ee36d6cf-40e3-4db8-84d8-217ba617e548 tempest-VolumesNegativeTest-1250689470 None] Volume 3726c0c4-d5f9-4c90-b03d-bd6af544a515: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3726c0c4-d5f9-4c90-b03d-bd6af544a515', 'volume_size': 1} Jul 08 01:51:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ee36d6cf-40e3-4db8-84d8-217ba617e548 tempest-VolumesNegativeTest-1250689470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:51:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ee36d6cf-40e3-4db8-84d8-217ba617e548 tempest-VolumesNegativeTest-1250689470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:51:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-ee36d6cf-40e3-4db8-84d8-217ba617e548 tempest-VolumesNegativeTest-1250689470 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1932288638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3726c0c4-d5f9-4c90-b03d-bd6af544a515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd13f8dcc31d43be9b12e6b84b6a2de9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:51:58Z,use_quota=True,user_id='40791139164943a590d19f414db33534',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:51:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-ee36d6cf-40e3-4db8-84d8-217ba617e548 tempest-VolumesNegativeTest-1250689470 None] Creating volume 3726c0c4-d5f9-4c90-b03d-bd6af544a515 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:51:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ee36d6cf-40e3-4db8-84d8-217ba617e548 tempest-VolumesNegativeTest-1250689470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:51:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ee36d6cf-40e3-4db8-84d8-217ba617e548 tempest-VolumesNegativeTest-1250689470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:51:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-ee36d6cf-40e3-4db8-84d8-217ba617e548 tempest-VolumesNegativeTest-1250689470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:51:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-ee36d6cf-40e3-4db8-84d8-217ba617e548 tempest-VolumesNegativeTest-1250689470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:51:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ee36d6cf-40e3-4db8-84d8-217ba617e548 tempest-VolumesNegativeTest-1250689470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:51:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-ee36d6cf-40e3-4db8-84d8-217ba617e548 tempest-VolumesNegativeTest-1250689470 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:51:57 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-ee36d6cf-40e3-4db8-84d8-217ba617e548 tempest-VolumesNegativeTest-1250689470 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:51:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ee36d6cf-40e3-4db8-84d8-217ba617e548 tempest-VolumesNegativeTest-1250689470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3726c0c4-d5f9-4c90-b03d-bd6af544a515 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:57 devstack sudo[102811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3726c0c4-d5f9-4c90-b03d-bd6af544a515 1073741824 Jul 08 01:51:57 devstack sudo[102811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:58 devstack sudo[102811]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ee36d6cf-40e3-4db8-84d8-217ba617e548 tempest-VolumesNegativeTest-1250689470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3726c0c4-d5f9-4c90-b03d-bd6af544a515 1073741824" returned: 0 in 0.935s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ee36d6cf-40e3-4db8-84d8-217ba617e548 tempest-VolumesNegativeTest-1250689470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3726c0c4-d5f9-4c90-b03d-bd6af544a515 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:58 devstack sudo[102819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3726c0c4-d5f9-4c90-b03d-bd6af544a515 Jul 08 01:51:58 devstack sudo[102819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:59 devstack sudo[102819]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ee36d6cf-40e3-4db8-84d8-217ba617e548 tempest-VolumesNegativeTest-1250689470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3726c0c4-d5f9-4c90-b03d-bd6af544a515" returned: 0 in 0.708s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:59 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-ee36d6cf-40e3-4db8-84d8-217ba617e548 tempest-VolumesNegativeTest-1250689470 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:51:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ee36d6cf-40e3-4db8-84d8-217ba617e548 tempest-VolumesNegativeTest-1250689470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.699s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:51:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ee36d6cf-40e3-4db8-84d8-217ba617e548 tempest-VolumesNegativeTest-1250689470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccf1d249-2a5f-483d-8077-eafbdfaacc2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3726c0c4-d5f9-4c90-b03d-bd6af544a515', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ee36d6cf-40e3-4db8-84d8-217ba617e548 tempest-VolumesNegativeTest-1250689470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (905f8a8d-505e-4698-9be2-0b947a0352a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:59 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-ee36d6cf-40e3-4db8-84d8-217ba617e548 tempest-VolumesNegativeTest-1250689470 None] Volume volume-3726c0c4-d5f9-4c90-b03d-bd6af544a515 (3726c0c4-d5f9-4c90-b03d-bd6af544a515): created successfully Jul 08 01:51:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ee36d6cf-40e3-4db8-84d8-217ba617e548 tempest-VolumesNegativeTest-1250689470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (905f8a8d-505e-4698-9be2-0b947a0352a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ee36d6cf-40e3-4db8-84d8-217ba617e548 tempest-VolumesNegativeTest-1250689470 None] Flow 'volume_create_manager' (670d9187-9845-4da0-977b-4cd2307472e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:51:59 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-ee36d6cf-40e3-4db8-84d8-217ba617e548 tempest-VolumesNegativeTest-1250689470 None] Created volume successfully. Jul 08 01:52:09 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=17,cinder:INSERT=13,cinder:UPDATE=23,cinder:DELETE=3 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:52:09 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:UPDATE=58,cinder:SELECT=46,cinder:DELETE=5,cinder:INSERT=16 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:52:30 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5351f062-e1e4-4dca-a2ea-fe8a9355bf48 tempest-VolumesNegativeTest-1250689470 None] Acquiring lock "cinder-3726c0c4-d5f9-4c90-b03d-bd6af544a515-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:52:30 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5351f062-e1e4-4dca-a2ea-fe8a9355bf48 tempest-VolumesNegativeTest-1250689470 None] Lock "cinder-3726c0c4-d5f9-4c90-b03d-bd6af544a515-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:52:30 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5351f062-e1e4-4dca-a2ea-fe8a9355bf48 tempest-VolumesNegativeTest-1250689470 None] Acquiring lock "cinder-quobyte-3726c0c4-d5f9-4c90-b03d-bd6af544a515" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:52:30 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5351f062-e1e4-4dca-a2ea-fe8a9355bf48 tempest-VolumesNegativeTest-1250689470 None] Lock "cinder-quobyte-3726c0c4-d5f9-4c90-b03d-bd6af544a515" acquired by "delete_volume" :: waited 0.016s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:52:30 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e5dfde-656f-4294-b843-00923e6d3330]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:52:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5351f062-e1e4-4dca-a2ea-fe8a9355bf48 tempest-VolumesNegativeTest-1250689470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3726c0c4-d5f9-4c90-b03d-bd6af544a515 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:30 devstack sudo[102944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3726c0c4-d5f9-4c90-b03d-bd6af544a515 Jul 08 01:52:30 devstack sudo[102944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:31 devstack sudo[102944]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5351f062-e1e4-4dca-a2ea-fe8a9355bf48 tempest-VolumesNegativeTest-1250689470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3726c0c4-d5f9-4c90-b03d-bd6af544a515" returned: 0 in 0.826s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5351f062-e1e4-4dca-a2ea-fe8a9355bf48 tempest-VolumesNegativeTest-1250689470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3726c0c4-d5f9-4c90-b03d-bd6af544a515 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:31 devstack sudo[102950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3726c0c4-d5f9-4c90-b03d-bd6af544a515 Jul 08 01:52:31 devstack sudo[102950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:31 devstack sudo[102950]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5351f062-e1e4-4dca-a2ea-fe8a9355bf48 tempest-VolumesNegativeTest-1250689470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3726c0c4-d5f9-4c90-b03d-bd6af544a515" returned: 0 in 0.722s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:31 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5351f062-e1e4-4dca-a2ea-fe8a9355bf48 tempest-VolumesNegativeTest-1250689470 None] Lock "cinder-quobyte-3726c0c4-d5f9-4c90-b03d-bd6af544a515" released by "delete_volume" :: held 1.599s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:52:31 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-5351f062-e1e4-4dca-a2ea-fe8a9355bf48 tempest-VolumesNegativeTest-1250689470 None] Created reservations ['2603c912-4bac-4b42-b11a-6f01c0102bcd', 'd99944ec-5caf-48ad-8812-d9c4a15da596', 'c1bfc9a7-4a21-4fc8-a326-cb59f39e72d7', 'cbea7544-4eb9-4fb5-85cb-7f0f478a9193'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:52:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5351f062-e1e4-4dca-a2ea-fe8a9355bf48 tempest-VolumesNegativeTest-1250689470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:52:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5351f062-e1e4-4dca-a2ea-fe8a9355bf48 tempest-VolumesNegativeTest-1250689470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:52:32 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5351f062-e1e4-4dca-a2ea-fe8a9355bf48 tempest-VolumesNegativeTest-1250689470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:52:32 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5351f062-e1e4-4dca-a2ea-fe8a9355bf48 tempest-VolumesNegativeTest-1250689470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:52:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5351f062-e1e4-4dca-a2ea-fe8a9355bf48 tempest-VolumesNegativeTest-1250689470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:52:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5351f062-e1e4-4dca-a2ea-fe8a9355bf48 tempest-VolumesNegativeTest-1250689470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:32 devstack sudo[102953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:52:32 devstack sudo[102953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:32 devstack sudo[102953]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5351f062-e1e4-4dca-a2ea-fe8a9355bf48 tempest-VolumesNegativeTest-1250689470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.747s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:32 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-5351f062-e1e4-4dca-a2ea-fe8a9355bf48 tempest-VolumesNegativeTest-1250689470 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:52:32 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-5351f062-e1e4-4dca-a2ea-fe8a9355bf48 tempest-VolumesNegativeTest-1250689470 None] Deleted volume successfully. Jul 08 01:52:32 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5351f062-e1e4-4dca-a2ea-fe8a9355bf48 tempest-VolumesNegativeTest-1250689470 None] Lock "cinder-3726c0c4-d5f9-4c90-b03d-bd6af544a515-delete_volume" released by "delete_volume" :: held 2.596s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:52:47 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:UPDATE=9,cinder:SELECT=4,cinder:INSERT=2 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:52:47 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:52:55 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:52:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:52:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:52:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:52:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:52:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:52:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:55 devstack sudo[102999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:52:55 devstack sudo[102999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:55 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-41ea3eb8-9ccb-4506-9db8-ec8818d329fc tempest-TestServerVolumeAttachmentScenario-148945225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:52:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-41ea3eb8-9ccb-4506-9db8-ec8818d329fc tempest-TestServerVolumeAttachmentScenario-148945225 None] Flow 'volume_create_manager' (f1f194a9-048e-459c-a2ae-5ba3a268e8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:52:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-41ea3eb8-9ccb-4506-9db8-ec8818d329fc tempest-TestServerVolumeAttachmentScenario-148945225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be0cd625-91c0-4496-a21e-9b9a41f868ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-41ea3eb8-9ccb-4506-9db8-ec8818d329fc tempest-TestServerVolumeAttachmentScenario-148945225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be0cd625-91c0-4496-a21e-9b9a41f868ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-759318780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12f6ffa1-ab64-49c8-b4cc-ecf3e86bfe47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21a99aa8c5a348d7af63f7c5e0297f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:52:56Z,use_quota=True,user_id='8601e38f07a6417f941d8f27b4131a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-41ea3eb8-9ccb-4506-9db8-ec8818d329fc tempest-TestServerVolumeAttachmentScenario-148945225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8297554a-bb15-4ac8-9d44-ac94f07b59b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-41ea3eb8-9ccb-4506-9db8-ec8818d329fc tempest-TestServerVolumeAttachmentScenario-148945225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8297554a-bb15-4ac8-9d44-ac94f07b59b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:55 devstack sudo[102999]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-41ea3eb8-9ccb-4506-9db8-ec8818d329fc tempest-TestServerVolumeAttachmentScenario-148945225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b236f35-0c11-4a8f-a9c6-8ac9c7659f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-41ea3eb8-9ccb-4506-9db8-ec8818d329fc tempest-TestServerVolumeAttachmentScenario-148945225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b236f35-0c11-4a8f-a9c6-8ac9c7659f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12f6ffa1-ab64-49c8-b4cc-ecf3e86bfe47', 'volume_name': 'volume-12f6ffa1-ab64-49c8-b4cc-ecf3e86bfe47', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-41ea3eb8-9ccb-4506-9db8-ec8818d329fc tempest-TestServerVolumeAttachmentScenario-148945225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e40adb1-de24-4dd4-9481-0577fd70f08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-41ea3eb8-9ccb-4506-9db8-ec8818d329fc tempest-TestServerVolumeAttachmentScenario-148945225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e40adb1-de24-4dd4-9481-0577fd70f08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-41ea3eb8-9ccb-4506-9db8-ec8818d329fc tempest-TestServerVolumeAttachmentScenario-148945225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (511c9e44-a26e-4ddf-a0a4-d0bce8a39fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:55 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-41ea3eb8-9ccb-4506-9db8-ec8818d329fc tempest-TestServerVolumeAttachmentScenario-148945225 None] Volume 12f6ffa1-ab64-49c8-b4cc-ecf3e86bfe47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12f6ffa1-ab64-49c8-b4cc-ecf3e86bfe47', 'volume_size': 1} Jul 08 01:52:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-41ea3eb8-9ccb-4506-9db8-ec8818d329fc tempest-TestServerVolumeAttachmentScenario-148945225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:52:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-41ea3eb8-9ccb-4506-9db8-ec8818d329fc tempest-TestServerVolumeAttachmentScenario-148945225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:52:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-41ea3eb8-9ccb-4506-9db8-ec8818d329fc tempest-TestServerVolumeAttachmentScenario-148945225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-759318780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12f6ffa1-ab64-49c8-b4cc-ecf3e86bfe47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21a99aa8c5a348d7af63f7c5e0297f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:52:56Z,use_quota=True,user_id='8601e38f07a6417f941d8f27b4131a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:52:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-41ea3eb8-9ccb-4506-9db8-ec8818d329fc tempest-TestServerVolumeAttachmentScenario-148945225 None] Creating volume 12f6ffa1-ab64-49c8-b4cc-ecf3e86bfe47 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:52:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-41ea3eb8-9ccb-4506-9db8-ec8818d329fc tempest-TestServerVolumeAttachmentScenario-148945225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:52:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-41ea3eb8-9ccb-4506-9db8-ec8818d329fc tempest-TestServerVolumeAttachmentScenario-148945225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:52:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-41ea3eb8-9ccb-4506-9db8-ec8818d329fc tempest-TestServerVolumeAttachmentScenario-148945225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:52:56 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-41ea3eb8-9ccb-4506-9db8-ec8818d329fc tempest-TestServerVolumeAttachmentScenario-148945225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:52:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-41ea3eb8-9ccb-4506-9db8-ec8818d329fc tempest-TestServerVolumeAttachmentScenario-148945225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:52:56 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-41ea3eb8-9ccb-4506-9db8-ec8818d329fc tempest-TestServerVolumeAttachmentScenario-148945225 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:52:56 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-41ea3eb8-9ccb-4506-9db8-ec8818d329fc tempest-TestServerVolumeAttachmentScenario-148945225 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:52:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-41ea3eb8-9ccb-4506-9db8-ec8818d329fc tempest-TestServerVolumeAttachmentScenario-148945225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-12f6ffa1-ab64-49c8-b4cc-ecf3e86bfe47 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.824s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:56 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:52:56 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager._thread_info {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:52:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread count: 29 {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:52:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread info: [<_MainThread(MainThread, started 127058402500736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:52:56 devstack sudo[103004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-12f6ffa1-ab64-49c8-b4cc-ecf3e86bfe47 1073741824 Jul 08 01:52:56 devstack sudo[103004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:56 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0eab25a-7973-417b-8088-458c0d72080d tempest-TestServerVolumeAttachmentScenario-148945225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:52:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a0eab25a-7973-417b-8088-458c0d72080d tempest-TestServerVolumeAttachmentScenario-148945225 None] Flow 'volume_create_manager' (7c6c6b23-b538-493d-aa6f-1a33c7667fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:52:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a0eab25a-7973-417b-8088-458c0d72080d tempest-TestServerVolumeAttachmentScenario-148945225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb57504a-d44b-41fc-9d79-cebe078ed0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a0eab25a-7973-417b-8088-458c0d72080d tempest-TestServerVolumeAttachmentScenario-148945225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb57504a-d44b-41fc-9d79-cebe078ed0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1724744167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=452f6054-7167-4ec4-a8de-2572c51dad57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21a99aa8c5a348d7af63f7c5e0297f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:52:56Z,use_quota=True,user_id='8601e38f07a6417f941d8f27b4131a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a0eab25a-7973-417b-8088-458c0d72080d tempest-TestServerVolumeAttachmentScenario-148945225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (befa4359-771c-41f4-b394-13c8cbe46884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a0eab25a-7973-417b-8088-458c0d72080d tempest-TestServerVolumeAttachmentScenario-148945225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (befa4359-771c-41f4-b394-13c8cbe46884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a0eab25a-7973-417b-8088-458c0d72080d tempest-TestServerVolumeAttachmentScenario-148945225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a619101-d830-40be-b17c-4e987d3b28b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a0eab25a-7973-417b-8088-458c0d72080d tempest-TestServerVolumeAttachmentScenario-148945225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a619101-d830-40be-b17c-4e987d3b28b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '452f6054-7167-4ec4-a8de-2572c51dad57', 'volume_name': 'volume-452f6054-7167-4ec4-a8de-2572c51dad57', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a0eab25a-7973-417b-8088-458c0d72080d tempest-TestServerVolumeAttachmentScenario-148945225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8fd86cb-ce16-4700-a215-fa3a051a9c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a0eab25a-7973-417b-8088-458c0d72080d tempest-TestServerVolumeAttachmentScenario-148945225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8fd86cb-ce16-4700-a215-fa3a051a9c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a0eab25a-7973-417b-8088-458c0d72080d tempest-TestServerVolumeAttachmentScenario-148945225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac10587c-88fb-47ce-b5aa-721cc957b9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:56 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-a0eab25a-7973-417b-8088-458c0d72080d tempest-TestServerVolumeAttachmentScenario-148945225 None] Volume 452f6054-7167-4ec4-a8de-2572c51dad57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-452f6054-7167-4ec4-a8de-2572c51dad57', 'volume_size': 1} Jul 08 01:52:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a0eab25a-7973-417b-8088-458c0d72080d tempest-TestServerVolumeAttachmentScenario-148945225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:52:57 devstack sudo[103004]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-41ea3eb8-9ccb-4506-9db8-ec8818d329fc tempest-TestServerVolumeAttachmentScenario-148945225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-12f6ffa1-ab64-49c8-b4cc-ecf3e86bfe47 1073741824" returned: 0 in 1.079s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-41ea3eb8-9ccb-4506-9db8-ec8818d329fc tempest-TestServerVolumeAttachmentScenario-148945225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-12f6ffa1-ab64-49c8-b4cc-ecf3e86bfe47 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:57 devstack sudo[103009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-12f6ffa1-ab64-49c8-b4cc-ecf3e86bfe47 Jul 08 01:52:57 devstack sudo[103009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:57 devstack sudo[103009]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-41ea3eb8-9ccb-4506-9db8-ec8818d329fc tempest-TestServerVolumeAttachmentScenario-148945225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-12f6ffa1-ab64-49c8-b4cc-ecf3e86bfe47" returned: 0 in 0.739s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-41ea3eb8-9ccb-4506-9db8-ec8818d329fc tempest-TestServerVolumeAttachmentScenario-148945225 None] <== create_volume: return (1863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:52:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-41ea3eb8-9ccb-4506-9db8-ec8818d329fc tempest-TestServerVolumeAttachmentScenario-148945225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.866s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:52:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a0eab25a-7973-417b-8088-458c0d72080d tempest-TestServerVolumeAttachmentScenario-148945225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.493s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:52:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a0eab25a-7973-417b-8088-458c0d72080d tempest-TestServerVolumeAttachmentScenario-148945225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1724744167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=452f6054-7167-4ec4-a8de-2572c51dad57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21a99aa8c5a348d7af63f7c5e0297f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:52:56Z,use_quota=True,user_id='8601e38f07a6417f941d8f27b4131a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:52:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-a0eab25a-7973-417b-8088-458c0d72080d tempest-TestServerVolumeAttachmentScenario-148945225 None] Creating volume 452f6054-7167-4ec4-a8de-2572c51dad57 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:52:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a0eab25a-7973-417b-8088-458c0d72080d tempest-TestServerVolumeAttachmentScenario-148945225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:52:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a0eab25a-7973-417b-8088-458c0d72080d tempest-TestServerVolumeAttachmentScenario-148945225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:52:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a0eab25a-7973-417b-8088-458c0d72080d tempest-TestServerVolumeAttachmentScenario-148945225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:52:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a0eab25a-7973-417b-8088-458c0d72080d tempest-TestServerVolumeAttachmentScenario-148945225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:52:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a0eab25a-7973-417b-8088-458c0d72080d tempest-TestServerVolumeAttachmentScenario-148945225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:52:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a0eab25a-7973-417b-8088-458c0d72080d tempest-TestServerVolumeAttachmentScenario-148945225 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:52:57 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-a0eab25a-7973-417b-8088-458c0d72080d tempest-TestServerVolumeAttachmentScenario-148945225 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:52:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a0eab25a-7973-417b-8088-458c0d72080d tempest-TestServerVolumeAttachmentScenario-148945225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-452f6054-7167-4ec4-a8de-2572c51dad57 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-41ea3eb8-9ccb-4506-9db8-ec8818d329fc tempest-TestServerVolumeAttachmentScenario-148945225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (511c9e44-a26e-4ddf-a0a4-d0bce8a39fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12f6ffa1-ab64-49c8-b4cc-ecf3e86bfe47', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:57 devstack sudo[103014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-452f6054-7167-4ec4-a8de-2572c51dad57 1073741824 Jul 08 01:52:57 devstack sudo[103014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-41ea3eb8-9ccb-4506-9db8-ec8818d329fc tempest-TestServerVolumeAttachmentScenario-148945225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adb5ccd3-90b6-492f-9bd2-ad7ad0d95e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:57 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-41ea3eb8-9ccb-4506-9db8-ec8818d329fc tempest-TestServerVolumeAttachmentScenario-148945225 None] Volume volume-12f6ffa1-ab64-49c8-b4cc-ecf3e86bfe47 (12f6ffa1-ab64-49c8-b4cc-ecf3e86bfe47): created successfully Jul 08 01:52:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-41ea3eb8-9ccb-4506-9db8-ec8818d329fc tempest-TestServerVolumeAttachmentScenario-148945225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adb5ccd3-90b6-492f-9bd2-ad7ad0d95e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-41ea3eb8-9ccb-4506-9db8-ec8818d329fc tempest-TestServerVolumeAttachmentScenario-148945225 None] Flow 'volume_create_manager' (f1f194a9-048e-459c-a2ae-5ba3a268e8b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:52:57 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-41ea3eb8-9ccb-4506-9db8-ec8818d329fc tempest-TestServerVolumeAttachmentScenario-148945225 None] Created volume successfully. Jul 08 01:52:58 devstack sudo[103014]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a0eab25a-7973-417b-8088-458c0d72080d tempest-TestServerVolumeAttachmentScenario-148945225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-452f6054-7167-4ec4-a8de-2572c51dad57 1073741824" returned: 0 in 1.027s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a0eab25a-7973-417b-8088-458c0d72080d tempest-TestServerVolumeAttachmentScenario-148945225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-452f6054-7167-4ec4-a8de-2572c51dad57 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:58 devstack sudo[103020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-452f6054-7167-4ec4-a8de-2572c51dad57 Jul 08 01:52:58 devstack sudo[103020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:59 devstack sudo[103020]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a0eab25a-7973-417b-8088-458c0d72080d tempest-TestServerVolumeAttachmentScenario-148945225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-452f6054-7167-4ec4-a8de-2572c51dad57" returned: 0 in 0.695s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:59 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a0eab25a-7973-417b-8088-458c0d72080d tempest-TestServerVolumeAttachmentScenario-148945225 None] <== create_volume: return (1776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:52:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a0eab25a-7973-417b-8088-458c0d72080d tempest-TestServerVolumeAttachmentScenario-148945225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.779s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:52:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a0eab25a-7973-417b-8088-458c0d72080d tempest-TestServerVolumeAttachmentScenario-148945225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac10587c-88fb-47ce-b5aa-721cc957b9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-452f6054-7167-4ec4-a8de-2572c51dad57', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a0eab25a-7973-417b-8088-458c0d72080d tempest-TestServerVolumeAttachmentScenario-148945225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5ff8024-8275-4e90-aac8-36fdb35fe727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:59 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-a0eab25a-7973-417b-8088-458c0d72080d tempest-TestServerVolumeAttachmentScenario-148945225 None] Volume volume-452f6054-7167-4ec4-a8de-2572c51dad57 (452f6054-7167-4ec4-a8de-2572c51dad57): created successfully Jul 08 01:52:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a0eab25a-7973-417b-8088-458c0d72080d tempest-TestServerVolumeAttachmentScenario-148945225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5ff8024-8275-4e90-aac8-36fdb35fe727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a0eab25a-7973-417b-8088-458c0d72080d tempest-TestServerVolumeAttachmentScenario-148945225 None] Flow 'volume_create_manager' (7c6c6b23-b538-493d-aa6f-1a33c7667fa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:52:59 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-a0eab25a-7973-417b-8088-458c0d72080d tempest-TestServerVolumeAttachmentScenario-148945225 None] Created volume successfully. Jul 08 01:53:09 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=5,cinder:UPDATE=7,cinder:INSERT=1 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:53:09 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=3,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=2 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:53:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-4c2d593d-64d8-483d-a36d-ef61750bc738 req-365092b0-62b3-4a27-879c-a69778010f12 tempest-TestServerVolumeAttachmentScenario-148945225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:53:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-4c2d593d-64d8-483d-a36d-ef61750bc738 req-365092b0-62b3-4a27-879c-a69778010f12 tempest-TestServerVolumeAttachmentScenario-148945225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:39 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65772b9-19ec-4599-97c8-0c226226414d]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:53:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-4c2d593d-64d8-483d-a36d-ef61750bc738 req-365092b0-62b3-4a27-879c-a69778010f12 tempest-TestServerVolumeAttachmentScenario-148945225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-12f6ffa1-ab64-49c8-b4cc-ecf3e86bfe47 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:40 devstack sudo[103194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-12f6ffa1-ab64-49c8-b4cc-ecf3e86bfe47 Jul 08 01:53:40 devstack sudo[103194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:40 devstack sudo[103194]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-4c2d593d-64d8-483d-a36d-ef61750bc738 req-365092b0-62b3-4a27-879c-a69778010f12 tempest-TestServerVolumeAttachmentScenario-148945225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-12f6ffa1-ab64-49c8-b4cc-ecf3e86bfe47" returned: 0 in 0.820s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-4c2d593d-64d8-483d-a36d-ef61750bc738 req-365092b0-62b3-4a27-879c-a69778010f12 tempest-TestServerVolumeAttachmentScenario-148945225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.840s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-4c2d593d-64d8-483d-a36d-ef61750bc738 req-365092b0-62b3-4a27-879c-a69778010f12 tempest-TestServerVolumeAttachmentScenario-148945225 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96', 'name': 'volume-12f6ffa1-ab64-49c8-b4cc-ecf3e86bfe47', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6ab69ad6-0cc5-4849-b4c9-66913a8480dd', 'enforce_multipath': True} {{(pid=87284) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:53:40 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-4c2d593d-64d8-483d-a36d-ef61750bc738 req-365092b0-62b3-4a27-879c-a69778010f12 tempest-TestServerVolumeAttachmentScenario-148945225 None] attachment_update completed successfully. Jul 08 01:53:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-b3709f73-60f7-43ea-b3d0-47693dc1f07c req-b6603c0f-0ff7-4742-8c7e-dbb7733f8686 tempest-TestServerVolumeAttachmentScenario-148945225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:53:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-b3709f73-60f7-43ea-b3d0-47693dc1f07c req-b6603c0f-0ff7-4742-8c7e-dbb7733f8686 tempest-TestServerVolumeAttachmentScenario-148945225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:50 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea61739d-a205-4165-8a3f-1be0bba6dcaa]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:53:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-b3709f73-60f7-43ea-b3d0-47693dc1f07c req-b6603c0f-0ff7-4742-8c7e-dbb7733f8686 tempest-TestServerVolumeAttachmentScenario-148945225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-452f6054-7167-4ec4-a8de-2572c51dad57 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:50 devstack sudo[103593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-452f6054-7167-4ec4-a8de-2572c51dad57 Jul 08 01:53:50 devstack sudo[103593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:51 devstack sudo[103593]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [req-b3709f73-60f7-43ea-b3d0-47693dc1f07c req-b6603c0f-0ff7-4742-8c7e-dbb7733f8686 tempest-TestServerVolumeAttachmentScenario-148945225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-452f6054-7167-4ec4-a8de-2572c51dad57" returned: 0 in 0.818s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [req-b3709f73-60f7-43ea-b3d0-47693dc1f07c req-b6603c0f-0ff7-4742-8c7e-dbb7733f8686 tempest-TestServerVolumeAttachmentScenario-148945225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.837s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:51 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-b3709f73-60f7-43ea-b3d0-47693dc1f07c req-b6603c0f-0ff7-4742-8c7e-dbb7733f8686 tempest-TestServerVolumeAttachmentScenario-148945225 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96', 'name': 'volume-452f6054-7167-4ec4-a8de-2572c51dad57', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '07ff1657-ba94-42d1-908e-c1ea2e052ccd', 'enforce_multipath': True} {{(pid=87284) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:53:51 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-b3709f73-60f7-43ea-b3d0-47693dc1f07c req-b6603c0f-0ff7-4742-8c7e-dbb7733f8686 tempest-TestServerVolumeAttachmentScenario-148945225 None] attachment_update completed successfully. Jul 08 01:53:55 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:53:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:53:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:53:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:53:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:55 devstack sudo[103602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:53:55 devstack sudo[103602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:55 devstack sudo[103602]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.682s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:55 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:53:55 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager._thread_info {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:53:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread count: 29 {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:53:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread info: [<_MainThread(MainThread, started 127058402500736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:53:56 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-7c895942-31b3-4280-8094-869d3ac27cef req-3f5248ee-b852-431f-9ee0-9c9437b314cb tempest-TestServerVolumeAttachmentScenario-148945225 None] Terminate volume connection completed successfully. Jul 08 01:53:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-7c895942-31b3-4280-8094-869d3ac27cef req-3f5248ee-b852-431f-9ee0-9c9437b314cb tempest-TestServerVolumeAttachmentScenario-148945225 None] Deleting attachment 07ff1657-ba94-42d1-908e-c1ea2e052ccd. {{(pid=87284) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:54:00 devstack cinder-volume[87284]: INFO cinder.volume.manager [req-83d09337-196c-4c61-9d40-1fcb3a74b947 req-549017d2-063a-4d2b-8883-7a8e429003a1 tempest-TestServerVolumeAttachmentScenario-148945225 None] Terminate volume connection completed successfully. Jul 08 01:54:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [req-83d09337-196c-4c61-9d40-1fcb3a74b947 req-549017d2-063a-4d2b-8883-7a8e429003a1 tempest-TestServerVolumeAttachmentScenario-148945225 None] Deleting attachment 6ab69ad6-0cc5-4849-b4c9-66913a8480dd. {{(pid=87284) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:54:06 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=13,cinder:UPDATE=2 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:54:10 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=13,cinder:UPDATE=4 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:54:11 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ecf4ce6c-9ea1-4867-ab2d-182022b71ddd tempest-TestServerVolumeAttachmentScenario-148945225 None] Acquiring lock "cinder-452f6054-7167-4ec4-a8de-2572c51dad57-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:54:11 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ecf4ce6c-9ea1-4867-ab2d-182022b71ddd tempest-TestServerVolumeAttachmentScenario-148945225 None] Lock "cinder-452f6054-7167-4ec4-a8de-2572c51dad57-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:54:11 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ecf4ce6c-9ea1-4867-ab2d-182022b71ddd tempest-TestServerVolumeAttachmentScenario-148945225 None] Acquiring lock "cinder-quobyte-452f6054-7167-4ec4-a8de-2572c51dad57" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:54:11 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ecf4ce6c-9ea1-4867-ab2d-182022b71ddd tempest-TestServerVolumeAttachmentScenario-148945225 None] Lock "cinder-quobyte-452f6054-7167-4ec4-a8de-2572c51dad57" acquired by "delete_volume" :: waited 0.017s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:54:11 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cfaa31-3189-44ed-94f3-df2a100c6949]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:54:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ecf4ce6c-9ea1-4867-ab2d-182022b71ddd tempest-TestServerVolumeAttachmentScenario-148945225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-452f6054-7167-4ec4-a8de-2572c51dad57 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:11 devstack sudo[103672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-452f6054-7167-4ec4-a8de-2572c51dad57 Jul 08 01:54:11 devstack sudo[103672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:12 devstack sudo[103672]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ecf4ce6c-9ea1-4867-ab2d-182022b71ddd tempest-TestServerVolumeAttachmentScenario-148945225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-452f6054-7167-4ec4-a8de-2572c51dad57" returned: 0 in 0.882s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ecf4ce6c-9ea1-4867-ab2d-182022b71ddd tempest-TestServerVolumeAttachmentScenario-148945225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-452f6054-7167-4ec4-a8de-2572c51dad57 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:12 devstack sudo[103677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-452f6054-7167-4ec4-a8de-2572c51dad57 Jul 08 01:54:12 devstack sudo[103677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:12 devstack sudo[103677]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ecf4ce6c-9ea1-4867-ab2d-182022b71ddd tempest-TestServerVolumeAttachmentScenario-148945225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-452f6054-7167-4ec4-a8de-2572c51dad57" returned: 0 in 0.701s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:12 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ecf4ce6c-9ea1-4867-ab2d-182022b71ddd tempest-TestServerVolumeAttachmentScenario-148945225 None] Lock "cinder-quobyte-452f6054-7167-4ec4-a8de-2572c51dad57" released by "delete_volume" :: held 1.630s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:54:12 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-ecf4ce6c-9ea1-4867-ab2d-182022b71ddd tempest-TestServerVolumeAttachmentScenario-148945225 None] Created reservations ['0fe1c1eb-9c7a-4f75-b32e-a60db80aa662', '45e1d762-bf53-4b75-946a-a7a385cedfbe', '769a6845-2a37-43e2-8f46-fa7eed7f7472', 'dbe678f3-5a85-41c2-ad2e-058271dc306a'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:54:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ecf4ce6c-9ea1-4867-ab2d-182022b71ddd tempest-TestServerVolumeAttachmentScenario-148945225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:54:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ecf4ce6c-9ea1-4867-ab2d-182022b71ddd tempest-TestServerVolumeAttachmentScenario-148945225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:54:12 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-ecf4ce6c-9ea1-4867-ab2d-182022b71ddd tempest-TestServerVolumeAttachmentScenario-148945225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:54:12 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-ecf4ce6c-9ea1-4867-ab2d-182022b71ddd tempest-TestServerVolumeAttachmentScenario-148945225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:54:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ecf4ce6c-9ea1-4867-ab2d-182022b71ddd tempest-TestServerVolumeAttachmentScenario-148945225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:54:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ecf4ce6c-9ea1-4867-ab2d-182022b71ddd tempest-TestServerVolumeAttachmentScenario-148945225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:12 devstack sudo[103680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:54:12 devstack sudo[103680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:13 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5ba332c9-132e-47c5-86b9-532f2c02201a tempest-TestServerVolumeAttachmentScenario-148945225 None] Acquiring lock "cinder-12f6ffa1-ab64-49c8-b4cc-ecf3e86bfe47-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:54:13 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5ba332c9-132e-47c5-86b9-532f2c02201a tempest-TestServerVolumeAttachmentScenario-148945225 None] Lock "cinder-12f6ffa1-ab64-49c8-b4cc-ecf3e86bfe47-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:54:13 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5ba332c9-132e-47c5-86b9-532f2c02201a tempest-TestServerVolumeAttachmentScenario-148945225 None] Acquiring lock "cinder-quobyte-12f6ffa1-ab64-49c8-b4cc-ecf3e86bfe47" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:54:13 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5ba332c9-132e-47c5-86b9-532f2c02201a tempest-TestServerVolumeAttachmentScenario-148945225 None] Lock "cinder-quobyte-12f6ffa1-ab64-49c8-b4cc-ecf3e86bfe47" acquired by "delete_volume" :: waited 0.017s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:54:13 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34cbfe6-9bc2-4748-813a-cc47a8579532]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:54:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5ba332c9-132e-47c5-86b9-532f2c02201a tempest-TestServerVolumeAttachmentScenario-148945225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-12f6ffa1-ab64-49c8-b4cc-ecf3e86bfe47 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:13 devstack sudo[103682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-12f6ffa1-ab64-49c8-b4cc-ecf3e86bfe47 Jul 08 01:54:13 devstack sudo[103682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:13 devstack sudo[103680]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ecf4ce6c-9ea1-4867-ab2d-182022b71ddd tempest-TestServerVolumeAttachmentScenario-148945225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.704s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:13 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-ecf4ce6c-9ea1-4867-ab2d-182022b71ddd tempest-TestServerVolumeAttachmentScenario-148945225 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:54:13 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-ecf4ce6c-9ea1-4867-ab2d-182022b71ddd tempest-TestServerVolumeAttachmentScenario-148945225 None] Deleted volume successfully. Jul 08 01:54:13 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ecf4ce6c-9ea1-4867-ab2d-182022b71ddd tempest-TestServerVolumeAttachmentScenario-148945225 None] Lock "cinder-452f6054-7167-4ec4-a8de-2572c51dad57-delete_volume" released by "delete_volume" :: held 2.571s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:54:14 devstack sudo[103682]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5ba332c9-132e-47c5-86b9-532f2c02201a tempest-TestServerVolumeAttachmentScenario-148945225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-12f6ffa1-ab64-49c8-b4cc-ecf3e86bfe47" returned: 0 in 0.827s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5ba332c9-132e-47c5-86b9-532f2c02201a tempest-TestServerVolumeAttachmentScenario-148945225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-12f6ffa1-ab64-49c8-b4cc-ecf3e86bfe47 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:14 devstack sudo[103688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-12f6ffa1-ab64-49c8-b4cc-ecf3e86bfe47 Jul 08 01:54:14 devstack sudo[103688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:14 devstack sudo[103688]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5ba332c9-132e-47c5-86b9-532f2c02201a tempest-TestServerVolumeAttachmentScenario-148945225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-12f6ffa1-ab64-49c8-b4cc-ecf3e86bfe47" returned: 0 in 0.692s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:15 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5ba332c9-132e-47c5-86b9-532f2c02201a tempest-TestServerVolumeAttachmentScenario-148945225 None] Lock "cinder-quobyte-12f6ffa1-ab64-49c8-b4cc-ecf3e86bfe47" released by "delete_volume" :: held 1.564s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:54:15 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-5ba332c9-132e-47c5-86b9-532f2c02201a tempest-TestServerVolumeAttachmentScenario-148945225 None] Created reservations ['a69b57d4-eb5b-42e6-9d7d-fc77adabfd91', '434797f9-a747-4e20-9d4b-321c886d98c7', 'a0302eff-0c45-44b1-a438-4c1f72dbed03', '7bdb131b-04cd-481c-bbcd-c35c5ee5dc42'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:54:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5ba332c9-132e-47c5-86b9-532f2c02201a tempest-TestServerVolumeAttachmentScenario-148945225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:54:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5ba332c9-132e-47c5-86b9-532f2c02201a tempest-TestServerVolumeAttachmentScenario-148945225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:54:15 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5ba332c9-132e-47c5-86b9-532f2c02201a tempest-TestServerVolumeAttachmentScenario-148945225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:54:15 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5ba332c9-132e-47c5-86b9-532f2c02201a tempest-TestServerVolumeAttachmentScenario-148945225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:54:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5ba332c9-132e-47c5-86b9-532f2c02201a tempest-TestServerVolumeAttachmentScenario-148945225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:54:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5ba332c9-132e-47c5-86b9-532f2c02201a tempest-TestServerVolumeAttachmentScenario-148945225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:15 devstack sudo[103691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:54:15 devstack sudo[103691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:15 devstack sudo[103691]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5ba332c9-132e-47c5-86b9-532f2c02201a tempest-TestServerVolumeAttachmentScenario-148945225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.736s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:15 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-5ba332c9-132e-47c5-86b9-532f2c02201a tempest-TestServerVolumeAttachmentScenario-148945225 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:54:15 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-5ba332c9-132e-47c5-86b9-532f2c02201a tempest-TestServerVolumeAttachmentScenario-148945225 None] Deleted volume successfully. Jul 08 01:54:15 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5ba332c9-132e-47c5-86b9-532f2c02201a tempest-TestServerVolumeAttachmentScenario-148945225 None] Lock "cinder-12f6ffa1-ab64-49c8-b4cc-ecf3e86bfe47-delete_volume" released by "delete_volume" :: held 2.548s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:54:25 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:UPDATE=14,cinder:SELECT=10,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:54:25 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=10,cinder:INSERT=5,cinder:UPDATE=18,cinder:DELETE=1 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:54:27 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dd78e4e-791e-4163-b2a8-79c5651afda4 tempest-VolumeDependencyTests-1168566191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:54:27 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3dd78e4e-791e-4163-b2a8-79c5651afda4 tempest-VolumeDependencyTests-1168566191 None] Flow 'volume_create_manager' (1f592b9e-d30c-46c3-808a-441e00d542c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:54:27 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3dd78e4e-791e-4163-b2a8-79c5651afda4 tempest-VolumeDependencyTests-1168566191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c72f2d9-170d-4836-8dd4-eb8221e0a718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:27 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3dd78e4e-791e-4163-b2a8-79c5651afda4 tempest-VolumeDependencyTests-1168566191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c72f2d9-170d-4836-8dd4-eb8221e0a718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-219974341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58de7b72-7efd-43ab-988b-cddd47678066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fab63b62e90f4c5ab92d5654b463866d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:54:28Z,use_quota=True,user_id='482be72f72e44e5f894fc1281dae6c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:27 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3dd78e4e-791e-4163-b2a8-79c5651afda4 tempest-VolumeDependencyTests-1168566191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (888b5b34-6cdc-4f61-847f-32da8bec9f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:27 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3dd78e4e-791e-4163-b2a8-79c5651afda4 tempest-VolumeDependencyTests-1168566191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (888b5b34-6cdc-4f61-847f-32da8bec9f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:27 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3dd78e4e-791e-4163-b2a8-79c5651afda4 tempest-VolumeDependencyTests-1168566191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8e5f4be-ce77-4d1d-9406-9a60cfbbb95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:27 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3dd78e4e-791e-4163-b2a8-79c5651afda4 tempest-VolumeDependencyTests-1168566191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8e5f4be-ce77-4d1d-9406-9a60cfbbb95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58de7b72-7efd-43ab-988b-cddd47678066', 'volume_name': 'volume-58de7b72-7efd-43ab-988b-cddd47678066', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:27 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3dd78e4e-791e-4163-b2a8-79c5651afda4 tempest-VolumeDependencyTests-1168566191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67772100-ba9e-420c-865b-78746071ec49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:27 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3dd78e4e-791e-4163-b2a8-79c5651afda4 tempest-VolumeDependencyTests-1168566191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67772100-ba9e-420c-865b-78746071ec49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:27 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3dd78e4e-791e-4163-b2a8-79c5651afda4 tempest-VolumeDependencyTests-1168566191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d893be-5256-4f51-bb3b-eb30c76c700d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:27 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-3dd78e4e-791e-4163-b2a8-79c5651afda4 tempest-VolumeDependencyTests-1168566191 None] Volume 58de7b72-7efd-43ab-988b-cddd47678066: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58de7b72-7efd-43ab-988b-cddd47678066', 'volume_size': 1} Jul 08 01:54:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3dd78e4e-791e-4163-b2a8-79c5651afda4 tempest-VolumeDependencyTests-1168566191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:54:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3dd78e4e-791e-4163-b2a8-79c5651afda4 tempest-VolumeDependencyTests-1168566191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:54:27 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3dd78e4e-791e-4163-b2a8-79c5651afda4 tempest-VolumeDependencyTests-1168566191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-219974341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58de7b72-7efd-43ab-988b-cddd47678066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fab63b62e90f4c5ab92d5654b463866d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:54:28Z,use_quota=True,user_id='482be72f72e44e5f894fc1281dae6c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:54:27 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-3dd78e4e-791e-4163-b2a8-79c5651afda4 tempest-VolumeDependencyTests-1168566191 None] Creating volume 58de7b72-7efd-43ab-988b-cddd47678066 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:54:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3dd78e4e-791e-4163-b2a8-79c5651afda4 tempest-VolumeDependencyTests-1168566191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:54:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3dd78e4e-791e-4163-b2a8-79c5651afda4 tempest-VolumeDependencyTests-1168566191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:54:27 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3dd78e4e-791e-4163-b2a8-79c5651afda4 tempest-VolumeDependencyTests-1168566191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:54:27 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3dd78e4e-791e-4163-b2a8-79c5651afda4 tempest-VolumeDependencyTests-1168566191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:54:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3dd78e4e-791e-4163-b2a8-79c5651afda4 tempest-VolumeDependencyTests-1168566191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:54:27 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3dd78e4e-791e-4163-b2a8-79c5651afda4 tempest-VolumeDependencyTests-1168566191 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:54:27 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-3dd78e4e-791e-4163-b2a8-79c5651afda4 tempest-VolumeDependencyTests-1168566191 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:54:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3dd78e4e-791e-4163-b2a8-79c5651afda4 tempest-VolumeDependencyTests-1168566191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:27 devstack sudo[103707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066 1073741824 Jul 08 01:54:27 devstack sudo[103707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:28 devstack sudo[103707]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3dd78e4e-791e-4163-b2a8-79c5651afda4 tempest-VolumeDependencyTests-1168566191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066 1073741824" returned: 0 in 0.991s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3dd78e4e-791e-4163-b2a8-79c5651afda4 tempest-VolumeDependencyTests-1168566191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:28 devstack sudo[103713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066 Jul 08 01:54:28 devstack sudo[103713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:29 devstack sudo[103713]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3dd78e4e-791e-4163-b2a8-79c5651afda4 tempest-VolumeDependencyTests-1168566191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066" returned: 0 in 0.716s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:29 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3dd78e4e-791e-4163-b2a8-79c5651afda4 tempest-VolumeDependencyTests-1168566191 None] <== create_volume: return (1757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:54:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3dd78e4e-791e-4163-b2a8-79c5651afda4 tempest-VolumeDependencyTests-1168566191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.760s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:54:29 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3dd78e4e-791e-4163-b2a8-79c5651afda4 tempest-VolumeDependencyTests-1168566191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d893be-5256-4f51-bb3b-eb30c76c700d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58de7b72-7efd-43ab-988b-cddd47678066', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:29 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3dd78e4e-791e-4163-b2a8-79c5651afda4 tempest-VolumeDependencyTests-1168566191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d469e7d-a4da-41cf-a7ab-1b9294e8632e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:29 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-3dd78e4e-791e-4163-b2a8-79c5651afda4 tempest-VolumeDependencyTests-1168566191 None] Volume volume-58de7b72-7efd-43ab-988b-cddd47678066 (58de7b72-7efd-43ab-988b-cddd47678066): created successfully Jul 08 01:54:29 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3dd78e4e-791e-4163-b2a8-79c5651afda4 tempest-VolumeDependencyTests-1168566191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d469e7d-a4da-41cf-a7ab-1b9294e8632e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:29 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3dd78e4e-791e-4163-b2a8-79c5651afda4 tempest-VolumeDependencyTests-1168566191 None] Flow 'volume_create_manager' (1f592b9e-d30c-46c3-808a-441e00d542c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:54:29 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-3dd78e4e-791e-4163-b2a8-79c5651afda4 tempest-VolumeDependencyTests-1168566191 None] Created volume successfully. Jul 08 01:54:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-d71fa6f9-3c75-4d10-acfc-ea76ac06e18b tempest-VolumeDependencyTests-1168566191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:54:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-d71fa6f9-3c75-4d10-acfc-ea76ac06e18b tempest-VolumeDependencyTests-1168566191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:54:30 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-d71fa6f9-3c75-4d10-acfc-ea76ac06e18b tempest-VolumeDependencyTests-1168566191 None] Creating offline snapshot e6ac7844-f37b-49ef-a365-66faf5004987 of volume 58de7b72-7efd-43ab-988b-cddd47678066 {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:54:30 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[1311b29d-fa16-419c-8289-2bc4b35cb147]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:54:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d71fa6f9-3c75-4d10-acfc-ea76ac06e18b tempest-VolumeDependencyTests-1168566191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:30 devstack sudo[103716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066 Jul 08 01:54:30 devstack sudo[103716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:31 devstack sudo[103716]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d71fa6f9-3c75-4d10-acfc-ea76ac06e18b tempest-VolumeDependencyTests-1168566191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066" returned: 0 in 0.898s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d71fa6f9-3c75-4d10-acfc-ea76ac06e18b tempest-VolumeDependencyTests-1168566191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066.e6ac7844-f37b-49ef-a365-66faf5004987 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:31 devstack sudo[103721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066.e6ac7844-f37b-49ef-a365-66faf5004987 1G Jul 08 01:54:31 devstack sudo[103721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:32 devstack sudo[103721]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d71fa6f9-3c75-4d10-acfc-ea76ac06e18b tempest-VolumeDependencyTests-1168566191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066.e6ac7844-f37b-49ef-a365-66faf5004987 1G" returned: 0 in 0.944s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d71fa6f9-3c75-4d10-acfc-ea76ac06e18b tempest-VolumeDependencyTests-1168566191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58de7b72-7efd-43ab-988b-cddd47678066 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066.e6ac7844-f37b-49ef-a365-66faf5004987 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:32 devstack sudo[103727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58de7b72-7efd-43ab-988b-cddd47678066 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066.e6ac7844-f37b-49ef-a365-66faf5004987 Jul 08 01:54:32 devstack sudo[103727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:32 devstack sudo[103727]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d71fa6f9-3c75-4d10-acfc-ea76ac06e18b tempest-VolumeDependencyTests-1168566191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58de7b72-7efd-43ab-988b-cddd47678066 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066.e6ac7844-f37b-49ef-a365-66faf5004987" returned: 0 in 0.800s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:32 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-d71fa6f9-3c75-4d10-acfc-ea76ac06e18b tempest-VolumeDependencyTests-1168566191 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066.e6ac7844-f37b-49ef-a365-66faf5004987 is being set with open permissions: ugo+rw Jul 08 01:54:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d71fa6f9-3c75-4d10-acfc-ea76ac06e18b tempest-VolumeDependencyTests-1168566191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066.e6ac7844-f37b-49ef-a365-66faf5004987 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:32 devstack sudo[103732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066.e6ac7844-f37b-49ef-a365-66faf5004987 Jul 08 01:54:32 devstack sudo[103732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:33 devstack sudo[103732]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d71fa6f9-3c75-4d10-acfc-ea76ac06e18b tempest-VolumeDependencyTests-1168566191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066.e6ac7844-f37b-49ef-a365-66faf5004987" returned: 0 in 0.802s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d71fa6f9-3c75-4d10-acfc-ea76ac06e18b tempest-VolumeDependencyTests-1168566191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:33 devstack sudo[103735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066.info Jul 08 01:54:33 devstack sudo[103735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:34 devstack sudo[103735]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d71fa6f9-3c75-4d10-acfc-ea76ac06e18b tempest-VolumeDependencyTests-1168566191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066.info" returned: 0 in 0.789s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:34 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-d71fa6f9-3c75-4d10-acfc-ea76ac06e18b tempest-VolumeDependencyTests-1168566191 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066.info is being set with open permissions: ugo+rw Jul 08 01:54:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d71fa6f9-3c75-4d10-acfc-ea76ac06e18b tempest-VolumeDependencyTests-1168566191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:34 devstack sudo[103738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066.info Jul 08 01:54:34 devstack sudo[103738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:35 devstack sudo[103738]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d71fa6f9-3c75-4d10-acfc-ea76ac06e18b tempest-VolumeDependencyTests-1168566191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066.info" returned: 0 in 0.686s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-d71fa6f9-3c75-4d10-acfc-ea76ac06e18b tempest-VolumeDependencyTests-1168566191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.044s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:54:35 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-d71fa6f9-3c75-4d10-acfc-ea76ac06e18b tempest-VolumeDependencyTests-1168566191 None] Create snapshot completed successfully Jul 08 01:54:35 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:54:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Flow 'volume_create_manager' (098c9352-a3d6-4c4e-90ed-f0e38b8171a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:54:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fed7be5-fa6b-4021-ba64-1f5a7f352888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fed7be5-fa6b-4021-ba64-1f5a7f352888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-683856112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9101344-9ebe-4496-9bf5-fc4d0d0f7183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fab63b62e90f4c5ab92d5654b463866d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e6ac7844-f37b-49ef-a365-66faf5004987,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:54:36Z,use_quota=True,user_id='482be72f72e44e5f894fc1281dae6c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f065dc39-89ad-47ad-a725-b5e598864999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f065dc39-89ad-47ad-a725-b5e598864999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d18392a6-a15a-4c5d-aaae-2cb4d4dc9c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d18392a6-a15a-4c5d-aaae-2cb4d4dc9c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a9101344-9ebe-4496-9bf5-fc4d0d0f7183', 'volume_name': 'volume-a9101344-9ebe-4496-9bf5-fc4d0d0f7183', 'volume_size': 1, 'snapshot_id': 'e6ac7844-f37b-49ef-a365-66faf5004987'}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b54df070-bf56-45b9-975c-6433f9bdf6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b54df070-bf56-45b9-975c-6433f9bdf6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f58df03e-6d1e-4de0-955a-efd6159676cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:36 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Volume a9101344-9ebe-4496-9bf5-fc4d0d0f7183: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a9101344-9ebe-4496-9bf5-fc4d0d0f7183', 'volume_size': 1, 'snapshot_id': 'e6ac7844-f37b-49ef-a365-66faf5004987'} Jul 08 01:54:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:54:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:54:36 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Acquiring lock "cinder-quobyte-e6ac7844-f37b-49ef-a365-66faf5004987-a9101344-9ebe-4496-9bf5-fc4d0d0f7183" by "_create_volume_from_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:54:36 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Lock "cinder-quobyte-e6ac7844-f37b-49ef-a365-66faf5004987-a9101344-9ebe-4496-9bf5-fc4d0d0f7183" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:54:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Creating volume a9101344-9ebe-4496-9bf5-fc4d0d0f7183 from snapshot e6ac7844-f37b-49ef-a365-66faf5004987 {{(pid=87284) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 01:54:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:54:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:54:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:54:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:54:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:54:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:54:36 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Acquiring lock "cinder-quobyte-a9101344-9ebe-4496-9bf5-fc4d0d0f7183" by "_copy_volume_from_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:54:36 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Lock "cinder-quobyte-a9101344-9ebe-4496-9bf5-fc4d0d0f7183" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:54:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] snapshot: e6ac7844-f37b-49ef-a365-66faf5004987, volume: a9101344-9ebe-4496-9bf5-fc4d0d0f7183, {{(pid=87284) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:54:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:54:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:54:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:54:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:54:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:54:36 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[63906c39-d456-4b76-9500-b38fc07bbad9]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:54:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066.e6ac7844-f37b-49ef-a365-66faf5004987 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:36 devstack sudo[103742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066.e6ac7844-f37b-49ef-a365-66faf5004987 Jul 08 01:54:36 devstack sudo[103742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:37 devstack sudo[103742]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066.e6ac7844-f37b-49ef-a365-66faf5004987" returned: 0 in 0.894s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:37 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58de7b72-7efd-43ab-988b-cddd47678066(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:54:37 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066 {{(pid=87284) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:54:37 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Creating direct copy from snapshot {{(pid=87284) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:54:37 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a253ebc-f4c8-4ffd-aeba-bc861d13fc8c]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:54:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:37 devstack sudo[103747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066 Jul 08 01:54:37 devstack sudo[103747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:37 devstack sudo[103747]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066" returned: 0 in 0.867s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:38 devstack cinder-volume[87284]: DEBUG cinder.utils [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Path /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9101344-9ebe-4496-9bf5-fc4d0d0f7183 not found in is_blk_device check {{(pid=87284) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:54:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9101344-9ebe-4496-9bf5-fc4d0d0f7183 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:38 devstack sudo[103752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9101344-9ebe-4496-9bf5-fc4d0d0f7183 Jul 08 01:54:38 devstack sudo[103752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:43 devstack sudo[103752]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9101344-9ebe-4496-9bf5-fc4d0d0f7183" returned: 0 in 5.259s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:43 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[699d4c12-0935-49b1-84bb-7eff96d89e1e]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:54:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:43 devstack sudo[103801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066 Jul 08 01:54:43 devstack sudo[103801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:44 devstack sudo[103801]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066" returned: 0 in 1.025s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:44 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Image conversion details: src /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066, size 1024.00 MB, duration 5.26 sec, destination /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9101344-9ebe-4496-9bf5-fc4d0d0f7183 {{(pid=87284) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:54:44 devstack cinder-volume[87284]: INFO cinder.image.image_utils [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Converted 1024.00 MB image at 194.65 MB/s Jul 08 01:54:44 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9101344-9ebe-4496-9bf5-fc4d0d0f7183 is being set with open permissions: ugo+rw Jul 08 01:54:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9101344-9ebe-4496-9bf5-fc4d0d0f7183 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:44 devstack sudo[103806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9101344-9ebe-4496-9bf5-fc4d0d0f7183 Jul 08 01:54:44 devstack sudo[103806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:45 devstack sudo[103806]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9101344-9ebe-4496-9bf5-fc4d0d0f7183" returned: 0 in 0.756s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:45 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Lock "cinder-quobyte-a9101344-9ebe-4496-9bf5-fc4d0d0f7183" released by "_copy_volume_from_snapshot" :: held 8.914s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:54:45 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Lock "cinder-quobyte-e6ac7844-f37b-49ef-a365-66faf5004987-a9101344-9ebe-4496-9bf5-fc4d0d0f7183" released by "_create_volume_from_snapshot" :: held 8.949s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:54:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.969s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:54:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f58df03e-6d1e-4de0-955a-efd6159676cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9101344-9ebe-4496-9bf5-fc4d0d0f7183', 'volume_size': 1, 'snapshot_id': 'e6ac7844-f37b-49ef-a365-66faf5004987'}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (062ae3ae-bc84-4399-ae14-3981a81a03f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:45 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Volume volume-a9101344-9ebe-4496-9bf5-fc4d0d0f7183 (a9101344-9ebe-4496-9bf5-fc4d0d0f7183): created successfully Jul 08 01:54:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (062ae3ae-bc84-4399-ae14-3981a81a03f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Flow 'volume_create_manager' (098c9352-a3d6-4c4e-90ed-f0e38b8171a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:54:45 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-07b9d37f-ca3a-4fa0-83e7-fbf9ce542760 tempest-VolumeDependencyTests-1168566191 None] Created volume successfully. Jul 08 01:54:46 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e7fd4740-37e1-49a0-9d50-b72c9c69cc52 tempest-VolumeDependencyTests-1168566191 None] Acquiring lock "cinder-e6ac7844-f37b-49ef-a365-66faf5004987-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:54:46 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e7fd4740-37e1-49a0-9d50-b72c9c69cc52 tempest-VolumeDependencyTests-1168566191 None] Lock "cinder-e6ac7844-f37b-49ef-a365-66faf5004987-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:54:46 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e7fd4740-37e1-49a0-9d50-b72c9c69cc52 tempest-VolumeDependencyTests-1168566191 None] Acquiring lock "cinder-quobyte-58de7b72-7efd-43ab-988b-cddd47678066" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:54:46 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e7fd4740-37e1-49a0-9d50-b72c9c69cc52 tempest-VolumeDependencyTests-1168566191 None] Lock "cinder-quobyte-58de7b72-7efd-43ab-988b-cddd47678066" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:54:46 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e7fd4740-37e1-49a0-9d50-b72c9c69cc52 tempest-VolumeDependencyTests-1168566191 None] Acquiring lock "cinder-quobyte-e6ac7844-f37b-49ef-a365-66faf5004987" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:54:46 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e7fd4740-37e1-49a0-9d50-b72c9c69cc52 tempest-VolumeDependencyTests-1168566191 None] Lock "cinder-quobyte-e6ac7844-f37b-49ef-a365-66faf5004987" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:54:46 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-e7fd4740-37e1-49a0-9d50-b72c9c69cc52 tempest-VolumeDependencyTests-1168566191 None] Deleting offline snapshot e6ac7844-f37b-49ef-a365-66faf5004987 of volume 58de7b72-7efd-43ab-988b-cddd47678066 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:54:46 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-e7fd4740-37e1-49a0-9d50-b72c9c69cc52 tempest-VolumeDependencyTests-1168566191 None] snapshot_file for this snap is: volume-58de7b72-7efd-43ab-988b-cddd47678066.e6ac7844-f37b-49ef-a365-66faf5004987 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:54:46 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91daf48-b89f-4276-83ef-735aa125fd07]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:54:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e7fd4740-37e1-49a0-9d50-b72c9c69cc52 tempest-VolumeDependencyTests-1168566191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066.e6ac7844-f37b-49ef-a365-66faf5004987 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:46 devstack sudo[103810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066.e6ac7844-f37b-49ef-a365-66faf5004987 Jul 08 01:54:46 devstack sudo[103810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:46 devstack sudo[103810]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e7fd4740-37e1-49a0-9d50-b72c9c69cc52 tempest-VolumeDependencyTests-1168566191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066.e6ac7844-f37b-49ef-a365-66faf5004987" returned: 0 in 0.831s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:46 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-e7fd4740-37e1-49a0-9d50-b72c9c69cc52 tempest-VolumeDependencyTests-1168566191 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58de7b72-7efd-43ab-988b-cddd47678066(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:54:47 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[00656654-eaab-4c43-bd84-fb99cd936000]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:54:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e7fd4740-37e1-49a0-9d50-b72c9c69cc52 tempest-VolumeDependencyTests-1168566191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:47 devstack sudo[103815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066 Jul 08 01:54:47 devstack sudo[103815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:47 devstack sudo[103815]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e7fd4740-37e1-49a0-9d50-b72c9c69cc52 tempest-VolumeDependencyTests-1168566191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066" returned: 0 in 0.872s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e7fd4740-37e1-49a0-9d50-b72c9c69cc52 tempest-VolumeDependencyTests-1168566191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066.e6ac7844-f37b-49ef-a365-66faf5004987 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:47 devstack sudo[103820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066.e6ac7844-f37b-49ef-a365-66faf5004987 Jul 08 01:54:47 devstack sudo[103820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:48 devstack sudo[103820]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e7fd4740-37e1-49a0-9d50-b72c9c69cc52 tempest-VolumeDependencyTests-1168566191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066.e6ac7844-f37b-49ef-a365-66faf5004987" returned: 0 in 0.786s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e7fd4740-37e1-49a0-9d50-b72c9c69cc52 tempest-VolumeDependencyTests-1168566191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066.e6ac7844-f37b-49ef-a365-66faf5004987 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:48 devstack sudo[103826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066.e6ac7844-f37b-49ef-a365-66faf5004987 Jul 08 01:54:48 devstack sudo[103826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:49 devstack sudo[103826]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e7fd4740-37e1-49a0-9d50-b72c9c69cc52 tempest-VolumeDependencyTests-1168566191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066.e6ac7844-f37b-49ef-a365-66faf5004987" returned: 0 in 0.726s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:49 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e7fd4740-37e1-49a0-9d50-b72c9c69cc52 tempest-VolumeDependencyTests-1168566191 None] Lock "cinder-quobyte-e6ac7844-f37b-49ef-a365-66faf5004987" released by "_delete_snapshot" :: held 3.324s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:54:49 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e7fd4740-37e1-49a0-9d50-b72c9c69cc52 tempest-VolumeDependencyTests-1168566191 None] Lock "cinder-quobyte-58de7b72-7efd-43ab-988b-cddd47678066" released by "delete_snapshot" :: held 3.352s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:54:49 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-e7fd4740-37e1-49a0-9d50-b72c9c69cc52 tempest-VolumeDependencyTests-1168566191 None] Created reservations ['5bac3c71-e488-4c93-8b70-6d0ec93cc729', 'a83f13b4-4f69-493f-8744-02c8a41485e2', '3b79f852-ff94-4245-8199-8b42a1e1b615', '38828a91-27e7-4c6e-8cc6-271156f3b121'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:54:49 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-e7fd4740-37e1-49a0-9d50-b72c9c69cc52 tempest-VolumeDependencyTests-1168566191 None] Delete snapshot completed successfully. Jul 08 01:54:49 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e7fd4740-37e1-49a0-9d50-b72c9c69cc52 tempest-VolumeDependencyTests-1168566191 None] Lock "cinder-e6ac7844-f37b-49ef-a365-66faf5004987-delete_snapshot" released by "delete_snapshot" :: held 3.510s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:54:50 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-4ad613d5-0332-42e3-bc88-9d452f4b5d91 tempest-VolumeDependencyTests-1168566191 None] Acquiring lock "cinder-58de7b72-7efd-43ab-988b-cddd47678066-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:54:50 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-4ad613d5-0332-42e3-bc88-9d452f4b5d91 tempest-VolumeDependencyTests-1168566191 None] Lock "cinder-58de7b72-7efd-43ab-988b-cddd47678066-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:54:50 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-4ad613d5-0332-42e3-bc88-9d452f4b5d91 tempest-VolumeDependencyTests-1168566191 None] Acquiring lock "cinder-quobyte-58de7b72-7efd-43ab-988b-cddd47678066" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:54:50 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-4ad613d5-0332-42e3-bc88-9d452f4b5d91 tempest-VolumeDependencyTests-1168566191 None] Lock "cinder-quobyte-58de7b72-7efd-43ab-988b-cddd47678066" acquired by "delete_volume" :: waited 0.016s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:54:50 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3340d6-feef-4d7b-9a7f-a569e378b9f5]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:54:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4ad613d5-0332-42e3-bc88-9d452f4b5d91 tempest-VolumeDependencyTests-1168566191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:50 devstack sudo[103829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066 Jul 08 01:54:50 devstack sudo[103829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:51 devstack sudo[103829]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4ad613d5-0332-42e3-bc88-9d452f4b5d91 tempest-VolumeDependencyTests-1168566191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066" returned: 0 in 0.802s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4ad613d5-0332-42e3-bc88-9d452f4b5d91 tempest-VolumeDependencyTests-1168566191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:51 devstack sudo[103834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066 Jul 08 01:54:51 devstack sudo[103834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:51 devstack sudo[103834]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4ad613d5-0332-42e3-bc88-9d452f4b5d91 tempest-VolumeDependencyTests-1168566191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-58de7b72-7efd-43ab-988b-cddd47678066" returned: 0 in 0.753s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:51 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-4ad613d5-0332-42e3-bc88-9d452f4b5d91 tempest-VolumeDependencyTests-1168566191 None] Lock "cinder-quobyte-58de7b72-7efd-43ab-988b-cddd47678066" released by "delete_volume" :: held 1.617s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:54:52 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-4ad613d5-0332-42e3-bc88-9d452f4b5d91 tempest-VolumeDependencyTests-1168566191 None] Created reservations ['59fcfffc-6650-47df-a85e-43474d3e7af5', '1b5c7ea6-2dba-466c-be59-3a9e030e534d', '126e91b8-e8cf-40ec-b9cd-7d15767b7ca0', '1de2d4b1-a69c-4994-9c27-532a2fe003cf'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:54:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4ad613d5-0332-42e3-bc88-9d452f4b5d91 tempest-VolumeDependencyTests-1168566191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:54:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4ad613d5-0332-42e3-bc88-9d452f4b5d91 tempest-VolumeDependencyTests-1168566191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:54:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-4ad613d5-0332-42e3-bc88-9d452f4b5d91 tempest-VolumeDependencyTests-1168566191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:54:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-4ad613d5-0332-42e3-bc88-9d452f4b5d91 tempest-VolumeDependencyTests-1168566191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:54:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4ad613d5-0332-42e3-bc88-9d452f4b5d91 tempest-VolumeDependencyTests-1168566191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:54:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4ad613d5-0332-42e3-bc88-9d452f4b5d91 tempest-VolumeDependencyTests-1168566191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:52 devstack sudo[103837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:54:52 devstack sudo[103837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:52 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e529e70a-a16a-4c14-b0f7-5e03d185eab9 tempest-VolumeDependencyTests-1168566191 None] Acquiring lock "cinder-a9101344-9ebe-4496-9bf5-fc4d0d0f7183-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:54:52 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e529e70a-a16a-4c14-b0f7-5e03d185eab9 tempest-VolumeDependencyTests-1168566191 None] Lock "cinder-a9101344-9ebe-4496-9bf5-fc4d0d0f7183-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:54:52 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e529e70a-a16a-4c14-b0f7-5e03d185eab9 tempest-VolumeDependencyTests-1168566191 None] Acquiring lock "cinder-quobyte-a9101344-9ebe-4496-9bf5-fc4d0d0f7183" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:54:52 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e529e70a-a16a-4c14-b0f7-5e03d185eab9 tempest-VolumeDependencyTests-1168566191 None] Lock "cinder-quobyte-a9101344-9ebe-4496-9bf5-fc4d0d0f7183" acquired by "delete_volume" :: waited 0.021s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:54:52 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8026682-37bc-47d6-bbb7-498fe0a2d750]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:54:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e529e70a-a16a-4c14-b0f7-5e03d185eab9 tempest-VolumeDependencyTests-1168566191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9101344-9ebe-4496-9bf5-fc4d0d0f7183 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:52 devstack sudo[103839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9101344-9ebe-4496-9bf5-fc4d0d0f7183 Jul 08 01:54:52 devstack sudo[103839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:52 devstack sudo[103837]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4ad613d5-0332-42e3-bc88-9d452f4b5d91 tempest-VolumeDependencyTests-1168566191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.739s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:52 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-4ad613d5-0332-42e3-bc88-9d452f4b5d91 tempest-VolumeDependencyTests-1168566191 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:54:52 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-4ad613d5-0332-42e3-bc88-9d452f4b5d91 tempest-VolumeDependencyTests-1168566191 None] Deleted volume successfully. Jul 08 01:54:52 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-4ad613d5-0332-42e3-bc88-9d452f4b5d91 tempest-VolumeDependencyTests-1168566191 None] Lock "cinder-58de7b72-7efd-43ab-988b-cddd47678066-delete_volume" released by "delete_volume" :: held 2.583s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:54:53 devstack sudo[103839]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e529e70a-a16a-4c14-b0f7-5e03d185eab9 tempest-VolumeDependencyTests-1168566191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9101344-9ebe-4496-9bf5-fc4d0d0f7183" returned: 0 in 0.786s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e529e70a-a16a-4c14-b0f7-5e03d185eab9 tempest-VolumeDependencyTests-1168566191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9101344-9ebe-4496-9bf5-fc4d0d0f7183 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:53 devstack sudo[103845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9101344-9ebe-4496-9bf5-fc4d0d0f7183 Jul 08 01:54:53 devstack sudo[103845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:54 devstack sudo[103845]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e529e70a-a16a-4c14-b0f7-5e03d185eab9 tempest-VolumeDependencyTests-1168566191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a9101344-9ebe-4496-9bf5-fc4d0d0f7183" returned: 0 in 0.715s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:54 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e529e70a-a16a-4c14-b0f7-5e03d185eab9 tempest-VolumeDependencyTests-1168566191 None] Lock "cinder-quobyte-a9101344-9ebe-4496-9bf5-fc4d0d0f7183" released by "delete_volume" :: held 1.549s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:54:54 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-e529e70a-a16a-4c14-b0f7-5e03d185eab9 tempest-VolumeDependencyTests-1168566191 None] Created reservations ['aa83f9a9-88da-4b3e-b942-74c57b79d28c', '4668872b-62dc-45e4-afa7-6fe6df224fe2', '3f2ba635-c5d8-4f22-8646-bec5648b7571', '5f2886a1-b578-43f0-9261-ad96821158b4'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:54:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e529e70a-a16a-4c14-b0f7-5e03d185eab9 tempest-VolumeDependencyTests-1168566191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:54:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e529e70a-a16a-4c14-b0f7-5e03d185eab9 tempest-VolumeDependencyTests-1168566191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:54:54 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e529e70a-a16a-4c14-b0f7-5e03d185eab9 tempest-VolumeDependencyTests-1168566191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:54:54 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e529e70a-a16a-4c14-b0f7-5e03d185eab9 tempest-VolumeDependencyTests-1168566191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:54:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e529e70a-a16a-4c14-b0f7-5e03d185eab9 tempest-VolumeDependencyTests-1168566191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:54:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e529e70a-a16a-4c14-b0f7-5e03d185eab9 tempest-VolumeDependencyTests-1168566191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:54 devstack sudo[103848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:54:54 devstack sudo[103848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:55 devstack sudo[103848]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e529e70a-a16a-4c14-b0f7-5e03d185eab9 tempest-VolumeDependencyTests-1168566191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.697s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:55 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-e529e70a-a16a-4c14-b0f7-5e03d185eab9 tempest-VolumeDependencyTests-1168566191 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:54:55 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-e529e70a-a16a-4c14-b0f7-5e03d185eab9 tempest-VolumeDependencyTests-1168566191 None] Deleted volume successfully. Jul 08 01:54:55 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e529e70a-a16a-4c14-b0f7-5e03d185eab9 tempest-VolumeDependencyTests-1168566191 None] Lock "cinder-a9101344-9ebe-4496-9bf5-fc4d0d0f7183-delete_volume" released by "delete_volume" :: held 2.476s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:54:55 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:54:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:54:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:54:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:54:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:54:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:54:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:55 devstack sudo[103853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:54:55 devstack sudo[103853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:55 devstack sudo[103853]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.796s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:55 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:54:55 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager._thread_info {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:54:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread count: 29 {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:54:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread info: [<_MainThread(MainThread, started 127058402500736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:54:58 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-a15cf7d4-fc0a-473f-9c97-6619aa4f67ec tempest-ProjectReaderTests-187264621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:54:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a15cf7d4-fc0a-473f-9c97-6619aa4f67ec tempest-ProjectReaderTests-187264621 None] Flow 'volume_create_manager' (b60b2ac2-2343-4f8f-9a95-cb16e0562c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:54:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a15cf7d4-fc0a-473f-9c97-6619aa4f67ec tempest-ProjectReaderTests-187264621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0219a72c-db7d-451d-9d30-5b48e5e3a540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a15cf7d4-fc0a-473f-9c97-6619aa4f67ec tempest-ProjectReaderTests-187264621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0219a72c-db7d-451d-9d30-5b48e5e3a540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1503935621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23fd0372-9e8f-45b1-b011-b69fb867c36b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b881eec858bc456882a68219919e6cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:54:59Z,use_quota=True,user_id='96f3ca0cf4cb4b4e8a01c93f962cd30e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a15cf7d4-fc0a-473f-9c97-6619aa4f67ec tempest-ProjectReaderTests-187264621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fcf3afc-33d4-40eb-bc43-99c5d13d262d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a15cf7d4-fc0a-473f-9c97-6619aa4f67ec tempest-ProjectReaderTests-187264621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fcf3afc-33d4-40eb-bc43-99c5d13d262d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a15cf7d4-fc0a-473f-9c97-6619aa4f67ec tempest-ProjectReaderTests-187264621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39d7f795-1a5d-4c2f-a73b-48b4dae1ab3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a15cf7d4-fc0a-473f-9c97-6619aa4f67ec tempest-ProjectReaderTests-187264621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39d7f795-1a5d-4c2f-a73b-48b4dae1ab3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23fd0372-9e8f-45b1-b011-b69fb867c36b', 'volume_name': 'volume-23fd0372-9e8f-45b1-b011-b69fb867c36b', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a15cf7d4-fc0a-473f-9c97-6619aa4f67ec tempest-ProjectReaderTests-187264621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (560fc82f-18e3-45ef-8fd2-6fad889546fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a15cf7d4-fc0a-473f-9c97-6619aa4f67ec tempest-ProjectReaderTests-187264621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (560fc82f-18e3-45ef-8fd2-6fad889546fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a15cf7d4-fc0a-473f-9c97-6619aa4f67ec tempest-ProjectReaderTests-187264621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fbcb284-bd75-4eb0-b305-f4ddea260a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:59 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-a15cf7d4-fc0a-473f-9c97-6619aa4f67ec tempest-ProjectReaderTests-187264621 None] Volume 23fd0372-9e8f-45b1-b011-b69fb867c36b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23fd0372-9e8f-45b1-b011-b69fb867c36b', 'volume_size': 1} Jul 08 01:54:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a15cf7d4-fc0a-473f-9c97-6619aa4f67ec tempest-ProjectReaderTests-187264621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:54:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a15cf7d4-fc0a-473f-9c97-6619aa4f67ec tempest-ProjectReaderTests-187264621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:54:59 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a15cf7d4-fc0a-473f-9c97-6619aa4f67ec tempest-ProjectReaderTests-187264621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1503935621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23fd0372-9e8f-45b1-b011-b69fb867c36b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b881eec858bc456882a68219919e6cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:54:59Z,use_quota=True,user_id='96f3ca0cf4cb4b4e8a01c93f962cd30e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:54:59 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-a15cf7d4-fc0a-473f-9c97-6619aa4f67ec tempest-ProjectReaderTests-187264621 None] Creating volume 23fd0372-9e8f-45b1-b011-b69fb867c36b {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:54:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a15cf7d4-fc0a-473f-9c97-6619aa4f67ec tempest-ProjectReaderTests-187264621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:54:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a15cf7d4-fc0a-473f-9c97-6619aa4f67ec tempest-ProjectReaderTests-187264621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:54:59 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a15cf7d4-fc0a-473f-9c97-6619aa4f67ec tempest-ProjectReaderTests-187264621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:54:59 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a15cf7d4-fc0a-473f-9c97-6619aa4f67ec tempest-ProjectReaderTests-187264621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:54:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a15cf7d4-fc0a-473f-9c97-6619aa4f67ec tempest-ProjectReaderTests-187264621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:54:59 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a15cf7d4-fc0a-473f-9c97-6619aa4f67ec tempest-ProjectReaderTests-187264621 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:54:59 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-a15cf7d4-fc0a-473f-9c97-6619aa4f67ec tempest-ProjectReaderTests-187264621 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:54:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a15cf7d4-fc0a-473f-9c97-6619aa4f67ec tempest-ProjectReaderTests-187264621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-23fd0372-9e8f-45b1-b011-b69fb867c36b 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:59 devstack sudo[103860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-23fd0372-9e8f-45b1-b011-b69fb867c36b 1073741824 Jul 08 01:54:59 devstack sudo[103860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:59 devstack sudo[103860]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a15cf7d4-fc0a-473f-9c97-6619aa4f67ec tempest-ProjectReaderTests-187264621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-23fd0372-9e8f-45b1-b011-b69fb867c36b 1073741824" returned: 0 in 0.829s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a15cf7d4-fc0a-473f-9c97-6619aa4f67ec tempest-ProjectReaderTests-187264621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-23fd0372-9e8f-45b1-b011-b69fb867c36b {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:59 devstack sudo[103865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-23fd0372-9e8f-45b1-b011-b69fb867c36b Jul 08 01:54:59 devstack sudo[103865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:00 devstack sudo[103865]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a15cf7d4-fc0a-473f-9c97-6619aa4f67ec tempest-ProjectReaderTests-187264621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-23fd0372-9e8f-45b1-b011-b69fb867c36b" returned: 0 in 0.651s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a15cf7d4-fc0a-473f-9c97-6619aa4f67ec tempest-ProjectReaderTests-187264621 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:55:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a15cf7d4-fc0a-473f-9c97-6619aa4f67ec tempest-ProjectReaderTests-187264621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a15cf7d4-fc0a-473f-9c97-6619aa4f67ec tempest-ProjectReaderTests-187264621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fbcb284-bd75-4eb0-b305-f4ddea260a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23fd0372-9e8f-45b1-b011-b69fb867c36b', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a15cf7d4-fc0a-473f-9c97-6619aa4f67ec tempest-ProjectReaderTests-187264621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23f193f2-c31b-44ed-b2c9-14ac4f7088d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:00 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-a15cf7d4-fc0a-473f-9c97-6619aa4f67ec tempest-ProjectReaderTests-187264621 None] Volume volume-23fd0372-9e8f-45b1-b011-b69fb867c36b (23fd0372-9e8f-45b1-b011-b69fb867c36b): created successfully Jul 08 01:55:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a15cf7d4-fc0a-473f-9c97-6619aa4f67ec tempest-ProjectReaderTests-187264621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23f193f2-c31b-44ed-b2c9-14ac4f7088d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a15cf7d4-fc0a-473f-9c97-6619aa4f67ec tempest-ProjectReaderTests-187264621 None] Flow 'volume_create_manager' (b60b2ac2-2343-4f8f-9a95-cb16e0562c91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:55:00 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-a15cf7d4-fc0a-473f-9c97-6619aa4f67ec tempest-ProjectReaderTests-187264621 None] Created volume successfully. Jul 08 01:55:01 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-64651f09-3554-486d-9760-bfcb754439a0 tempest-ProjectReaderTests-187264621 None] Acquiring lock "cinder-23fd0372-9e8f-45b1-b011-b69fb867c36b-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:55:01 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-64651f09-3554-486d-9760-bfcb754439a0 tempest-ProjectReaderTests-187264621 None] Lock "cinder-23fd0372-9e8f-45b1-b011-b69fb867c36b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:55:01 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-64651f09-3554-486d-9760-bfcb754439a0 tempest-ProjectReaderTests-187264621 None] Acquiring lock "cinder-quobyte-23fd0372-9e8f-45b1-b011-b69fb867c36b" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:55:01 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-64651f09-3554-486d-9760-bfcb754439a0 tempest-ProjectReaderTests-187264621 None] Lock "cinder-quobyte-23fd0372-9e8f-45b1-b011-b69fb867c36b" acquired by "delete_volume" :: waited 0.021s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:55:01 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[67380661-944c-4736-ac85-a5e0725284fc]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:55:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-64651f09-3554-486d-9760-bfcb754439a0 tempest-ProjectReaderTests-187264621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-23fd0372-9e8f-45b1-b011-b69fb867c36b {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:01 devstack sudo[103868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-23fd0372-9e8f-45b1-b011-b69fb867c36b Jul 08 01:55:01 devstack sudo[103868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:02 devstack sudo[103868]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-64651f09-3554-486d-9760-bfcb754439a0 tempest-ProjectReaderTests-187264621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-23fd0372-9e8f-45b1-b011-b69fb867c36b" returned: 0 in 0.829s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-64651f09-3554-486d-9760-bfcb754439a0 tempest-ProjectReaderTests-187264621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-23fd0372-9e8f-45b1-b011-b69fb867c36b {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:02 devstack sudo[103876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-23fd0372-9e8f-45b1-b011-b69fb867c36b Jul 08 01:55:02 devstack sudo[103876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:02 devstack sudo[103876]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-64651f09-3554-486d-9760-bfcb754439a0 tempest-ProjectReaderTests-187264621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-23fd0372-9e8f-45b1-b011-b69fb867c36b" returned: 0 in 0.691s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:02 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-64651f09-3554-486d-9760-bfcb754439a0 tempest-ProjectReaderTests-187264621 None] Lock "cinder-quobyte-23fd0372-9e8f-45b1-b011-b69fb867c36b" released by "delete_volume" :: held 1.563s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:55:02 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-64651f09-3554-486d-9760-bfcb754439a0 tempest-ProjectReaderTests-187264621 None] Created reservations ['7d21863d-5da7-48cc-afe4-becbb0c8056a', '266f7d37-68ee-460e-a409-aaaa53613c97', 'c2f87cff-67b0-4f49-bc8e-98808c79ae70', 'c8332033-da51-4ea0-9db4-635bf39e5f3f'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:55:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-64651f09-3554-486d-9760-bfcb754439a0 tempest-ProjectReaderTests-187264621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-64651f09-3554-486d-9760-bfcb754439a0 tempest-ProjectReaderTests-187264621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:03 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-64651f09-3554-486d-9760-bfcb754439a0 tempest-ProjectReaderTests-187264621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:55:03 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-64651f09-3554-486d-9760-bfcb754439a0 tempest-ProjectReaderTests-187264621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:55:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-64651f09-3554-486d-9760-bfcb754439a0 tempest-ProjectReaderTests-187264621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-64651f09-3554-486d-9760-bfcb754439a0 tempest-ProjectReaderTests-187264621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:03 devstack sudo[103879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:55:03 devstack sudo[103879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:03 devstack sudo[103879]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-64651f09-3554-486d-9760-bfcb754439a0 tempest-ProjectReaderTests-187264621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.783s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:03 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-64651f09-3554-486d-9760-bfcb754439a0 tempest-ProjectReaderTests-187264621 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:55:03 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-64651f09-3554-486d-9760-bfcb754439a0 tempest-ProjectReaderTests-187264621 None] Deleted volume successfully. Jul 08 01:55:03 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-64651f09-3554-486d-9760-bfcb754439a0 tempest-ProjectReaderTests-187264621 None] Lock "cinder-23fd0372-9e8f-45b1-b011-b69fb867c36b-delete_volume" released by "delete_volume" :: held 2.599s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:55:04 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fc5f0c8-234e-4591-aa1b-1907f304220a tempest-ProjectReaderTests-187264621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:55:04 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8fc5f0c8-234e-4591-aa1b-1907f304220a tempest-ProjectReaderTests-187264621 None] Flow 'volume_create_manager' (fde40708-ab85-419a-b18c-e6f37920323f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:55:04 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8fc5f0c8-234e-4591-aa1b-1907f304220a tempest-ProjectReaderTests-187264621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd8fbc46-37af-4730-9d14-31eba1710867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:04 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8fc5f0c8-234e-4591-aa1b-1907f304220a tempest-ProjectReaderTests-187264621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd8fbc46-37af-4730-9d14-31eba1710867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2090690807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=868e25f9-79f6-4f88-a51d-e357cb81915d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b881eec858bc456882a68219919e6cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:55:04Z,use_quota=True,user_id='96f3ca0cf4cb4b4e8a01c93f962cd30e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:04 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8fc5f0c8-234e-4591-aa1b-1907f304220a tempest-ProjectReaderTests-187264621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4a081e9-f79f-4cad-aa3e-61163fba5dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:04 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8fc5f0c8-234e-4591-aa1b-1907f304220a tempest-ProjectReaderTests-187264621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4a081e9-f79f-4cad-aa3e-61163fba5dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:04 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8fc5f0c8-234e-4591-aa1b-1907f304220a tempest-ProjectReaderTests-187264621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a144a59c-d299-42b6-8e4f-77a1ffa44adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:04 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8fc5f0c8-234e-4591-aa1b-1907f304220a tempest-ProjectReaderTests-187264621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a144a59c-d299-42b6-8e4f-77a1ffa44adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '868e25f9-79f6-4f88-a51d-e357cb81915d', 'volume_name': 'volume-868e25f9-79f6-4f88-a51d-e357cb81915d', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:04 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8fc5f0c8-234e-4591-aa1b-1907f304220a tempest-ProjectReaderTests-187264621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (583f95b9-2723-4b83-96f0-23afbc90e829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:04 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8fc5f0c8-234e-4591-aa1b-1907f304220a tempest-ProjectReaderTests-187264621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (583f95b9-2723-4b83-96f0-23afbc90e829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:04 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8fc5f0c8-234e-4591-aa1b-1907f304220a tempest-ProjectReaderTests-187264621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adb5bfd0-93a4-42ca-8c9e-2a6df3a080ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:04 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-8fc5f0c8-234e-4591-aa1b-1907f304220a tempest-ProjectReaderTests-187264621 None] Volume 868e25f9-79f6-4f88-a51d-e357cb81915d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-868e25f9-79f6-4f88-a51d-e357cb81915d', 'volume_size': 1} Jul 08 01:55:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8fc5f0c8-234e-4591-aa1b-1907f304220a tempest-ProjectReaderTests-187264621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8fc5f0c8-234e-4591-aa1b-1907f304220a tempest-ProjectReaderTests-187264621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:04 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-8fc5f0c8-234e-4591-aa1b-1907f304220a tempest-ProjectReaderTests-187264621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2090690807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=868e25f9-79f6-4f88-a51d-e357cb81915d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b881eec858bc456882a68219919e6cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:55:04Z,use_quota=True,user_id='96f3ca0cf4cb4b4e8a01c93f962cd30e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:55:04 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-8fc5f0c8-234e-4591-aa1b-1907f304220a tempest-ProjectReaderTests-187264621 None] Creating volume 868e25f9-79f6-4f88-a51d-e357cb81915d {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:55:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8fc5f0c8-234e-4591-aa1b-1907f304220a tempest-ProjectReaderTests-187264621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8fc5f0c8-234e-4591-aa1b-1907f304220a tempest-ProjectReaderTests-187264621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:04 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-8fc5f0c8-234e-4591-aa1b-1907f304220a tempest-ProjectReaderTests-187264621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:55:04 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-8fc5f0c8-234e-4591-aa1b-1907f304220a tempest-ProjectReaderTests-187264621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:55:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8fc5f0c8-234e-4591-aa1b-1907f304220a tempest-ProjectReaderTests-187264621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:04 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-8fc5f0c8-234e-4591-aa1b-1907f304220a tempest-ProjectReaderTests-187264621 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:55:04 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-8fc5f0c8-234e-4591-aa1b-1907f304220a tempest-ProjectReaderTests-187264621 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:55:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8fc5f0c8-234e-4591-aa1b-1907f304220a tempest-ProjectReaderTests-187264621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-868e25f9-79f6-4f88-a51d-e357cb81915d 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:04 devstack sudo[103882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-868e25f9-79f6-4f88-a51d-e357cb81915d 1073741824 Jul 08 01:55:04 devstack sudo[103882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:05 devstack sudo[103882]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8fc5f0c8-234e-4591-aa1b-1907f304220a tempest-ProjectReaderTests-187264621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-868e25f9-79f6-4f88-a51d-e357cb81915d 1073741824" returned: 0 in 0.863s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8fc5f0c8-234e-4591-aa1b-1907f304220a tempest-ProjectReaderTests-187264621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-868e25f9-79f6-4f88-a51d-e357cb81915d {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:05 devstack sudo[103887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-868e25f9-79f6-4f88-a51d-e357cb81915d Jul 08 01:55:05 devstack sudo[103887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:05 devstack sudo[103887]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8fc5f0c8-234e-4591-aa1b-1907f304220a tempest-ProjectReaderTests-187264621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-868e25f9-79f6-4f88-a51d-e357cb81915d" returned: 0 in 0.794s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:05 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-8fc5f0c8-234e-4591-aa1b-1907f304220a tempest-ProjectReaderTests-187264621 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:55:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8fc5f0c8-234e-4591-aa1b-1907f304220a tempest-ProjectReaderTests-187264621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:05 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8fc5f0c8-234e-4591-aa1b-1907f304220a tempest-ProjectReaderTests-187264621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adb5bfd0-93a4-42ca-8c9e-2a6df3a080ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-868e25f9-79f6-4f88-a51d-e357cb81915d', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:05 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8fc5f0c8-234e-4591-aa1b-1907f304220a tempest-ProjectReaderTests-187264621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1ddfded-20b2-4784-bc1b-5bb4834bf2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:05 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-8fc5f0c8-234e-4591-aa1b-1907f304220a tempest-ProjectReaderTests-187264621 None] Volume volume-868e25f9-79f6-4f88-a51d-e357cb81915d (868e25f9-79f6-4f88-a51d-e357cb81915d): created successfully Jul 08 01:55:05 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8fc5f0c8-234e-4591-aa1b-1907f304220a tempest-ProjectReaderTests-187264621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1ddfded-20b2-4784-bc1b-5bb4834bf2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:05 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-8fc5f0c8-234e-4591-aa1b-1907f304220a tempest-ProjectReaderTests-187264621 None] Flow 'volume_create_manager' (fde40708-ab85-419a-b18c-e6f37920323f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:55:05 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-8fc5f0c8-234e-4591-aa1b-1907f304220a tempest-ProjectReaderTests-187264621 None] Created volume successfully. Jul 08 01:55:06 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-9df2b205-a78f-4957-829d-5ff78a6c86af tempest-ProjectReaderTests-187264621 None] Acquiring lock "cinder-868e25f9-79f6-4f88-a51d-e357cb81915d-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:55:06 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-9df2b205-a78f-4957-829d-5ff78a6c86af tempest-ProjectReaderTests-187264621 None] Lock "cinder-868e25f9-79f6-4f88-a51d-e357cb81915d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:55:06 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-9df2b205-a78f-4957-829d-5ff78a6c86af tempest-ProjectReaderTests-187264621 None] Acquiring lock "cinder-quobyte-868e25f9-79f6-4f88-a51d-e357cb81915d" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:55:06 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-9df2b205-a78f-4957-829d-5ff78a6c86af tempest-ProjectReaderTests-187264621 None] Lock "cinder-quobyte-868e25f9-79f6-4f88-a51d-e357cb81915d" acquired by "delete_volume" :: waited 0.020s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:55:06 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d9dcf1-49aa-4092-ba91-670eded31f72]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:55:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9df2b205-a78f-4957-829d-5ff78a6c86af tempest-ProjectReaderTests-187264621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-868e25f9-79f6-4f88-a51d-e357cb81915d {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:06 devstack sudo[103891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-868e25f9-79f6-4f88-a51d-e357cb81915d Jul 08 01:55:06 devstack sudo[103891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:07 devstack sudo[103891]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9df2b205-a78f-4957-829d-5ff78a6c86af tempest-ProjectReaderTests-187264621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-868e25f9-79f6-4f88-a51d-e357cb81915d" returned: 0 in 0.850s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9df2b205-a78f-4957-829d-5ff78a6c86af tempest-ProjectReaderTests-187264621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-868e25f9-79f6-4f88-a51d-e357cb81915d {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:07 devstack sudo[103896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-868e25f9-79f6-4f88-a51d-e357cb81915d Jul 08 01:55:07 devstack sudo[103896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:07 devstack sudo[103896]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9df2b205-a78f-4957-829d-5ff78a6c86af tempest-ProjectReaderTests-187264621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-868e25f9-79f6-4f88-a51d-e357cb81915d" returned: 0 in 0.704s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:07 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-9df2b205-a78f-4957-829d-5ff78a6c86af tempest-ProjectReaderTests-187264621 None] Lock "cinder-quobyte-868e25f9-79f6-4f88-a51d-e357cb81915d" released by "delete_volume" :: held 1.595s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:55:07 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-9df2b205-a78f-4957-829d-5ff78a6c86af tempest-ProjectReaderTests-187264621 None] Created reservations ['9495d9cd-1b36-4531-9a41-74ab5919b016', '9cac7d0e-c3e5-4a56-abe3-8d27d15624e8', 'b5b58b04-222f-4044-a2c7-654a6f14a573', 'f79dc8c8-10af-4704-9e28-bddbb03798b1'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:55:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-9df2b205-a78f-4957-829d-5ff78a6c86af tempest-ProjectReaderTests-187264621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-9df2b205-a78f-4957-829d-5ff78a6c86af tempest-ProjectReaderTests-187264621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:08 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-9df2b205-a78f-4957-829d-5ff78a6c86af tempest-ProjectReaderTests-187264621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:55:08 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-9df2b205-a78f-4957-829d-5ff78a6c86af tempest-ProjectReaderTests-187264621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:55:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-9df2b205-a78f-4957-829d-5ff78a6c86af tempest-ProjectReaderTests-187264621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9df2b205-a78f-4957-829d-5ff78a6c86af tempest-ProjectReaderTests-187264621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:08 devstack sudo[104208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:55:08 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:08 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9df2b205-a78f-4957-829d-5ff78a6c86af tempest-ProjectReaderTests-187264621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.705s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:08 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-9df2b205-a78f-4957-829d-5ff78a6c86af tempest-ProjectReaderTests-187264621 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:55:08 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-9df2b205-a78f-4957-829d-5ff78a6c86af tempest-ProjectReaderTests-187264621 None] Deleted volume successfully. Jul 08 01:55:08 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-9df2b205-a78f-4957-829d-5ff78a6c86af tempest-ProjectReaderTests-187264621 None] Lock "cinder-868e25f9-79f6-4f88-a51d-e357cb81915d-delete_volume" released by "delete_volume" :: held 2.552s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:55:18 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=35,cinder:UPDATE=48,cinder:DELETE=3,cinder:INSERT=13 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:55:18 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=41,cinder:UPDATE=53,cinder:INSERT=11,cinder:DELETE=6 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:55:25 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6b33bb4-5177-44b4-a145-90ffb4976657 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:55:25 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a6b33bb4-5177-44b4-a145-90ffb4976657 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Flow 'volume_create_manager' (c98f1c28-1213-4489-b7d2-067bd60b6188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:55:25 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a6b33bb4-5177-44b4-a145-90ffb4976657 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b017e30f-f561-4cad-867f-8ebd510ac78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:25 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a6b33bb4-5177-44b4-a145-90ffb4976657 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b017e30f-f561-4cad-867f-8ebd510ac78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-813233037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e6155d5-fbf2-43ea-a765-4584980f9098,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a8f380c8b645a5a686943b4bcaad89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:55:26Z,use_quota=True,user_id='4851b20b18f9494194688ba217d4744f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:25 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a6b33bb4-5177-44b4-a145-90ffb4976657 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dd50de6-8f7b-4b6a-b93e-2ef7920ed5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:25 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a6b33bb4-5177-44b4-a145-90ffb4976657 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dd50de6-8f7b-4b6a-b93e-2ef7920ed5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:25 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a6b33bb4-5177-44b4-a145-90ffb4976657 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e1835fb-d51b-4284-a02b-7c52afa302f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:25 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a6b33bb4-5177-44b4-a145-90ffb4976657 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e1835fb-d51b-4284-a02b-7c52afa302f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e6155d5-fbf2-43ea-a765-4584980f9098', 'volume_name': 'volume-6e6155d5-fbf2-43ea-a765-4584980f9098', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:25 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a6b33bb4-5177-44b4-a145-90ffb4976657 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f99c961-9b94-4db4-8c03-7233eea01eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a6b33bb4-5177-44b4-a145-90ffb4976657 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f99c961-9b94-4db4-8c03-7233eea01eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a6b33bb4-5177-44b4-a145-90ffb4976657 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f68d46d3-7593-46fa-936c-dc306654a120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:26 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-a6b33bb4-5177-44b4-a145-90ffb4976657 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Volume 6e6155d5-fbf2-43ea-a765-4584980f9098: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e6155d5-fbf2-43ea-a765-4584980f9098', 'volume_size': 1} Jul 08 01:55:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a6b33bb4-5177-44b4-a145-90ffb4976657 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a6b33bb4-5177-44b4-a145-90ffb4976657 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:26 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a6b33bb4-5177-44b4-a145-90ffb4976657 tempest-CreateVolumesFromSnapshotTest-1308629226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-813233037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e6155d5-fbf2-43ea-a765-4584980f9098,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a8f380c8b645a5a686943b4bcaad89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:55:26Z,use_quota=True,user_id='4851b20b18f9494194688ba217d4744f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:55:26 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-a6b33bb4-5177-44b4-a145-90ffb4976657 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Creating volume 6e6155d5-fbf2-43ea-a765-4584980f9098 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:55:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a6b33bb4-5177-44b4-a145-90ffb4976657 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a6b33bb4-5177-44b4-a145-90ffb4976657 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:26 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a6b33bb4-5177-44b4-a145-90ffb4976657 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:55:26 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a6b33bb4-5177-44b4-a145-90ffb4976657 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:55:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a6b33bb4-5177-44b4-a145-90ffb4976657 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:26 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a6b33bb4-5177-44b4-a145-90ffb4976657 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:55:26 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-a6b33bb4-5177-44b4-a145-90ffb4976657 tempest-CreateVolumesFromSnapshotTest-1308629226 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:55:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a6b33bb4-5177-44b4-a145-90ffb4976657 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:26 devstack sudo[104358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098 1073741824 Jul 08 01:55:26 devstack sudo[104358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:26 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c9786e4-79d6-4e60-a772-0c35c9164678 tempest-CreateVolumesFromImageTest-2115603068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:55:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5c9786e4-79d6-4e60-a772-0c35c9164678 tempest-CreateVolumesFromImageTest-2115603068 None] Flow 'volume_create_manager' (5cb36733-9288-4570-a3cc-ba37ec083dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:55:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5c9786e4-79d6-4e60-a772-0c35c9164678 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bc1fe62-76df-4ab1-a797-d44849a51fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5c9786e4-79d6-4e60-a772-0c35c9164678 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bc1fe62-76df-4ab1-a797-d44849a51fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1017976851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7db3a0a0-5964-4bc1-a5f3-aa10391a7bf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='663506569a884829924e9585c565784b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:55:26Z,use_quota=True,user_id='d033957b7a944f6da13c688146f450a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5c9786e4-79d6-4e60-a772-0c35c9164678 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2f9fb48-2150-4755-beec-86b262e02ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5c9786e4-79d6-4e60-a772-0c35c9164678 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2f9fb48-2150-4755-beec-86b262e02ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5c9786e4-79d6-4e60-a772-0c35c9164678 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (892c70dd-4d0e-436b-856e-adc2a2ed9343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5c9786e4-79d6-4e60-a772-0c35c9164678 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (892c70dd-4d0e-436b-856e-adc2a2ed9343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7db3a0a0-5964-4bc1-a5f3-aa10391a7bf3', 'volume_name': 'volume-7db3a0a0-5964-4bc1-a5f3-aa10391a7bf3', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5c9786e4-79d6-4e60-a772-0c35c9164678 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2c673d9-e50c-4f9a-8255-a5c3c977b5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5c9786e4-79d6-4e60-a772-0c35c9164678 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2c673d9-e50c-4f9a-8255-a5c3c977b5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5c9786e4-79d6-4e60-a772-0c35c9164678 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9d5562f-c6f7-4210-9087-393bc1f1c2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:26 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-5c9786e4-79d6-4e60-a772-0c35c9164678 tempest-CreateVolumesFromImageTest-2115603068 None] Volume 7db3a0a0-5964-4bc1-a5f3-aa10391a7bf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7db3a0a0-5964-4bc1-a5f3-aa10391a7bf3', 'volume_size': 1} Jul 08 01:55:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5c9786e4-79d6-4e60-a772-0c35c9164678 tempest-CreateVolumesFromImageTest-2115603068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:26 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-831b4f0e-a45f-45e2-98e6-70393a765cd0 tempest-CreateVolumesFromImageTest-2115603068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:55:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-831b4f0e-a45f-45e2-98e6-70393a765cd0 tempest-CreateVolumesFromImageTest-2115603068 None] Flow 'volume_create_manager' (1658cee7-5d49-4822-8435-653bb139df1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:55:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-831b4f0e-a45f-45e2-98e6-70393a765cd0 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c785271-d9f8-4127-836f-2770cba4b1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-831b4f0e-a45f-45e2-98e6-70393a765cd0 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c785271-d9f8-4127-836f-2770cba4b1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1760482722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1d56551-8817-4886-8fd1-185d12fd69b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='663506569a884829924e9585c565784b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:55:27Z,use_quota=True,user_id='d033957b7a944f6da13c688146f450a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-831b4f0e-a45f-45e2-98e6-70393a765cd0 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d50202fa-67cb-4129-9dda-85d28582f2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-831b4f0e-a45f-45e2-98e6-70393a765cd0 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d50202fa-67cb-4129-9dda-85d28582f2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-831b4f0e-a45f-45e2-98e6-70393a765cd0 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b7d8d15-4763-4139-8e5d-cf32021564d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-831b4f0e-a45f-45e2-98e6-70393a765cd0 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b7d8d15-4763-4139-8e5d-cf32021564d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1d56551-8817-4886-8fd1-185d12fd69b3', 'volume_name': 'volume-a1d56551-8817-4886-8fd1-185d12fd69b3', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-831b4f0e-a45f-45e2-98e6-70393a765cd0 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (286f7e97-f278-4ace-897b-2373a4b998ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-831b4f0e-a45f-45e2-98e6-70393a765cd0 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (286f7e97-f278-4ace-897b-2373a4b998ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-831b4f0e-a45f-45e2-98e6-70393a765cd0 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3724024-6f17-4d8a-8cee-5afdc39a6c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:26 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-831b4f0e-a45f-45e2-98e6-70393a765cd0 tempest-CreateVolumesFromImageTest-2115603068 None] Volume a1d56551-8817-4886-8fd1-185d12fd69b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1d56551-8817-4886-8fd1-185d12fd69b3', 'volume_size': 1} Jul 08 01:55:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-831b4f0e-a45f-45e2-98e6-70393a765cd0 tempest-CreateVolumesFromImageTest-2115603068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:27 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-d552300f-2322-4b31-b8bd-18f370f35350 tempest-CreateVolumesFromImageTest-2115603068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:55:27 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d552300f-2322-4b31-b8bd-18f370f35350 tempest-CreateVolumesFromImageTest-2115603068 None] Flow 'volume_create_manager' (ed0c92b9-e73d-4591-a6b1-83adcc0e0727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:55:27 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d552300f-2322-4b31-b8bd-18f370f35350 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1b89e66-9da5-4e15-92e5-82cacfe3c23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:27 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d552300f-2322-4b31-b8bd-18f370f35350 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1b89e66-9da5-4e15-92e5-82cacfe3c23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-644654740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b8b9430-68e7-4a28-95d0-b60af923580a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='663506569a884829924e9585c565784b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:55:27Z,use_quota=True,user_id='d033957b7a944f6da13c688146f450a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:27 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d552300f-2322-4b31-b8bd-18f370f35350 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39788191-4535-4406-89e1-3713dac4d818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:27 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d552300f-2322-4b31-b8bd-18f370f35350 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39788191-4535-4406-89e1-3713dac4d818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:27 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d552300f-2322-4b31-b8bd-18f370f35350 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (505e97b1-62ef-4c02-aede-4fe1fd5471de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:27 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d552300f-2322-4b31-b8bd-18f370f35350 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (505e97b1-62ef-4c02-aede-4fe1fd5471de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b8b9430-68e7-4a28-95d0-b60af923580a', 'volume_name': 'volume-4b8b9430-68e7-4a28-95d0-b60af923580a', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:27 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d552300f-2322-4b31-b8bd-18f370f35350 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66517ad0-bea8-44de-8976-7e1f0694c250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:27 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d552300f-2322-4b31-b8bd-18f370f35350 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66517ad0-bea8-44de-8976-7e1f0694c250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:27 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d552300f-2322-4b31-b8bd-18f370f35350 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b312b210-7a85-4e01-9f75-c944572e790f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:27 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-d552300f-2322-4b31-b8bd-18f370f35350 tempest-CreateVolumesFromImageTest-2115603068 None] Volume 4b8b9430-68e7-4a28-95d0-b60af923580a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b8b9430-68e7-4a28-95d0-b60af923580a', 'volume_size': 1} Jul 08 01:55:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-d552300f-2322-4b31-b8bd-18f370f35350 tempest-CreateVolumesFromImageTest-2115603068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:27 devstack sudo[104358]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a6b33bb4-5177-44b4-a145-90ffb4976657 tempest-CreateVolumesFromSnapshotTest-1308629226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098 1073741824" returned: 0 in 1.641s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a6b33bb4-5177-44b4-a145-90ffb4976657 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:27 devstack sudo[104370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098 Jul 08 01:55:27 devstack sudo[104370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:28 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-56485d89-0c37-42ad-882e-c65faf763009 tempest-CreateVolumesFromImageTest-2115603068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:55:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-56485d89-0c37-42ad-882e-c65faf763009 tempest-CreateVolumesFromImageTest-2115603068 None] Flow 'volume_create_manager' (a1439f8c-65cf-471d-89a0-a971c8add3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:55:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-56485d89-0c37-42ad-882e-c65faf763009 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff758473-d396-4be5-ad58-1b42cce47602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-56485d89-0c37-42ad-882e-c65faf763009 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff758473-d396-4be5-ad58-1b42cce47602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2067933415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df58e96d-3ab8-40ec-a97f-cc1c2f21187c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='663506569a884829924e9585c565784b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:55:28Z,use_quota=True,user_id='d033957b7a944f6da13c688146f450a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-56485d89-0c37-42ad-882e-c65faf763009 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e37850a2-eda0-4a7a-b7a0-2069f4a3288a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-56485d89-0c37-42ad-882e-c65faf763009 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e37850a2-eda0-4a7a-b7a0-2069f4a3288a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-56485d89-0c37-42ad-882e-c65faf763009 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c81064f9-d7f6-4dd6-ab87-59e44c6e92a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-56485d89-0c37-42ad-882e-c65faf763009 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c81064f9-d7f6-4dd6-ab87-59e44c6e92a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df58e96d-3ab8-40ec-a97f-cc1c2f21187c', 'volume_name': 'volume-df58e96d-3ab8-40ec-a97f-cc1c2f21187c', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-56485d89-0c37-42ad-882e-c65faf763009 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d58a38-bf0e-47ad-8600-1a86ef00f1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-56485d89-0c37-42ad-882e-c65faf763009 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d58a38-bf0e-47ad-8600-1a86ef00f1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-56485d89-0c37-42ad-882e-c65faf763009 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96b2a19e-d912-4a19-8a90-55f039eba652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:28 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-56485d89-0c37-42ad-882e-c65faf763009 tempest-CreateVolumesFromImageTest-2115603068 None] Volume df58e96d-3ab8-40ec-a97f-cc1c2f21187c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df58e96d-3ab8-40ec-a97f-cc1c2f21187c', 'volume_size': 1} Jul 08 01:55:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-56485d89-0c37-42ad-882e-c65faf763009 tempest-CreateVolumesFromImageTest-2115603068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:28 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-d12bd984-5f90-4c50-8074-59acd99247fb tempest-CreateVolumesFromImageTest-2115603068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:55:28 devstack sudo[104370]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d12bd984-5f90-4c50-8074-59acd99247fb tempest-CreateVolumesFromImageTest-2115603068 None] Flow 'volume_create_manager' (28f7e229-13f6-41f9-bb9c-da0c52b6c1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:55:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d12bd984-5f90-4c50-8074-59acd99247fb tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (638deb3b-5a63-40e6-82af-6ab1f0a1afdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a6b33bb4-5177-44b4-a145-90ffb4976657 tempest-CreateVolumesFromSnapshotTest-1308629226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098" returned: 0 in 1.100s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:28 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a6b33bb4-5177-44b4-a145-90ffb4976657 tempest-CreateVolumesFromSnapshotTest-1308629226 None] <== create_volume: return (2833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:55:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a6b33bb4-5177-44b4-a145-90ffb4976657 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.841s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5c9786e4-79d6-4e60-a772-0c35c9164678 tempest-CreateVolumesFromImageTest-2115603068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.285s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:28 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5c9786e4-79d6-4e60-a772-0c35c9164678 tempest-CreateVolumesFromImageTest-2115603068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1017976851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7db3a0a0-5964-4bc1-a5f3-aa10391a7bf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='663506569a884829924e9585c565784b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:55:26Z,use_quota=True,user_id='d033957b7a944f6da13c688146f450a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:55:28 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-5c9786e4-79d6-4e60-a772-0c35c9164678 tempest-CreateVolumesFromImageTest-2115603068 None] Creating volume 7db3a0a0-5964-4bc1-a5f3-aa10391a7bf3 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:55:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5c9786e4-79d6-4e60-a772-0c35c9164678 tempest-CreateVolumesFromImageTest-2115603068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5c9786e4-79d6-4e60-a772-0c35c9164678 tempest-CreateVolumesFromImageTest-2115603068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:28 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5c9786e4-79d6-4e60-a772-0c35c9164678 tempest-CreateVolumesFromImageTest-2115603068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:55:28 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5c9786e4-79d6-4e60-a772-0c35c9164678 tempest-CreateVolumesFromImageTest-2115603068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:55:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5c9786e4-79d6-4e60-a772-0c35c9164678 tempest-CreateVolumesFromImageTest-2115603068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:28 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5c9786e4-79d6-4e60-a772-0c35c9164678 tempest-CreateVolumesFromImageTest-2115603068 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:55:28 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-5c9786e4-79d6-4e60-a772-0c35c9164678 tempest-CreateVolumesFromImageTest-2115603068 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:55:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5c9786e4-79d6-4e60-a772-0c35c9164678 tempest-CreateVolumesFromImageTest-2115603068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7db3a0a0-5964-4bc1-a5f3-aa10391a7bf3 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d12bd984-5f90-4c50-8074-59acd99247fb tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (638deb3b-5a63-40e6-82af-6ab1f0a1afdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-439111977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d34a00b-1ef6-448f-8787-124885aa0641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='663506569a884829924e9585c565784b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:55:29Z,use_quota=True,user_id='d033957b7a944f6da13c688146f450a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:28 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7db3a0a0-5964-4bc1-a5f3-aa10391a7bf3 1073741824 Jul 08 01:55:28 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d12bd984-5f90-4c50-8074-59acd99247fb tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c5d47c5-25c6-41fb-b47d-6a424d23c856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d12bd984-5f90-4c50-8074-59acd99247fb tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c5d47c5-25c6-41fb-b47d-6a424d23c856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d12bd984-5f90-4c50-8074-59acd99247fb tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35627386-83b9-40c3-900b-03925c9468fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d12bd984-5f90-4c50-8074-59acd99247fb tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35627386-83b9-40c3-900b-03925c9468fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d34a00b-1ef6-448f-8787-124885aa0641', 'volume_name': 'volume-9d34a00b-1ef6-448f-8787-124885aa0641', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d12bd984-5f90-4c50-8074-59acd99247fb tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e48042f0-2014-4940-b793-15f1347480ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d12bd984-5f90-4c50-8074-59acd99247fb tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e48042f0-2014-4940-b793-15f1347480ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:28 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d12bd984-5f90-4c50-8074-59acd99247fb tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34f940ca-fd3f-4d79-9960-ff56135a0f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:28 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-d12bd984-5f90-4c50-8074-59acd99247fb tempest-CreateVolumesFromImageTest-2115603068 None] Volume 9d34a00b-1ef6-448f-8787-124885aa0641: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d34a00b-1ef6-448f-8787-124885aa0641', 'volume_size': 1} Jul 08 01:55:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-d12bd984-5f90-4c50-8074-59acd99247fb tempest-CreateVolumesFromImageTest-2115603068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:29 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a6b33bb4-5177-44b4-a145-90ffb4976657 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f68d46d3-7593-46fa-936c-dc306654a120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e6155d5-fbf2-43ea-a765-4584980f9098', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:29 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a6b33bb4-5177-44b4-a145-90ffb4976657 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85ae3406-92e1-40b9-9d47-cbfbe75e2b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:29 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-a6b33bb4-5177-44b4-a145-90ffb4976657 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Volume volume-6e6155d5-fbf2-43ea-a765-4584980f9098 (6e6155d5-fbf2-43ea-a765-4584980f9098): created successfully Jul 08 01:55:29 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a6b33bb4-5177-44b4-a145-90ffb4976657 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85ae3406-92e1-40b9-9d47-cbfbe75e2b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:29 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a6b33bb4-5177-44b4-a145-90ffb4976657 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Flow 'volume_create_manager' (c98f1c28-1213-4489-b7d2-067bd60b6188) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:55:29 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-a6b33bb4-5177-44b4-a145-90ffb4976657 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Created volume successfully. Jul 08 01:55:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4b7443c5-c984-4fd6-b658-3c0110096d95 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:29 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:55:29 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Flow 'volume_create_manager' (2382e758-9acf-425a-9c4c-5de85f0538d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:55:29 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b80a3aa-e320-4f4b-a6b8-f17611a66c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:29 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b80a3aa-e320-4f4b-a6b8-f17611a66c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d835ef96-3d5c-494b-af26-68d2886988a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c81cc5f542c40b69ca753ced723b3dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:55:30Z,use_quota=True,user_id='25298a9d19284ef296ea50c75495490a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:29 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d48694c3-e2ff-4079-bd44-73f01ec595ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:29 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d48694c3-e2ff-4079-bd44-73f01ec595ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:29 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6927dc1b-0a6b-4552-a7fa-1155d60821b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:29 devstack cinder-volume[87284]: DEBUG cinder.image.glance [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Creating Keystone auth plugin from conf {{(pid=87284) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:55:30 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5c9786e4-79d6-4e60-a772-0c35c9164678 tempest-CreateVolumesFromImageTest-2115603068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7db3a0a0-5964-4bc1-a5f3-aa10391a7bf3 1073741824" returned: 0 in 1.236s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:30 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6927dc1b-0a6b-4552-a7fa-1155d60821b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd835ef96-3d5c-494b-af26-68d2886988a5', 'volume_name': 'volume-d835ef96-3d5c-494b-af26-68d2886988a5', 'volume_size': 1, 'image_id': 'b89ee2e1-9ef6-4298-a35b-27978b4ebea7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b89ee2e1-9ef6-4298-a35b-27978b4ebea7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1ef276b8c213d8e91e592f2fd0b75d7f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9c81cc5f542c40b69ca753ced723b3dd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1e8faa31e99a86b16d8ed7dd3f9d923316e157db9fa8a6e1a71357b6b11672f88309ee173b23f99c2810ee9b5775d51e008dfc7613da3470dcce19c9e2e0019d', 'id': 'b89ee2e1-9ef6-4298-a35b-27978b4ebea7', 'created_at': datetime.datetime(2026, 7, 7, 23, 55, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 55, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b89ee2e1-9ef6-4298-a35b-27978b4ebea7/file', 'properties': {}}, 'image_service': }' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:30 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71bccc32-57c5-466f-a043-06abc58934dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:30 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71bccc32-57c5-466f-a043-06abc58934dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:30 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b181fc87-74dd-4ad7-8e4c-a2e61a884b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:30 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Volume d835ef96-3d5c-494b-af26-68d2886988a5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d835ef96-3d5c-494b-af26-68d2886988a5', 'volume_size': 1, 'image_id': 'b89ee2e1-9ef6-4298-a35b-27978b4ebea7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b89ee2e1-9ef6-4298-a35b-27978b4ebea7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1ef276b8c213d8e91e592f2fd0b75d7f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9c81cc5f542c40b69ca753ced723b3dd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1e8faa31e99a86b16d8ed7dd3f9d923316e157db9fa8a6e1a71357b6b11672f88309ee173b23f99c2810ee9b5775d51e008dfc7613da3470dcce19c9e2e0019d', 'id': 'b89ee2e1-9ef6-4298-a35b-27978b4ebea7', 'created_at': datetime.datetime(2026, 7, 7, 23, 55, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 55, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b89ee2e1-9ef6-4298-a35b-27978b4ebea7/file', 'properties': {}}, 'image_service': } Jul 08 01:55:30 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Trying to clone d835ef96-3d5c-494b-af26-68d2886988a5 from image b89ee2e1-9ef6-4298-a35b-27978b4ebea7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b89ee2e1-9ef6-4298-a35b-27978b4ebea7', 'metadata': {}}]). {{(pid=87284) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:55:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5c9786e4-79d6-4e60-a772-0c35c9164678 tempest-CreateVolumesFromImageTest-2115603068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7db3a0a0-5964-4bc1-a5f3-aa10391a7bf3 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:30 devstack sudo[104379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7db3a0a0-5964-4bc1-a5f3-aa10391a7bf3 Jul 08 01:55:30 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:30 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b89ee2e1-9ef6-4298-a35b-27978b4ebea7_ea55e9r_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87284) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:55:30 devstack cinder-volume[87284]: INFO cinder.image.image_utils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Image download 0.00 MB at 0.00 MB/s Jul 08 01:55:30 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d2cc8c-7da2-4a02-a225-5f0e9fcef5cd]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:55:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b89ee2e1-9ef6-4298-a35b-27978b4ebea7_ea55e9r_devstack@QuobyteHD {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:30 devstack sudo[104381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b89ee2e1-9ef6-4298-a35b-27978b4ebea7_ea55e9r_devstack@QuobyteHD Jul 08 01:55:30 devstack sudo[104381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:31 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5c9786e4-79d6-4e60-a772-0c35c9164678 tempest-CreateVolumesFromImageTest-2115603068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7db3a0a0-5964-4bc1-a5f3-aa10391a7bf3" returned: 0 in 0.849s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:31 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5c9786e4-79d6-4e60-a772-0c35c9164678 tempest-CreateVolumesFromImageTest-2115603068 None] <== create_volume: return (2175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:55:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5c9786e4-79d6-4e60-a772-0c35c9164678 tempest-CreateVolumesFromImageTest-2115603068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.179s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-831b4f0e-a45f-45e2-98e6-70393a765cd0 tempest-CreateVolumesFromImageTest-2115603068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.114s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:31 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-831b4f0e-a45f-45e2-98e6-70393a765cd0 tempest-CreateVolumesFromImageTest-2115603068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1760482722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1d56551-8817-4886-8fd1-185d12fd69b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='663506569a884829924e9585c565784b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:55:27Z,use_quota=True,user_id='d033957b7a944f6da13c688146f450a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:55:31 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-831b4f0e-a45f-45e2-98e6-70393a765cd0 tempest-CreateVolumesFromImageTest-2115603068 None] Creating volume a1d56551-8817-4886-8fd1-185d12fd69b3 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:55:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-831b4f0e-a45f-45e2-98e6-70393a765cd0 tempest-CreateVolumesFromImageTest-2115603068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-831b4f0e-a45f-45e2-98e6-70393a765cd0 tempest-CreateVolumesFromImageTest-2115603068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:31 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-831b4f0e-a45f-45e2-98e6-70393a765cd0 tempest-CreateVolumesFromImageTest-2115603068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:55:31 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-831b4f0e-a45f-45e2-98e6-70393a765cd0 tempest-CreateVolumesFromImageTest-2115603068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:55:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-831b4f0e-a45f-45e2-98e6-70393a765cd0 tempest-CreateVolumesFromImageTest-2115603068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:31 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-831b4f0e-a45f-45e2-98e6-70393a765cd0 tempest-CreateVolumesFromImageTest-2115603068 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:55:31 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-831b4f0e-a45f-45e2-98e6-70393a765cd0 tempest-CreateVolumesFromImageTest-2115603068 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:55:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-831b4f0e-a45f-45e2-98e6-70393a765cd0 tempest-CreateVolumesFromImageTest-2115603068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a1d56551-8817-4886-8fd1-185d12fd69b3 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:31 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5c9786e4-79d6-4e60-a772-0c35c9164678 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9d5562f-c6f7-4210-9087-393bc1f1c2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7db3a0a0-5964-4bc1-a5f3-aa10391a7bf3', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:31 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5c9786e4-79d6-4e60-a772-0c35c9164678 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e86d672-ffa3-46b7-be3b-ae4294494971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:31 devstack sudo[104384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a1d56551-8817-4886-8fd1-185d12fd69b3 1073741824 Jul 08 01:55:31 devstack sudo[104384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:31 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-5c9786e4-79d6-4e60-a772-0c35c9164678 tempest-CreateVolumesFromImageTest-2115603068 None] Volume volume-7db3a0a0-5964-4bc1-a5f3-aa10391a7bf3 (7db3a0a0-5964-4bc1-a5f3-aa10391a7bf3): created successfully Jul 08 01:55:31 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5c9786e4-79d6-4e60-a772-0c35c9164678 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e86d672-ffa3-46b7-be3b-ae4294494971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:31 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5c9786e4-79d6-4e60-a772-0c35c9164678 tempest-CreateVolumesFromImageTest-2115603068 None] Flow 'volume_create_manager' (5cb36733-9288-4570-a3cc-ba37ec083dea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:55:31 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-5c9786e4-79d6-4e60-a772-0c35c9164678 tempest-CreateVolumesFromImageTest-2115603068 None] Created volume successfully. Jul 08 01:55:31 devstack sudo[104381]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b89ee2e1-9ef6-4298-a35b-27978b4ebea7_ea55e9r_devstack@QuobyteHD" returned: 0 in 0.876s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b89ee2e1-9ef6-4298-a35b-27978b4ebea7_ea55e9r_devstack@QuobyteHD {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:31 devstack sudo[104388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b89ee2e1-9ef6-4298-a35b-27978b4ebea7_ea55e9r_devstack@QuobyteHD Jul 08 01:55:31 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:31 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:55:31 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Flow 'volume_create_manager' (b8ec8f3b-8dc4-4242-bdeb-fb75f6569ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:55:31 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1f126ac-c40d-4800-9111-3d7a7730d204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:31 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1f126ac-c40d-4800-9111-3d7a7730d204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c1141c3-31a8-4118-8f7b-3e65763761db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f68fd7d8bf74027ab49d40723b602e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:55:32Z,use_quota=True,user_id='b8a5c4af3f8445949c5de1975c3e5aa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea1dc1f6-9529-47ec-aea1-0260c8603511),volume_type_id=ea1dc1f6-9529-47ec-aea1-0260c8603511)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:31 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab442d6a-01bf-4eab-95f1-559f17d56f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:31 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab442d6a-01bf-4eab-95f1-559f17d56f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:32 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12f1b4da-14c8-4c30-81b2-af1d53b70e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:32 devstack cinder-volume[87284]: DEBUG cinder.image.glance [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Creating Keystone auth plugin from conf {{(pid=87284) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:55:32 devstack sudo[104384]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-831b4f0e-a45f-45e2-98e6-70393a765cd0 tempest-CreateVolumesFromImageTest-2115603068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a1d56551-8817-4886-8fd1-185d12fd69b3 1073741824" returned: 0 in 1.042s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-831b4f0e-a45f-45e2-98e6-70393a765cd0 tempest-CreateVolumesFromImageTest-2115603068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a1d56551-8817-4886-8fd1-185d12fd69b3 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:32 devstack sudo[104397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a1d56551-8817-4886-8fd1-185d12fd69b3 Jul 08 01:55:32 devstack sudo[104397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:32 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12f1b4da-14c8-4c30-81b2-af1d53b70e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8c1141c3-31a8-4118-8f7b-3e65763761db', 'volume_name': 'volume-8c1141c3-31a8-4118-8f7b-3e65763761db', 'volume_size': 1, 'image_id': 'b4064015-e677-46e8-b969-07e5e081b0ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b4064015-e677-46e8-b969-07e5e081b0ff', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'be3d5f7cbd0761e4f699e402034ee6c9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2f68fd7d8bf74027ab49d40723b602e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '93748f2177644ca105d2c9fe8be13b601c7c19ba2fde416befbc904e597d97d9054afebcc9930d31a8e8bf1f9f7fab725d87e5852b500001ceedc4db820f5663', 'id': 'b4064015-e677-46e8-b969-07e5e081b0ff', 'created_at': datetime.datetime(2026, 7, 7, 23, 55, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 55, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4064015-e677-46e8-b969-07e5e081b0ff/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:32 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cdd58fc-c149-4515-a2ee-a031ca18e5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:32 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cdd58fc-c149-4515-a2ee-a031ca18e5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:32 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f00fceae-d06a-4ff6-be4c-91fbb80168bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:32 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Volume 8c1141c3-31a8-4118-8f7b-3e65763761db: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8c1141c3-31a8-4118-8f7b-3e65763761db', 'volume_size': 1, 'image_id': 'b4064015-e677-46e8-b969-07e5e081b0ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b4064015-e677-46e8-b969-07e5e081b0ff', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'be3d5f7cbd0761e4f699e402034ee6c9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2f68fd7d8bf74027ab49d40723b602e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '93748f2177644ca105d2c9fe8be13b601c7c19ba2fde416befbc904e597d97d9054afebcc9930d31a8e8bf1f9f7fab725d87e5852b500001ceedc4db820f5663', 'id': 'b4064015-e677-46e8-b969-07e5e081b0ff', 'created_at': datetime.datetime(2026, 7, 7, 23, 55, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 55, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4064015-e677-46e8-b969-07e5e081b0ff/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 08 01:55:32 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Trying to clone 8c1141c3-31a8-4118-8f7b-3e65763761db from image b4064015-e677-46e8-b969-07e5e081b0ff at location (None, [{'url': 'file:///opt/stack/data/glance/images/b4064015-e677-46e8-b969-07e5e081b0ff', 'metadata': {}}]). {{(pid=87284) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:55:32 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b89ee2e1-9ef6-4298-a35b-27978b4ebea7_ea55e9r_devstack@QuobyteHD" returned: 1 in 1.069s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b89ee2e1-9ef6-4298-a35b-27978b4ebea7_ea55e9r_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:55:32 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Temporary image b89ee2e1-9ef6-4298-a35b-27978b4ebea7 is fetched for user 25298a9d19284ef296ea50c75495490a. {{(pid=87284) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:55:32 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bf3d6d-9b4f-459e-b421-236d3aa8939a]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:55:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b89ee2e1-9ef6-4298-a35b-27978b4ebea7_ea55e9r_devstack@QuobyteHD {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:32 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b4064015-e677-46e8-b969-07e5e081b0ff_43mmrikkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87284) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:55:32 devstack cinder-volume[87284]: INFO cinder.image.image_utils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Image download 0.00 MB at 0.00 MB/s Jul 08 01:55:32 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afe1266-0ff2-4ae0-988e-b77c3198a401]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:55:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4064015-e677-46e8-b969-07e5e081b0ff_43mmrikkdevstack@QuobyteHD {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:32 devstack sudo[104399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b89ee2e1-9ef6-4298-a35b-27978b4ebea7_ea55e9r_devstack@QuobyteHD Jul 08 01:55:32 devstack sudo[104399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:32 devstack sudo[104400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4064015-e677-46e8-b969-07e5e081b0ff_43mmrikkdevstack@QuobyteHD Jul 08 01:55:32 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:32 devstack sudo[104397]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-831b4f0e-a45f-45e2-98e6-70393a765cd0 tempest-CreateVolumesFromImageTest-2115603068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a1d56551-8817-4886-8fd1-185d12fd69b3" returned: 0 in 0.806s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:32 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-831b4f0e-a45f-45e2-98e6-70393a765cd0 tempest-CreateVolumesFromImageTest-2115603068 None] <== create_volume: return (1900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:55:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-831b4f0e-a45f-45e2-98e6-70393a765cd0 tempest-CreateVolumesFromImageTest-2115603068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.904s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-d552300f-2322-4b31-b8bd-18f370f35350 tempest-CreateVolumesFromImageTest-2115603068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.493s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:32 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-d552300f-2322-4b31-b8bd-18f370f35350 tempest-CreateVolumesFromImageTest-2115603068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-644654740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b8b9430-68e7-4a28-95d0-b60af923580a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='663506569a884829924e9585c565784b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:55:27Z,use_quota=True,user_id='d033957b7a944f6da13c688146f450a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:55:32 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-d552300f-2322-4b31-b8bd-18f370f35350 tempest-CreateVolumesFromImageTest-2115603068 None] Creating volume 4b8b9430-68e7-4a28-95d0-b60af923580a {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:55:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-d552300f-2322-4b31-b8bd-18f370f35350 tempest-CreateVolumesFromImageTest-2115603068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-d552300f-2322-4b31-b8bd-18f370f35350 tempest-CreateVolumesFromImageTest-2115603068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:32 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-d552300f-2322-4b31-b8bd-18f370f35350 tempest-CreateVolumesFromImageTest-2115603068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:55:32 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-d552300f-2322-4b31-b8bd-18f370f35350 tempest-CreateVolumesFromImageTest-2115603068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:55:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-d552300f-2322-4b31-b8bd-18f370f35350 tempest-CreateVolumesFromImageTest-2115603068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:32 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-d552300f-2322-4b31-b8bd-18f370f35350 tempest-CreateVolumesFromImageTest-2115603068 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:55:32 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-d552300f-2322-4b31-b8bd-18f370f35350 tempest-CreateVolumesFromImageTest-2115603068 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:55:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d552300f-2322-4b31-b8bd-18f370f35350 tempest-CreateVolumesFromImageTest-2115603068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4b8b9430-68e7-4a28-95d0-b60af923580a 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:33 devstack sudo[104404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4b8b9430-68e7-4a28-95d0-b60af923580a 1073741824 Jul 08 01:55:33 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:33 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-831b4f0e-a45f-45e2-98e6-70393a765cd0 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3724024-6f17-4d8a-8cee-5afdc39a6c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1d56551-8817-4886-8fd1-185d12fd69b3', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:33 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-831b4f0e-a45f-45e2-98e6-70393a765cd0 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8829863f-e5d1-4b5d-b194-5a55ab36aebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:33 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-831b4f0e-a45f-45e2-98e6-70393a765cd0 tempest-CreateVolumesFromImageTest-2115603068 None] Volume volume-a1d56551-8817-4886-8fd1-185d12fd69b3 (a1d56551-8817-4886-8fd1-185d12fd69b3): created successfully Jul 08 01:55:33 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-831b4f0e-a45f-45e2-98e6-70393a765cd0 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8829863f-e5d1-4b5d-b194-5a55ab36aebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:33 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-831b4f0e-a45f-45e2-98e6-70393a765cd0 tempest-CreateVolumesFromImageTest-2115603068 None] Flow 'volume_create_manager' (1658cee7-5d49-4822-8435-653bb139df1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:55:33 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-831b4f0e-a45f-45e2-98e6-70393a765cd0 tempest-CreateVolumesFromImageTest-2115603068 None] Created volume successfully. Jul 08 01:55:33 devstack sudo[104399]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b89ee2e1-9ef6-4298-a35b-27978b4ebea7_ea55e9r_devstack@QuobyteHD" returned: 0 in 0.888s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b89ee2e1-9ef6-4298-a35b-27978b4ebea7_ea55e9r_devstack@QuobyteHD {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:33 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4064015-e677-46e8-b969-07e5e081b0ff_43mmrikkdevstack@QuobyteHD" returned: 0 in 0.853s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4064015-e677-46e8-b969-07e5e081b0ff_43mmrikkdevstack@QuobyteHD {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:33 devstack sudo[104410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b89ee2e1-9ef6-4298-a35b-27978b4ebea7_ea55e9r_devstack@QuobyteHD Jul 08 01:55:33 devstack sudo[104410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:33 devstack sudo[104411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4064015-e677-46e8-b969-07e5e081b0ff_43mmrikkdevstack@QuobyteHD Jul 08 01:55:33 devstack sudo[104411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:33 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d552300f-2322-4b31-b8bd-18f370f35350 tempest-CreateVolumesFromImageTest-2115603068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4b8b9430-68e7-4a28-95d0-b60af923580a 1073741824" returned: 0 in 0.962s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d552300f-2322-4b31-b8bd-18f370f35350 tempest-CreateVolumesFromImageTest-2115603068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4b8b9430-68e7-4a28-95d0-b60af923580a {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:34 devstack sudo[104420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4b8b9430-68e7-4a28-95d0-b60af923580a Jul 08 01:55:34 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:34 devstack sudo[104410]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b89ee2e1-9ef6-4298-a35b-27978b4ebea7_ea55e9r_devstack@QuobyteHD" returned: 1 in 0.822s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b89ee2e1-9ef6-4298-a35b-27978b4ebea7_ea55e9r_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:55:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:34 devstack sudo[104411]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4064015-e677-46e8-b969-07e5e081b0ff_43mmrikkdevstack@QuobyteHD" returned: 1 in 0.843s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4064015-e677-46e8-b969-07e5e081b0ff_43mmrikkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:55:34 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Temporary image b4064015-e677-46e8-b969-07e5e081b0ff is fetched for user b8a5c4af3f8445949c5de1975c3e5aa7. {{(pid=87284) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:55:34 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf58abf-f040-43f3-8ea8-fdd4d3b718a8]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:55:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4064015-e677-46e8-b969-07e5e081b0ff_43mmrikkdevstack@QuobyteHD {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:34 devstack sudo[104425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4064015-e677-46e8-b969-07e5e081b0ff_43mmrikkdevstack@QuobyteHD Jul 08 01:55:34 devstack sudo[104425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:34 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d552300f-2322-4b31-b8bd-18f370f35350 tempest-CreateVolumesFromImageTest-2115603068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4b8b9430-68e7-4a28-95d0-b60af923580a" returned: 0 in 0.816s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:34 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-d552300f-2322-4b31-b8bd-18f370f35350 tempest-CreateVolumesFromImageTest-2115603068 None] <== create_volume: return (1849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:55:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-d552300f-2322-4b31-b8bd-18f370f35350 tempest-CreateVolumesFromImageTest-2115603068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.853s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-56485d89-0c37-42ad-882e-c65faf763009 tempest-CreateVolumesFromImageTest-2115603068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.585s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:34 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-56485d89-0c37-42ad-882e-c65faf763009 tempest-CreateVolumesFromImageTest-2115603068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2067933415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df58e96d-3ab8-40ec-a97f-cc1c2f21187c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='663506569a884829924e9585c565784b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:55:28Z,use_quota=True,user_id='d033957b7a944f6da13c688146f450a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:55:34 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-56485d89-0c37-42ad-882e-c65faf763009 tempest-CreateVolumesFromImageTest-2115603068 None] Creating volume df58e96d-3ab8-40ec-a97f-cc1c2f21187c {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:55:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-56485d89-0c37-42ad-882e-c65faf763009 tempest-CreateVolumesFromImageTest-2115603068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-56485d89-0c37-42ad-882e-c65faf763009 tempest-CreateVolumesFromImageTest-2115603068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:34 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-56485d89-0c37-42ad-882e-c65faf763009 tempest-CreateVolumesFromImageTest-2115603068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:55:34 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-56485d89-0c37-42ad-882e-c65faf763009 tempest-CreateVolumesFromImageTest-2115603068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:55:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-56485d89-0c37-42ad-882e-c65faf763009 tempest-CreateVolumesFromImageTest-2115603068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:34 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-56485d89-0c37-42ad-882e-c65faf763009 tempest-CreateVolumesFromImageTest-2115603068 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:55:34 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-56485d89-0c37-42ad-882e-c65faf763009 tempest-CreateVolumesFromImageTest-2115603068 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:55:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-56485d89-0c37-42ad-882e-c65faf763009 tempest-CreateVolumesFromImageTest-2115603068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df58e96d-3ab8-40ec-a97f-cc1c2f21187c 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:34 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d552300f-2322-4b31-b8bd-18f370f35350 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b312b210-7a85-4e01-9f75-c944572e790f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b8b9430-68e7-4a28-95d0-b60af923580a', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:34 devstack sudo[104429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df58e96d-3ab8-40ec-a97f-cc1c2f21187c 1073741824 Jul 08 01:55:34 devstack sudo[104429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:34 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d552300f-2322-4b31-b8bd-18f370f35350 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b0bfc7-120f-4c5c-a144-f5e1b35195e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:34 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-d552300f-2322-4b31-b8bd-18f370f35350 tempest-CreateVolumesFromImageTest-2115603068 None] Volume volume-4b8b9430-68e7-4a28-95d0-b60af923580a (4b8b9430-68e7-4a28-95d0-b60af923580a): created successfully Jul 08 01:55:34 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d552300f-2322-4b31-b8bd-18f370f35350 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b0bfc7-120f-4c5c-a144-f5e1b35195e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:34 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d552300f-2322-4b31-b8bd-18f370f35350 tempest-CreateVolumesFromImageTest-2115603068 None] Flow 'volume_create_manager' (ed0c92b9-e73d-4591-a6b1-83adcc0e0727) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:55:34 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-d552300f-2322-4b31-b8bd-18f370f35350 tempest-CreateVolumesFromImageTest-2115603068 None] Created volume successfully. Jul 08 01:55:35 devstack sudo[104425]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4064015-e677-46e8-b969-07e5e081b0ff_43mmrikkdevstack@QuobyteHD" returned: 0 in 0.855s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4064015-e677-46e8-b969-07e5e081b0ff_43mmrikkdevstack@QuobyteHD {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:35 devstack sudo[104433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4064015-e677-46e8-b969-07e5e081b0ff_43mmrikkdevstack@QuobyteHD Jul 08 01:55:35 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:35 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4064015-e677-46e8-b969-07e5e081b0ff_43mmrikkdevstack@QuobyteHD" returned: 1 in 0.854s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4064015-e677-46e8-b969-07e5e081b0ff_43mmrikkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:55:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:35 devstack sudo[104429]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-56485d89-0c37-42ad-882e-c65faf763009 tempest-CreateVolumesFromImageTest-2115603068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df58e96d-3ab8-40ec-a97f-cc1c2f21187c 1073741824" returned: 0 in 1.123s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-56485d89-0c37-42ad-882e-c65faf763009 tempest-CreateVolumesFromImageTest-2115603068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df58e96d-3ab8-40ec-a97f-cc1c2f21187c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:36 devstack sudo[104443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df58e96d-3ab8-40ec-a97f-cc1c2f21187c Jul 08 01:55:36 devstack sudo[104443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:36 devstack sudo[104443]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-56485d89-0c37-42ad-882e-c65faf763009 tempest-CreateVolumesFromImageTest-2115603068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df58e96d-3ab8-40ec-a97f-cc1c2f21187c" returned: 0 in 0.750s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-56485d89-0c37-42ad-882e-c65faf763009 tempest-CreateVolumesFromImageTest-2115603068 None] <== create_volume: return (1918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:55:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-56485d89-0c37-42ad-882e-c65faf763009 tempest-CreateVolumesFromImageTest-2115603068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.922s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-d12bd984-5f90-4c50-8074-59acd99247fb tempest-CreateVolumesFromImageTest-2115603068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.772s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-d12bd984-5f90-4c50-8074-59acd99247fb tempest-CreateVolumesFromImageTest-2115603068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-439111977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d34a00b-1ef6-448f-8787-124885aa0641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='663506569a884829924e9585c565784b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:55:29Z,use_quota=True,user_id='d033957b7a944f6da13c688146f450a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:55:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-d12bd984-5f90-4c50-8074-59acd99247fb tempest-CreateVolumesFromImageTest-2115603068 None] Creating volume 9d34a00b-1ef6-448f-8787-124885aa0641 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:55:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-d12bd984-5f90-4c50-8074-59acd99247fb tempest-CreateVolumesFromImageTest-2115603068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-d12bd984-5f90-4c50-8074-59acd99247fb tempest-CreateVolumesFromImageTest-2115603068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-d12bd984-5f90-4c50-8074-59acd99247fb tempest-CreateVolumesFromImageTest-2115603068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:55:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-d12bd984-5f90-4c50-8074-59acd99247fb tempest-CreateVolumesFromImageTest-2115603068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:55:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-d12bd984-5f90-4c50-8074-59acd99247fb tempest-CreateVolumesFromImageTest-2115603068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-d12bd984-5f90-4c50-8074-59acd99247fb tempest-CreateVolumesFromImageTest-2115603068 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:55:36 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-d12bd984-5f90-4c50-8074-59acd99247fb tempest-CreateVolumesFromImageTest-2115603068 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:55:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d12bd984-5f90-4c50-8074-59acd99247fb tempest-CreateVolumesFromImageTest-2115603068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9d34a00b-1ef6-448f-8787-124885aa0641 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-56485d89-0c37-42ad-882e-c65faf763009 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96b2a19e-d912-4a19-8a90-55f039eba652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df58e96d-3ab8-40ec-a97f-cc1c2f21187c', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:36 devstack sudo[104446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9d34a00b-1ef6-448f-8787-124885aa0641 1073741824 Jul 08 01:55:36 devstack sudo[104446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-56485d89-0c37-42ad-882e-c65faf763009 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb0acdd0-9d1b-4538-8562-311060336a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:36 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-56485d89-0c37-42ad-882e-c65faf763009 tempest-CreateVolumesFromImageTest-2115603068 None] Volume volume-df58e96d-3ab8-40ec-a97f-cc1c2f21187c (df58e96d-3ab8-40ec-a97f-cc1c2f21187c): created successfully Jul 08 01:55:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-56485d89-0c37-42ad-882e-c65faf763009 tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb0acdd0-9d1b-4538-8562-311060336a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-56485d89-0c37-42ad-882e-c65faf763009 tempest-CreateVolumesFromImageTest-2115603068 None] Flow 'volume_create_manager' (a1439f8c-65cf-471d-89a0-a971c8add3bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:55:36 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-56485d89-0c37-42ad-882e-c65faf763009 tempest-CreateVolumesFromImageTest-2115603068 None] Created volume successfully. Jul 08 01:55:37 devstack sudo[104446]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d12bd984-5f90-4c50-8074-59acd99247fb tempest-CreateVolumesFromImageTest-2115603068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9d34a00b-1ef6-448f-8787-124885aa0641 1073741824" returned: 0 in 0.869s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d12bd984-5f90-4c50-8074-59acd99247fb tempest-CreateVolumesFromImageTest-2115603068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9d34a00b-1ef6-448f-8787-124885aa0641 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:37 devstack sudo[104452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9d34a00b-1ef6-448f-8787-124885aa0641 Jul 08 01:55:37 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:38 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d12bd984-5f90-4c50-8074-59acd99247fb tempest-CreateVolumesFromImageTest-2115603068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9d34a00b-1ef6-448f-8787-124885aa0641" returned: 0 in 0.735s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:38 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-d12bd984-5f90-4c50-8074-59acd99247fb tempest-CreateVolumesFromImageTest-2115603068 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:55:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-d12bd984-5f90-4c50-8074-59acd99247fb tempest-CreateVolumesFromImageTest-2115603068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4b7443c5-c984-4fd6-b658-3c0110096d95 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.989s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d12bd984-5f90-4c50-8074-59acd99247fb tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34f940ca-fd3f-4d79-9960-ff56135a0f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d34a00b-1ef6-448f-8787-124885aa0641', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d12bd984-5f90-4c50-8074-59acd99247fb tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91cd72e3-2d4b-4139-8f67-911456b871c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:38 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-4b7443c5-c984-4fd6-b658-3c0110096d95 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Creating offline snapshot 8eb90949-a87c-4b63-afd2-6b5f7c40913f of volume 6e6155d5-fbf2-43ea-a765-4584980f9098 {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:55:38 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-d12bd984-5f90-4c50-8074-59acd99247fb tempest-CreateVolumesFromImageTest-2115603068 None] Volume volume-9d34a00b-1ef6-448f-8787-124885aa0641 (9d34a00b-1ef6-448f-8787-124885aa0641): created successfully Jul 08 01:55:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d12bd984-5f90-4c50-8074-59acd99247fb tempest-CreateVolumesFromImageTest-2115603068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91cd72e3-2d4b-4139-8f67-911456b871c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-d12bd984-5f90-4c50-8074-59acd99247fb tempest-CreateVolumesFromImageTest-2115603068 None] Flow 'volume_create_manager' (28f7e229-13f6-41f9-bb9c-da0c52b6c1c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:55:38 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40a137f-ca3d-479e-b211-c33e05b4aefa]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:55:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4b7443c5-c984-4fd6-b658-3c0110096d95 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:38 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-d12bd984-5f90-4c50-8074-59acd99247fb tempest-CreateVolumesFromImageTest-2115603068 None] Created volume successfully. Jul 08 01:55:38 devstack sudo[104455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098 Jul 08 01:55:38 devstack sudo[104455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:39 devstack sudo[104455]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4b7443c5-c984-4fd6-b658-3c0110096d95 tempest-CreateVolumesFromSnapshotTest-1308629226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098" returned: 0 in 0.944s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4b7443c5-c984-4fd6-b658-3c0110096d95 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098.8eb90949-a87c-4b63-afd2-6b5f7c40913f 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:39 devstack sudo[104460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098.8eb90949-a87c-4b63-afd2-6b5f7c40913f 1G Jul 08 01:55:39 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:39 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-52c80fe5-fec3-4186-a728-62d5c23b5dbc tempest-CreateVolumesFromImageTest-2115603068 None] Acquiring lock "cinder-9d34a00b-1ef6-448f-8787-124885aa0641-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:55:39 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-52c80fe5-fec3-4186-a728-62d5c23b5dbc tempest-CreateVolumesFromImageTest-2115603068 None] Lock "cinder-9d34a00b-1ef6-448f-8787-124885aa0641-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:55:39 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-52c80fe5-fec3-4186-a728-62d5c23b5dbc tempest-CreateVolumesFromImageTest-2115603068 None] Acquiring lock "cinder-quobyte-9d34a00b-1ef6-448f-8787-124885aa0641" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:55:39 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-52c80fe5-fec3-4186-a728-62d5c23b5dbc tempest-CreateVolumesFromImageTest-2115603068 None] Lock "cinder-quobyte-9d34a00b-1ef6-448f-8787-124885aa0641" acquired by "delete_volume" :: waited 0.027s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:55:39 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[63261885-78eb-48db-93e1-bae7aa06e1d9]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:55:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-52c80fe5-fec3-4186-a728-62d5c23b5dbc tempest-CreateVolumesFromImageTest-2115603068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9d34a00b-1ef6-448f-8787-124885aa0641 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:39 devstack sudo[104462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9d34a00b-1ef6-448f-8787-124885aa0641 Jul 08 01:55:39 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:40 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4b7443c5-c984-4fd6-b658-3c0110096d95 tempest-CreateVolumesFromSnapshotTest-1308629226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098.8eb90949-a87c-4b63-afd2-6b5f7c40913f 1G" returned: 0 in 1.034s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4b7443c5-c984-4fd6-b658-3c0110096d95 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e6155d5-fbf2-43ea-a765-4584980f9098 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098.8eb90949-a87c-4b63-afd2-6b5f7c40913f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:40 devstack sudo[104467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e6155d5-fbf2-43ea-a765-4584980f9098 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098.8eb90949-a87c-4b63-afd2-6b5f7c40913f Jul 08 01:55:40 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:40 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-52c80fe5-fec3-4186-a728-62d5c23b5dbc tempest-CreateVolumesFromImageTest-2115603068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9d34a00b-1ef6-448f-8787-124885aa0641" returned: 0 in 0.914s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-52c80fe5-fec3-4186-a728-62d5c23b5dbc tempest-CreateVolumesFromImageTest-2115603068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9d34a00b-1ef6-448f-8787-124885aa0641 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:40 devstack sudo[104472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9d34a00b-1ef6-448f-8787-124885aa0641 Jul 08 01:55:40 devstack sudo[104472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:41 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4b7443c5-c984-4fd6-b658-3c0110096d95 tempest-CreateVolumesFromSnapshotTest-1308629226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e6155d5-fbf2-43ea-a765-4584980f9098 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098.8eb90949-a87c-4b63-afd2-6b5f7c40913f" returned: 0 in 0.780s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:41 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-4b7443c5-c984-4fd6-b658-3c0110096d95 tempest-CreateVolumesFromSnapshotTest-1308629226 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098.8eb90949-a87c-4b63-afd2-6b5f7c40913f is being set with open permissions: ugo+rw Jul 08 01:55:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4b7443c5-c984-4fd6-b658-3c0110096d95 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098.8eb90949-a87c-4b63-afd2-6b5f7c40913f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:41 devstack sudo[104514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098.8eb90949-a87c-4b63-afd2-6b5f7c40913f Jul 08 01:55:41 devstack sudo[104514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:41 devstack sudo[104472]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-52c80fe5-fec3-4186-a728-62d5c23b5dbc tempest-CreateVolumesFromImageTest-2115603068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9d34a00b-1ef6-448f-8787-124885aa0641" returned: 0 in 0.747s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:41 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-52c80fe5-fec3-4186-a728-62d5c23b5dbc tempest-CreateVolumesFromImageTest-2115603068 None] Lock "cinder-quobyte-9d34a00b-1ef6-448f-8787-124885aa0641" released by "delete_volume" :: held 1.724s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:55:41 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-52c80fe5-fec3-4186-a728-62d5c23b5dbc tempest-CreateVolumesFromImageTest-2115603068 None] Created reservations ['651654ad-e104-424c-8b5b-fc2b0d39af13', '34a80ff1-5ddb-472b-8248-80f3de548e2f', '15e90fd4-ea4d-4e29-9e65-304f7b4e1b72', '48d80f7a-2926-43b9-9548-90c5e912d7ee'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:55:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-52c80fe5-fec3-4186-a728-62d5c23b5dbc tempest-CreateVolumesFromImageTest-2115603068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-52c80fe5-fec3-4186-a728-62d5c23b5dbc tempest-CreateVolumesFromImageTest-2115603068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:41 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-52c80fe5-fec3-4186-a728-62d5c23b5dbc tempest-CreateVolumesFromImageTest-2115603068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:55:41 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-52c80fe5-fec3-4186-a728-62d5c23b5dbc tempest-CreateVolumesFromImageTest-2115603068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:55:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-52c80fe5-fec3-4186-a728-62d5c23b5dbc tempest-CreateVolumesFromImageTest-2115603068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-52c80fe5-fec3-4186-a728-62d5c23b5dbc tempest-CreateVolumesFromImageTest-2115603068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:41 devstack sudo[104517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:55:41 devstack sudo[104517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:42 devstack sudo[104514]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4b7443c5-c984-4fd6-b658-3c0110096d95 tempest-CreateVolumesFromSnapshotTest-1308629226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098.8eb90949-a87c-4b63-afd2-6b5f7c40913f" returned: 0 in 0.765s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:42 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-7614e27b-6b64-405d-a7e9-9353ce59c8c1 tempest-CreateVolumesFromImageTest-2115603068 None] Acquiring lock "cinder-df58e96d-3ab8-40ec-a97f-cc1c2f21187c-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:55:42 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-7614e27b-6b64-405d-a7e9-9353ce59c8c1 tempest-CreateVolumesFromImageTest-2115603068 None] Lock "cinder-df58e96d-3ab8-40ec-a97f-cc1c2f21187c-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:55:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4b7443c5-c984-4fd6-b658-3c0110096d95 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:42 devstack sudo[104520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098.info Jul 08 01:55:42 devstack sudo[104520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:42 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-7614e27b-6b64-405d-a7e9-9353ce59c8c1 tempest-CreateVolumesFromImageTest-2115603068 None] Acquiring lock "cinder-quobyte-df58e96d-3ab8-40ec-a97f-cc1c2f21187c" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:55:42 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-7614e27b-6b64-405d-a7e9-9353ce59c8c1 tempest-CreateVolumesFromImageTest-2115603068 None] Lock "cinder-quobyte-df58e96d-3ab8-40ec-a97f-cc1c2f21187c" acquired by "delete_volume" :: waited 0.017s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:55:42 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[c374b9dd-a37c-4088-a18f-3606c49a13f6]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:55:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7614e27b-6b64-405d-a7e9-9353ce59c8c1 tempest-CreateVolumesFromImageTest-2115603068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df58e96d-3ab8-40ec-a97f-cc1c2f21187c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:42 devstack sudo[104522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df58e96d-3ab8-40ec-a97f-cc1c2f21187c Jul 08 01:55:42 devstack sudo[104522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:42 devstack sudo[104517]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-52c80fe5-fec3-4186-a728-62d5c23b5dbc tempest-CreateVolumesFromImageTest-2115603068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.898s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:42 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-52c80fe5-fec3-4186-a728-62d5c23b5dbc tempest-CreateVolumesFromImageTest-2115603068 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:55:42 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-52c80fe5-fec3-4186-a728-62d5c23b5dbc tempest-CreateVolumesFromImageTest-2115603068 None] Deleted volume successfully. Jul 08 01:55:42 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-52c80fe5-fec3-4186-a728-62d5c23b5dbc tempest-CreateVolumesFromImageTest-2115603068 None] Lock "cinder-9d34a00b-1ef6-448f-8787-124885aa0641-delete_volume" released by "delete_volume" :: held 2.878s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:55:42 devstack sudo[104520]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4b7443c5-c984-4fd6-b658-3c0110096d95 tempest-CreateVolumesFromSnapshotTest-1308629226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098.info" returned: 0 in 0.701s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:42 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-4b7443c5-c984-4fd6-b658-3c0110096d95 tempest-CreateVolumesFromSnapshotTest-1308629226 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098.info is being set with open permissions: ugo+rw Jul 08 01:55:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4b7443c5-c984-4fd6-b658-3c0110096d95 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:42 devstack sudo[104526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098.info Jul 08 01:55:42 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:43 devstack sudo[104522]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7614e27b-6b64-405d-a7e9-9353ce59c8c1 tempest-CreateVolumesFromImageTest-2115603068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df58e96d-3ab8-40ec-a97f-cc1c2f21187c" returned: 0 in 0.884s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7614e27b-6b64-405d-a7e9-9353ce59c8c1 tempest-CreateVolumesFromImageTest-2115603068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df58e96d-3ab8-40ec-a97f-cc1c2f21187c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:43 devstack sudo[104531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df58e96d-3ab8-40ec-a97f-cc1c2f21187c Jul 08 01:55:43 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:43 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4b7443c5-c984-4fd6-b658-3c0110096d95 tempest-CreateVolumesFromSnapshotTest-1308629226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098.info" returned: 0 in 0.748s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4b7443c5-c984-4fd6-b658-3c0110096d95 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.210s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.537s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:43 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d835ef96-3d5c-494b-af26-68d2886988a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c81cc5f542c40b69ca753ced723b3dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:55:30Z,use_quota=True,user_id='25298a9d19284ef296ea50c75495490a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:55:43 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Creating volume d835ef96-3d5c-494b-af26-68d2886988a5 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:55:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:43 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:55:43 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:55:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:43 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:55:43 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:55:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d835ef96-3d5c-494b-af26-68d2886988a5 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:43 devstack sudo[104534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d835ef96-3d5c-494b-af26-68d2886988a5 1073741824 Jul 08 01:55:43 devstack sudo[104534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:43 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-4b7443c5-c984-4fd6-b658-3c0110096d95 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Create snapshot completed successfully Jul 08 01:55:43 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7614e27b-6b64-405d-a7e9-9353ce59c8c1 tempest-CreateVolumesFromImageTest-2115603068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-df58e96d-3ab8-40ec-a97f-cc1c2f21187c" returned: 0 in 0.727s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:43 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-7614e27b-6b64-405d-a7e9-9353ce59c8c1 tempest-CreateVolumesFromImageTest-2115603068 None] Lock "cinder-quobyte-df58e96d-3ab8-40ec-a97f-cc1c2f21187c" released by "delete_volume" :: held 1.675s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:55:43 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-7614e27b-6b64-405d-a7e9-9353ce59c8c1 tempest-CreateVolumesFromImageTest-2115603068 None] Created reservations ['f39f36e0-b592-4aba-8aa4-098e44b95b2f', 'a8d4b877-5cfe-44fa-9c62-684d91d3ad2f', '67294a99-359b-4385-ab71-bde8743a4058', '8764498b-7f8b-4bb5-b9c8-bd68fb32ed68'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:55:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-7614e27b-6b64-405d-a7e9-9353ce59c8c1 tempest-CreateVolumesFromImageTest-2115603068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-7614e27b-6b64-405d-a7e9-9353ce59c8c1 tempest-CreateVolumesFromImageTest-2115603068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:44 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-7614e27b-6b64-405d-a7e9-9353ce59c8c1 tempest-CreateVolumesFromImageTest-2115603068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:55:44 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-7614e27b-6b64-405d-a7e9-9353ce59c8c1 tempest-CreateVolumesFromImageTest-2115603068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:55:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-7614e27b-6b64-405d-a7e9-9353ce59c8c1 tempest-CreateVolumesFromImageTest-2115603068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7614e27b-6b64-405d-a7e9-9353ce59c8c1 tempest-CreateVolumesFromImageTest-2115603068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:44 devstack sudo[104537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:55:44 devstack sudo[104537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:44 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-161e2502-2412-4d48-b9eb-bb7944625dae tempest-CreateVolumesFromImageTest-2115603068 None] Acquiring lock "cinder-4b8b9430-68e7-4a28-95d0-b60af923580a-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:55:44 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-161e2502-2412-4d48-b9eb-bb7944625dae tempest-CreateVolumesFromImageTest-2115603068 None] Lock "cinder-4b8b9430-68e7-4a28-95d0-b60af923580a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:55:44 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-161e2502-2412-4d48-b9eb-bb7944625dae tempest-CreateVolumesFromImageTest-2115603068 None] Acquiring lock "cinder-quobyte-4b8b9430-68e7-4a28-95d0-b60af923580a" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:55:44 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-161e2502-2412-4d48-b9eb-bb7944625dae tempest-CreateVolumesFromImageTest-2115603068 None] Lock "cinder-quobyte-4b8b9430-68e7-4a28-95d0-b60af923580a" acquired by "delete_volume" :: waited 0.028s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:55:44 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6a9f00-61ef-4120-8560-5e8aee4a76fc]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:55:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-161e2502-2412-4d48-b9eb-bb7944625dae tempest-CreateVolumesFromImageTest-2115603068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4b8b9430-68e7-4a28-95d0-b60af923580a {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:44 devstack sudo[104542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4b8b9430-68e7-4a28-95d0-b60af923580a Jul 08 01:55:44 devstack sudo[104542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:44 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-b18a6817-2b2b-40d8-a953-ef228d3e0333 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:55:44 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b18a6817-2b2b-40d8-a953-ef228d3e0333 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Flow 'volume_create_manager' (d58a2676-daa0-45eb-977e-8662b4c79d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:55:44 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b18a6817-2b2b-40d8-a953-ef228d3e0333 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (031d1bbd-6b02-4a77-852c-aec4ff702e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:44 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b18a6817-2b2b-40d8-a953-ef228d3e0333 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (031d1bbd-6b02-4a77-852c-aec4ff702e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1037074346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1964e503-a2bc-41b7-a7ab-065936432cd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a8f380c8b645a5a686943b4bcaad89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:55:45Z,use_quota=True,user_id='4851b20b18f9494194688ba217d4744f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:44 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b18a6817-2b2b-40d8-a953-ef228d3e0333 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf2b6e1c-6de2-49f9-88b1-c99f3feb3198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:44 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b18a6817-2b2b-40d8-a953-ef228d3e0333 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf2b6e1c-6de2-49f9-88b1-c99f3feb3198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:44 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b18a6817-2b2b-40d8-a953-ef228d3e0333 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0672c02c-7dab-4cac-8f32-147afd1c3f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:44 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b18a6817-2b2b-40d8-a953-ef228d3e0333 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0672c02c-7dab-4cac-8f32-147afd1c3f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1964e503-a2bc-41b7-a7ab-065936432cd8', 'volume_name': 'volume-1964e503-a2bc-41b7-a7ab-065936432cd8', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:44 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b18a6817-2b2b-40d8-a953-ef228d3e0333 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eddb5375-3098-40f5-b5bf-e7de916d8db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:44 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b18a6817-2b2b-40d8-a953-ef228d3e0333 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eddb5375-3098-40f5-b5bf-e7de916d8db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:44 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b18a6817-2b2b-40d8-a953-ef228d3e0333 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b6a1e9c-5c02-44a0-9c80-6454bbf4f1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:44 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-b18a6817-2b2b-40d8-a953-ef228d3e0333 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Volume 1964e503-a2bc-41b7-a7ab-065936432cd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1964e503-a2bc-41b7-a7ab-065936432cd8', 'volume_size': 1} Jul 08 01:55:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b18a6817-2b2b-40d8-a953-ef228d3e0333 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:45 devstack sudo[104537]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7614e27b-6b64-405d-a7e9-9353ce59c8c1 tempest-CreateVolumesFromImageTest-2115603068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.994s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:45 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-7614e27b-6b64-405d-a7e9-9353ce59c8c1 tempest-CreateVolumesFromImageTest-2115603068 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:55:45 devstack sudo[104534]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:45 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-7614e27b-6b64-405d-a7e9-9353ce59c8c1 tempest-CreateVolumesFromImageTest-2115603068 None] Deleted volume successfully. Jul 08 01:55:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d835ef96-3d5c-494b-af26-68d2886988a5 1073741824" returned: 0 in 1.417s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:45 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-7614e27b-6b64-405d-a7e9-9353ce59c8c1 tempest-CreateVolumesFromImageTest-2115603068 None] Lock "cinder-df58e96d-3ab8-40ec-a97f-cc1c2f21187c-delete_volume" released by "delete_volume" :: held 2.981s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:55:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d835ef96-3d5c-494b-af26-68d2886988a5 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:45 devstack sudo[104545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d835ef96-3d5c-494b-af26-68d2886988a5 Jul 08 01:55:45 devstack sudo[104545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:45 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-96fa479a-06e9-44a7-b9f2-cde52f548dbb tempest-CreateVolumesFromSnapshotTest-1308629226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:55:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-96fa479a-06e9-44a7-b9f2-cde52f548dbb tempest-CreateVolumesFromSnapshotTest-1308629226 None] Flow 'volume_create_manager' (a1adeea1-dcc8-46f1-bf0a-1f6b181efdf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:55:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-96fa479a-06e9-44a7-b9f2-cde52f548dbb tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38b47057-935c-45c5-a9d0-fe0a5cd9e238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-96fa479a-06e9-44a7-b9f2-cde52f548dbb tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38b47057-935c-45c5-a9d0-fe0a5cd9e238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-517391968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c358e221-3fdc-47a4-ab57-59e9b8f3795f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a8f380c8b645a5a686943b4bcaad89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:55:45Z,use_quota=True,user_id='4851b20b18f9494194688ba217d4744f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-96fa479a-06e9-44a7-b9f2-cde52f548dbb tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c224c601-1345-40d5-bcf1-feb1afc6eeb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-96fa479a-06e9-44a7-b9f2-cde52f548dbb tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c224c601-1345-40d5-bcf1-feb1afc6eeb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-96fa479a-06e9-44a7-b9f2-cde52f548dbb tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c177c727-2873-4ec3-a133-35d6f9cdb956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-96fa479a-06e9-44a7-b9f2-cde52f548dbb tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c177c727-2873-4ec3-a133-35d6f9cdb956) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c358e221-3fdc-47a4-ab57-59e9b8f3795f', 'volume_name': 'volume-c358e221-3fdc-47a4-ab57-59e9b8f3795f', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-96fa479a-06e9-44a7-b9f2-cde52f548dbb tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43237883-13a9-4fc2-868e-430582885c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-96fa479a-06e9-44a7-b9f2-cde52f548dbb tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43237883-13a9-4fc2-868e-430582885c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-96fa479a-06e9-44a7-b9f2-cde52f548dbb tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4e087d7-6919-4b39-9e78-53c9a934a86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:45 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-96fa479a-06e9-44a7-b9f2-cde52f548dbb tempest-CreateVolumesFromSnapshotTest-1308629226 None] Volume c358e221-3fdc-47a4-ab57-59e9b8f3795f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c358e221-3fdc-47a4-ab57-59e9b8f3795f', 'volume_size': 1} Jul 08 01:55:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-96fa479a-06e9-44a7-b9f2-cde52f548dbb tempest-CreateVolumesFromSnapshotTest-1308629226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:45 devstack sudo[104542]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-161e2502-2412-4d48-b9eb-bb7944625dae tempest-CreateVolumesFromImageTest-2115603068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4b8b9430-68e7-4a28-95d0-b60af923580a" returned: 0 in 1.171s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-161e2502-2412-4d48-b9eb-bb7944625dae tempest-CreateVolumesFromImageTest-2115603068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4b8b9430-68e7-4a28-95d0-b60af923580a {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:45 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-0671be6b-a90b-41db-933a-cb381dd087d7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:55:45 devstack sudo[104552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4b8b9430-68e7-4a28-95d0-b60af923580a Jul 08 01:55:45 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0671be6b-a90b-41db-933a-cb381dd087d7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Flow 'volume_create_manager' (d35bbe2c-7afc-4802-a73e-3f9ab3ea8e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:55:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0671be6b-a90b-41db-933a-cb381dd087d7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75dfe090-4ead-437e-9ba7-875f619113a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0671be6b-a90b-41db-933a-cb381dd087d7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75dfe090-4ead-437e-9ba7-875f619113a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1831908534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e53c5384-a879-4793-b21a-5b85caced18a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a8f380c8b645a5a686943b4bcaad89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:55:46Z,use_quota=True,user_id='4851b20b18f9494194688ba217d4744f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0671be6b-a90b-41db-933a-cb381dd087d7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4307cc0-0ac1-40e5-9347-46b99e6e323f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0671be6b-a90b-41db-933a-cb381dd087d7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4307cc0-0ac1-40e5-9347-46b99e6e323f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0671be6b-a90b-41db-933a-cb381dd087d7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a8f683b-4204-430c-a387-5a323684fe63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0671be6b-a90b-41db-933a-cb381dd087d7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a8f683b-4204-430c-a387-5a323684fe63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e53c5384-a879-4793-b21a-5b85caced18a', 'volume_name': 'volume-e53c5384-a879-4793-b21a-5b85caced18a', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0671be6b-a90b-41db-933a-cb381dd087d7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a00e67c-6622-4686-88f8-d3e80495fbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0671be6b-a90b-41db-933a-cb381dd087d7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a00e67c-6622-4686-88f8-d3e80495fbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0671be6b-a90b-41db-933a-cb381dd087d7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (169e964c-5179-47a5-bee7-debc88d90ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:45 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-0671be6b-a90b-41db-933a-cb381dd087d7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Volume e53c5384-a879-4793-b21a-5b85caced18a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e53c5384-a879-4793-b21a-5b85caced18a', 'volume_size': 1} Jul 08 01:55:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0671be6b-a90b-41db-933a-cb381dd087d7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:46 devstack sudo[104545]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d835ef96-3d5c-494b-af26-68d2886988a5" returned: 0 in 0.958s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:46 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] <== create_volume: return (2439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:55:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.443s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.128s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:46 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c1141c3-31a8-4118-8f7b-3e65763761db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f68fd7d8bf74027ab49d40723b602e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:55:32Z,use_quota=True,user_id='b8a5c4af3f8445949c5de1975c3e5aa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea1dc1f6-9529-47ec-aea1-0260c8603511),volume_type_id=ea1dc1f6-9529-47ec-aea1-0260c8603511)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:55:46 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Creating volume 8c1141c3-31a8-4118-8f7b-3e65763761db {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:55:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:46 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:55:46 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:55:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:46 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:55:46 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:55:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8c1141c3-31a8-4118-8f7b-3e65763761db 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:46 devstack sudo[104555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8c1141c3-31a8-4118-8f7b-3e65763761db 1073741824 Jul 08 01:55:46 devstack sudo[104555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:46 devstack cinder-volume[87284]: DEBUG cinder.volume.volume_utils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Attempting download of b89ee2e1-9ef6-4298-a35b-27978b4ebea7 ((None, [{'url': 'file:///opt/stack/data/glance/images/b89ee2e1-9ef6-4298-a35b-27978b4ebea7', 'metadata': {}}])) to volume d835ef96-3d5c-494b-af26-68d2886988a5. {{(pid=87284) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:55:46 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[7741e138-0d5e-4fc2-a054-21eb60659b8c]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:55:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b89ee2e1-9ef6-4298-a35b-27978b4ebea7_2105botr {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:46 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-02643a86-a2a1-45df-85f6-827d7a2202a1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:55:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-02643a86-a2a1-45df-85f6-827d7a2202a1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Flow 'volume_create_manager' (dc7bb95f-1e4e-45dd-8895-4e604038df75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:55:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-02643a86-a2a1-45df-85f6-827d7a2202a1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af24804a-dff4-4358-a875-f45c237726b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:46 devstack sudo[104557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b89ee2e1-9ef6-4298-a35b-27978b4ebea7_2105botr Jul 08 01:55:46 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-02643a86-a2a1-45df-85f6-827d7a2202a1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af24804a-dff4-4358-a875-f45c237726b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-990950063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14259efb-1c38-46a3-9924-dffd830ae953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a8f380c8b645a5a686943b4bcaad89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:55:46Z,use_quota=True,user_id='4851b20b18f9494194688ba217d4744f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-02643a86-a2a1-45df-85f6-827d7a2202a1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6acaa7b0-b8bd-4c75-af47-95d2a46972a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-02643a86-a2a1-45df-85f6-827d7a2202a1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6acaa7b0-b8bd-4c75-af47-95d2a46972a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-02643a86-a2a1-45df-85f6-827d7a2202a1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d614af67-d92d-46ae-917d-13b80b27b56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-02643a86-a2a1-45df-85f6-827d7a2202a1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d614af67-d92d-46ae-917d-13b80b27b56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14259efb-1c38-46a3-9924-dffd830ae953', 'volume_name': 'volume-14259efb-1c38-46a3-9924-dffd830ae953', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-02643a86-a2a1-45df-85f6-827d7a2202a1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8021ee4-8289-423d-8e1c-fac69bedc942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-02643a86-a2a1-45df-85f6-827d7a2202a1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8021ee4-8289-423d-8e1c-fac69bedc942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-02643a86-a2a1-45df-85f6-827d7a2202a1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e2c8bca-82e3-46b4-98a4-1dc51441ea58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:46 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-02643a86-a2a1-45df-85f6-827d7a2202a1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Volume 14259efb-1c38-46a3-9924-dffd830ae953: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14259efb-1c38-46a3-9924-dffd830ae953', 'volume_size': 1} Jul 08 01:55:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-02643a86-a2a1-45df-85f6-827d7a2202a1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:46 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-161e2502-2412-4d48-b9eb-bb7944625dae tempest-CreateVolumesFromImageTest-2115603068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4b8b9430-68e7-4a28-95d0-b60af923580a" returned: 0 in 0.976s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:46 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-161e2502-2412-4d48-b9eb-bb7944625dae tempest-CreateVolumesFromImageTest-2115603068 None] Lock "cinder-quobyte-4b8b9430-68e7-4a28-95d0-b60af923580a" released by "delete_volume" :: held 2.222s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:55:46 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-161e2502-2412-4d48-b9eb-bb7944625dae tempest-CreateVolumesFromImageTest-2115603068 None] Created reservations ['7965fc85-ff7e-4d28-b9e5-15421d1c6c26', 'd1dd9d29-876e-4a4e-b031-3e162d094730', '32ca3729-0d15-49b6-ba2f-07dd86d6a0f0', 'c701bb03-1504-4c38-a49c-8e8958eb1d73'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:55:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-161e2502-2412-4d48-b9eb-bb7944625dae tempest-CreateVolumesFromImageTest-2115603068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-161e2502-2412-4d48-b9eb-bb7944625dae tempest-CreateVolumesFromImageTest-2115603068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:47 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-161e2502-2412-4d48-b9eb-bb7944625dae tempest-CreateVolumesFromImageTest-2115603068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:55:47 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-161e2502-2412-4d48-b9eb-bb7944625dae tempest-CreateVolumesFromImageTest-2115603068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:55:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-161e2502-2412-4d48-b9eb-bb7944625dae tempest-CreateVolumesFromImageTest-2115603068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-161e2502-2412-4d48-b9eb-bb7944625dae tempest-CreateVolumesFromImageTest-2115603068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:47 devstack sudo[104563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:55:47 devstack sudo[104563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:47 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-18f9942e-d4f1-4de7-bbb4-0bfac9f60285 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:55:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-18f9942e-d4f1-4de7-bbb4-0bfac9f60285 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Flow 'volume_create_manager' (20be1420-8899-4b34-bac4-8a263c4f1dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:55:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-18f9942e-d4f1-4de7-bbb4-0bfac9f60285 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b77a6240-ab94-472c-a62a-713f290d7887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-18f9942e-d4f1-4de7-bbb4-0bfac9f60285 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b77a6240-ab94-472c-a62a-713f290d7887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1361667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccca81d7-aa8e-41a9-ab27-3aa030a55297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a8f380c8b645a5a686943b4bcaad89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:55:47Z,use_quota=True,user_id='4851b20b18f9494194688ba217d4744f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-18f9942e-d4f1-4de7-bbb4-0bfac9f60285 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc398520-91b3-4a52-bc32-57f1cead53a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-18f9942e-d4f1-4de7-bbb4-0bfac9f60285 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc398520-91b3-4a52-bc32-57f1cead53a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-18f9942e-d4f1-4de7-bbb4-0bfac9f60285 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9610f9e1-fc21-48dc-beca-7ed7983d6431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-18f9942e-d4f1-4de7-bbb4-0bfac9f60285 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9610f9e1-fc21-48dc-beca-7ed7983d6431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccca81d7-aa8e-41a9-ab27-3aa030a55297', 'volume_name': 'volume-ccca81d7-aa8e-41a9-ab27-3aa030a55297', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-18f9942e-d4f1-4de7-bbb4-0bfac9f60285 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (090219ee-0acc-44a2-b792-01cd9d7e4e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-18f9942e-d4f1-4de7-bbb4-0bfac9f60285 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (090219ee-0acc-44a2-b792-01cd9d7e4e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-18f9942e-d4f1-4de7-bbb4-0bfac9f60285 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bac29cf1-0803-4ac0-abb3-fd38166e61fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:47 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-18f9942e-d4f1-4de7-bbb4-0bfac9f60285 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Volume ccca81d7-aa8e-41a9-ab27-3aa030a55297: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccca81d7-aa8e-41a9-ab27-3aa030a55297', 'volume_size': 1} Jul 08 01:55:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-18f9942e-d4f1-4de7-bbb4-0bfac9f60285 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:47 devstack sudo[104555]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8c1141c3-31a8-4118-8f7b-3e65763761db 1073741824" returned: 0 in 1.294s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8c1141c3-31a8-4118-8f7b-3e65763761db {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:47 devstack sudo[104568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8c1141c3-31a8-4118-8f7b-3e65763761db Jul 08 01:55:47 devstack sudo[104568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:47 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b89ee2e1-9ef6-4298-a35b-27978b4ebea7_2105botr" returned: 0 in 1.219s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b89ee2e1-9ef6-4298-a35b-27978b4ebea7_2105botr {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:47 devstack sudo[104570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b89ee2e1-9ef6-4298-a35b-27978b4ebea7_2105botr Jul 08 01:55:47 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:47 devstack sudo[104563]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-161e2502-2412-4d48-b9eb-bb7944625dae tempest-CreateVolumesFromImageTest-2115603068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.815s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:47 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-161e2502-2412-4d48-b9eb-bb7944625dae tempest-CreateVolumesFromImageTest-2115603068 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:55:47 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-161e2502-2412-4d48-b9eb-bb7944625dae tempest-CreateVolumesFromImageTest-2115603068 None] Deleted volume successfully. Jul 08 01:55:47 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-161e2502-2412-4d48-b9eb-bb7944625dae tempest-CreateVolumesFromImageTest-2115603068 None] Lock "cinder-4b8b9430-68e7-4a28-95d0-b60af923580a-delete_volume" released by "delete_volume" :: held 3.517s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:55:48 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-23b58dbd-02ae-4a82-8532-910b5577eb73 tempest-CreateVolumesFromImageTest-2115603068 None] Acquiring lock "cinder-a1d56551-8817-4886-8fd1-185d12fd69b3-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:55:48 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-23b58dbd-02ae-4a82-8532-910b5577eb73 tempest-CreateVolumesFromImageTest-2115603068 None] Lock "cinder-a1d56551-8817-4886-8fd1-185d12fd69b3-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:55:48 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-23b58dbd-02ae-4a82-8532-910b5577eb73 tempest-CreateVolumesFromImageTest-2115603068 None] Acquiring lock "cinder-quobyte-a1d56551-8817-4886-8fd1-185d12fd69b3" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:55:48 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-23b58dbd-02ae-4a82-8532-910b5577eb73 tempest-CreateVolumesFromImageTest-2115603068 None] Lock "cinder-quobyte-a1d56551-8817-4886-8fd1-185d12fd69b3" acquired by "delete_volume" :: waited 0.026s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:55:48 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[778719c0-15ca-4fab-ba2f-f5414586eea5]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:55:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-23b58dbd-02ae-4a82-8532-910b5577eb73 tempest-CreateVolumesFromImageTest-2115603068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a1d56551-8817-4886-8fd1-185d12fd69b3 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:48 devstack sudo[104568]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8c1141c3-31a8-4118-8f7b-3e65763761db" returned: 0 in 0.870s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:48 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] <== create_volume: return (2219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:55:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.223s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b18a6817-2b2b-40d8-a953-ef228d3e0333 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.349s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:48 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b18a6817-2b2b-40d8-a953-ef228d3e0333 tempest-CreateVolumesFromSnapshotTest-1308629226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1037074346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1964e503-a2bc-41b7-a7ab-065936432cd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a8f380c8b645a5a686943b4bcaad89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:55:45Z,use_quota=True,user_id='4851b20b18f9494194688ba217d4744f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:55:48 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-b18a6817-2b2b-40d8-a953-ef228d3e0333 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Creating volume 1964e503-a2bc-41b7-a7ab-065936432cd8 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:55:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b18a6817-2b2b-40d8-a953-ef228d3e0333 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b18a6817-2b2b-40d8-a953-ef228d3e0333 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:48 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b18a6817-2b2b-40d8-a953-ef228d3e0333 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:55:48 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b18a6817-2b2b-40d8-a953-ef228d3e0333 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:55:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b18a6817-2b2b-40d8-a953-ef228d3e0333 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:48 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b18a6817-2b2b-40d8-a953-ef228d3e0333 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:55:48 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-b18a6817-2b2b-40d8-a953-ef228d3e0333 tempest-CreateVolumesFromSnapshotTest-1308629226 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:55:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b18a6817-2b2b-40d8-a953-ef228d3e0333 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1964e503-a2bc-41b7-a7ab-065936432cd8 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:48 devstack sudo[104574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a1d56551-8817-4886-8fd1-185d12fd69b3 Jul 08 01:55:48 devstack sudo[104574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:48 devstack sudo[104578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1964e503-a2bc-41b7-a7ab-065936432cd8 1073741824 Jul 08 01:55:48 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:48 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:48 devstack cinder-volume[87284]: DEBUG cinder.volume.volume_utils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Attempting download of b4064015-e677-46e8-b969-07e5e081b0ff ((None, [{'url': 'file:///opt/stack/data/glance/images/b4064015-e677-46e8-b969-07e5e081b0ff', 'metadata': {}}])) to volume 8c1141c3-31a8-4118-8f7b-3e65763761db. {{(pid=87284) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:55:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b89ee2e1-9ef6-4298-a35b-27978b4ebea7_2105botr" returned: 1 in 0.881s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b89ee2e1-9ef6-4298-a35b-27978b4ebea7_2105botr' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:55:48 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[12917789-cead-4b72-bc18-4f242820f6f8]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:55:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b89ee2e1-9ef6-4298-a35b-27978b4ebea7_ea55e9r_devstack@QuobyteHD {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:48 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f54381-dcd9-44cc-9492-429b97c218d0]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:55:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4064015-e677-46e8-b969-07e5e081b0ff__2gzpg96 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:48 devstack sudo[104580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b89ee2e1-9ef6-4298-a35b-27978b4ebea7_ea55e9r_devstack@QuobyteHD Jul 08 01:55:48 devstack sudo[104580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:48 devstack sudo[104581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4064015-e677-46e8-b969-07e5e081b0ff__2gzpg96 Jul 08 01:55:48 devstack sudo[104581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:49 devstack sudo[104574]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-23b58dbd-02ae-4a82-8532-910b5577eb73 tempest-CreateVolumesFromImageTest-2115603068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a1d56551-8817-4886-8fd1-185d12fd69b3" returned: 0 in 0.907s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-23b58dbd-02ae-4a82-8532-910b5577eb73 tempest-CreateVolumesFromImageTest-2115603068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a1d56551-8817-4886-8fd1-185d12fd69b3 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:49 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a1d56551-8817-4886-8fd1-185d12fd69b3 Jul 08 01:55:49 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:49 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b18a6817-2b2b-40d8-a953-ef228d3e0333 tempest-CreateVolumesFromSnapshotTest-1308629226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1964e503-a2bc-41b7-a7ab-065936432cd8 1073741824" returned: 0 in 0.978s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b18a6817-2b2b-40d8-a953-ef228d3e0333 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1964e503-a2bc-41b7-a7ab-065936432cd8 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:49 devstack sudo[104598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1964e503-a2bc-41b7-a7ab-065936432cd8 Jul 08 01:55:49 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:49 devstack sudo[104581]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4064015-e677-46e8-b969-07e5e081b0ff__2gzpg96" returned: 0 in 0.977s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4064015-e677-46e8-b969-07e5e081b0ff__2gzpg96 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:49 devstack sudo[104580]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b89ee2e1-9ef6-4298-a35b-27978b4ebea7_ea55e9r_devstack@QuobyteHD" returned: 0 in 1.055s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b89ee2e1-9ef6-4298-a35b-27978b4ebea7_ea55e9r_devstack@QuobyteHD {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:49 devstack sudo[104600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4064015-e677-46e8-b969-07e5e081b0ff__2gzpg96 Jul 08 01:55:49 devstack sudo[104600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:49 devstack sudo[104601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b89ee2e1-9ef6-4298-a35b-27978b4ebea7_ea55e9r_devstack@QuobyteHD Jul 08 01:55:49 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:49 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-23b58dbd-02ae-4a82-8532-910b5577eb73 tempest-CreateVolumesFromImageTest-2115603068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a1d56551-8817-4886-8fd1-185d12fd69b3" returned: 0 in 0.808s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:49 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-23b58dbd-02ae-4a82-8532-910b5577eb73 tempest-CreateVolumesFromImageTest-2115603068 None] Lock "cinder-quobyte-a1d56551-8817-4886-8fd1-185d12fd69b3" released by "delete_volume" :: held 1.776s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:55:49 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-23b58dbd-02ae-4a82-8532-910b5577eb73 tempest-CreateVolumesFromImageTest-2115603068 None] Created reservations ['41ceb0c1-7d75-4923-bc52-1ae5f51c13c8', '851b568e-8256-4bef-bddd-1d6e75c9bfba', '87ea9a35-7412-4675-b2be-c2927931f6a8', '8ac6495d-a1d0-41fb-b1e4-0595d10dbc28'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:55:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-23b58dbd-02ae-4a82-8532-910b5577eb73 tempest-CreateVolumesFromImageTest-2115603068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-23b58dbd-02ae-4a82-8532-910b5577eb73 tempest-CreateVolumesFromImageTest-2115603068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-23b58dbd-02ae-4a82-8532-910b5577eb73 tempest-CreateVolumesFromImageTest-2115603068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:55:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-23b58dbd-02ae-4a82-8532-910b5577eb73 tempest-CreateVolumesFromImageTest-2115603068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:55:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-23b58dbd-02ae-4a82-8532-910b5577eb73 tempest-CreateVolumesFromImageTest-2115603068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-23b58dbd-02ae-4a82-8532-910b5577eb73 tempest-CreateVolumesFromImageTest-2115603068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:50 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:55:50 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:50 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b18a6817-2b2b-40d8-a953-ef228d3e0333 tempest-CreateVolumesFromSnapshotTest-1308629226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1964e503-a2bc-41b7-a7ab-065936432cd8" returned: 0 in 0.825s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b18a6817-2b2b-40d8-a953-ef228d3e0333 tempest-CreateVolumesFromSnapshotTest-1308629226 None] <== create_volume: return (1870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:55:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b18a6817-2b2b-40d8-a953-ef228d3e0333 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.874s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-96fa479a-06e9-44a7-b9f2-cde52f548dbb tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.745s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-96fa479a-06e9-44a7-b9f2-cde52f548dbb tempest-CreateVolumesFromSnapshotTest-1308629226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-517391968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c358e221-3fdc-47a4-ab57-59e9b8f3795f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a8f380c8b645a5a686943b4bcaad89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:55:45Z,use_quota=True,user_id='4851b20b18f9494194688ba217d4744f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:55:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-96fa479a-06e9-44a7-b9f2-cde52f548dbb tempest-CreateVolumesFromSnapshotTest-1308629226 None] Creating volume c358e221-3fdc-47a4-ab57-59e9b8f3795f {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:55:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-96fa479a-06e9-44a7-b9f2-cde52f548dbb tempest-CreateVolumesFromSnapshotTest-1308629226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-96fa479a-06e9-44a7-b9f2-cde52f548dbb tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-96fa479a-06e9-44a7-b9f2-cde52f548dbb tempest-CreateVolumesFromSnapshotTest-1308629226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:55:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-96fa479a-06e9-44a7-b9f2-cde52f548dbb tempest-CreateVolumesFromSnapshotTest-1308629226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:55:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-96fa479a-06e9-44a7-b9f2-cde52f548dbb tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-96fa479a-06e9-44a7-b9f2-cde52f548dbb tempest-CreateVolumesFromSnapshotTest-1308629226 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:55:50 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-96fa479a-06e9-44a7-b9f2-cde52f548dbb tempest-CreateVolumesFromSnapshotTest-1308629226 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:55:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-96fa479a-06e9-44a7-b9f2-cde52f548dbb tempest-CreateVolumesFromSnapshotTest-1308629226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c358e221-3fdc-47a4-ab57-59e9b8f3795f 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b18a6817-2b2b-40d8-a953-ef228d3e0333 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b6a1e9c-5c02-44a0-9c80-6454bbf4f1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1964e503-a2bc-41b7-a7ab-065936432cd8', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:50 devstack sudo[104610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c358e221-3fdc-47a4-ab57-59e9b8f3795f 1073741824 Jul 08 01:55:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b18a6817-2b2b-40d8-a953-ef228d3e0333 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (677de557-9e81-44e8-90ef-ce8a75c90d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:50 devstack sudo[104600]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:50 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4064015-e677-46e8-b969-07e5e081b0ff__2gzpg96" returned: 1 in 0.874s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4064015-e677-46e8-b969-07e5e081b0ff__2gzpg96' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:55:50 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[db68603f-9cab-4c79-916c-21a36fc1aa57]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:55:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4064015-e677-46e8-b969-07e5e081b0ff_43mmrikkdevstack@QuobyteHD {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:50 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-b18a6817-2b2b-40d8-a953-ef228d3e0333 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Volume volume-1964e503-a2bc-41b7-a7ab-065936432cd8 (1964e503-a2bc-41b7-a7ab-065936432cd8): created successfully Jul 08 01:55:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b18a6817-2b2b-40d8-a953-ef228d3e0333 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (677de557-9e81-44e8-90ef-ce8a75c90d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b18a6817-2b2b-40d8-a953-ef228d3e0333 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Flow 'volume_create_manager' (d58a2676-daa0-45eb-977e-8662b4c79d43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:55:50 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c9979a05-aa55-44ce-9032-f2662540d9f9 tempest-CreateVolumesFromImageTest-2115603068 None] Acquiring lock "cinder-7db3a0a0-5964-4bc1-a5f3-aa10391a7bf3-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:55:50 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-b18a6817-2b2b-40d8-a953-ef228d3e0333 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Created volume successfully. Jul 08 01:55:50 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b89ee2e1-9ef6-4298-a35b-27978b4ebea7_ea55e9r_devstack@QuobyteHD" returned: 1 in 1.040s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b89ee2e1-9ef6-4298-a35b-27978b4ebea7_ea55e9r_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:55:50 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] b89ee2e1-9ef6-4298-a35b-27978b4ebea7 was raw, converting to raw {{(pid=87284) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:55:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b89ee2e1-9ef6-4298-a35b-27978b4ebea7_ea55e9r_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d835ef96-3d5c-494b-af26-68d2886988a5 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:50 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c9979a05-aa55-44ce-9032-f2662540d9f9 tempest-CreateVolumesFromImageTest-2115603068 None] Lock "cinder-7db3a0a0-5964-4bc1-a5f3-aa10391a7bf3-delete_volume" acquired by "delete_volume" :: waited 0.123s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:55:50 devstack sudo[104615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4064015-e677-46e8-b969-07e5e081b0ff_43mmrikkdevstack@QuobyteHD Jul 08 01:55:50 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:50 devstack sudo[104616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b89ee2e1-9ef6-4298-a35b-27978b4ebea7_ea55e9r_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d835ef96-3d5c-494b-af26-68d2886988a5 Jul 08 01:55:50 devstack sudo[104616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:50 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c9979a05-aa55-44ce-9032-f2662540d9f9 tempest-CreateVolumesFromImageTest-2115603068 None] Acquiring lock "cinder-quobyte-7db3a0a0-5964-4bc1-a5f3-aa10391a7bf3" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:55:50 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c9979a05-aa55-44ce-9032-f2662540d9f9 tempest-CreateVolumesFromImageTest-2115603068 None] Lock "cinder-quobyte-7db3a0a0-5964-4bc1-a5f3-aa10391a7bf3" acquired by "delete_volume" :: waited 0.019s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:55:50 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1190e30-8865-4c02-978b-b500b96fec6d]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:55:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c9979a05-aa55-44ce-9032-f2662540d9f9 tempest-CreateVolumesFromImageTest-2115603068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7db3a0a0-5964-4bc1-a5f3-aa10391a7bf3 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:50 devstack sudo[104619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7db3a0a0-5964-4bc1-a5f3-aa10391a7bf3 Jul 08 01:55:50 devstack sudo[104619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:51 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-23b58dbd-02ae-4a82-8532-910b5577eb73 tempest-CreateVolumesFromImageTest-2115603068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.006s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:51 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-23b58dbd-02ae-4a82-8532-910b5577eb73 tempest-CreateVolumesFromImageTest-2115603068 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:55:51 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-23b58dbd-02ae-4a82-8532-910b5577eb73 tempest-CreateVolumesFromImageTest-2115603068 None] Deleted volume successfully. Jul 08 01:55:51 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-23b58dbd-02ae-4a82-8532-910b5577eb73 tempest-CreateVolumesFromImageTest-2115603068 None] Lock "cinder-a1d56551-8817-4886-8fd1-185d12fd69b3-delete_volume" released by "delete_volume" :: held 3.122s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:55:51 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4064015-e677-46e8-b969-07e5e081b0ff_43mmrikkdevstack@QuobyteHD" returned: 0 in 1.191s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4064015-e677-46e8-b969-07e5e081b0ff_43mmrikkdevstack@QuobyteHD {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:51 devstack sudo[104616]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b89ee2e1-9ef6-4298-a35b-27978b4ebea7_ea55e9r_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d835ef96-3d5c-494b-af26-68d2886988a5" returned: 0 in 1.019s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:51 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b89ee2e1-9ef6-4298-a35b-27978b4ebea7_ea55e9r_devstack@QuobyteHD, size 0.00 MB, duration 1.02 sec, destination /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d835ef96-3d5c-494b-af26-68d2886988a5 {{(pid=87284) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:55:51 devstack cinder-volume[87284]: INFO cinder.image.image_utils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 01:55:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d835ef96-3d5c-494b-af26-68d2886988a5 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:51 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-96fa479a-06e9-44a7-b9f2-cde52f548dbb tempest-CreateVolumesFromSnapshotTest-1308629226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c358e221-3fdc-47a4-ab57-59e9b8f3795f 1073741824" returned: 0 in 1.378s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:51 devstack sudo[104632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d835ef96-3d5c-494b-af26-68d2886988a5 1G Jul 08 01:55:51 devstack sudo[104632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-96fa479a-06e9-44a7-b9f2-cde52f548dbb tempest-CreateVolumesFromSnapshotTest-1308629226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c358e221-3fdc-47a4-ab57-59e9b8f3795f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:51 devstack sudo[104631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4064015-e677-46e8-b969-07e5e081b0ff_43mmrikkdevstack@QuobyteHD Jul 08 01:55:51 devstack sudo[104631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:51 devstack sudo[104634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c358e221-3fdc-47a4-ab57-59e9b8f3795f Jul 08 01:55:51 devstack sudo[104634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:51 devstack sudo[104619]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c9979a05-aa55-44ce-9032-f2662540d9f9 tempest-CreateVolumesFromImageTest-2115603068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7db3a0a0-5964-4bc1-a5f3-aa10391a7bf3" returned: 0 in 1.189s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c9979a05-aa55-44ce-9032-f2662540d9f9 tempest-CreateVolumesFromImageTest-2115603068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7db3a0a0-5964-4bc1-a5f3-aa10391a7bf3 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:51 devstack sudo[104640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7db3a0a0-5964-4bc1-a5f3-aa10391a7bf3 Jul 08 01:55:51 devstack sudo[104640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:52 devstack sudo[104634]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-96fa479a-06e9-44a7-b9f2-cde52f548dbb tempest-CreateVolumesFromSnapshotTest-1308629226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c358e221-3fdc-47a4-ab57-59e9b8f3795f" returned: 0 in 0.766s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-96fa479a-06e9-44a7-b9f2-cde52f548dbb tempest-CreateVolumesFromSnapshotTest-1308629226 None] <== create_volume: return (2251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:55:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-96fa479a-06e9-44a7-b9f2-cde52f548dbb tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.256s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:52 devstack sudo[104631]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0671be6b-a90b-41db-933a-cb381dd087d7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.522s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0671be6b-a90b-41db-933a-cb381dd087d7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1831908534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e53c5384-a879-4793-b21a-5b85caced18a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a8f380c8b645a5a686943b4bcaad89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:55:46Z,use_quota=True,user_id='4851b20b18f9494194688ba217d4744f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:55:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-0671be6b-a90b-41db-933a-cb381dd087d7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Creating volume e53c5384-a879-4793-b21a-5b85caced18a {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:55:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0671be6b-a90b-41db-933a-cb381dd087d7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0671be6b-a90b-41db-933a-cb381dd087d7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0671be6b-a90b-41db-933a-cb381dd087d7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:55:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0671be6b-a90b-41db-933a-cb381dd087d7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:55:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0671be6b-a90b-41db-933a-cb381dd087d7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0671be6b-a90b-41db-933a-cb381dd087d7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:55:52 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-0671be6b-a90b-41db-933a-cb381dd087d7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:55:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0671be6b-a90b-41db-933a-cb381dd087d7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-e53c5384-a879-4793-b21a-5b85caced18a 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:52 devstack sudo[104632]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4064015-e677-46e8-b969-07e5e081b0ff_43mmrikkdevstack@QuobyteHD" returned: 1 in 0.969s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4064015-e677-46e8-b969-07e5e081b0ff_43mmrikkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:55:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d835ef96-3d5c-494b-af26-68d2886988a5 1G" returned: 0 in 0.943s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:52 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] b4064015-e677-46e8-b969-07e5e081b0ff was raw, converting to raw {{(pid=87284) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:55:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b4064015-e677-46e8-b969-07e5e081b0ff_43mmrikkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8c1141c3-31a8-4118-8f7b-3e65763761db {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:52 devstack sudo[104649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-e53c5384-a879-4793-b21a-5b85caced18a 1073741824 Jul 08 01:55:52 devstack sudo[104649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:52 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-96fa479a-06e9-44a7-b9f2-cde52f548dbb tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4e087d7-6919-4b39-9e78-53c9a934a86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c358e221-3fdc-47a4-ab57-59e9b8f3795f', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:52 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-96fa479a-06e9-44a7-b9f2-cde52f548dbb tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ef4eaf-391f-482c-ad8f-ce728caae7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:52 devstack sudo[104651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b4064015-e677-46e8-b969-07e5e081b0ff_43mmrikkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8c1141c3-31a8-4118-8f7b-3e65763761db Jul 08 01:55:52 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:52 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-96fa479a-06e9-44a7-b9f2-cde52f548dbb tempest-CreateVolumesFromSnapshotTest-1308629226 None] Volume volume-c358e221-3fdc-47a4-ab57-59e9b8f3795f (c358e221-3fdc-47a4-ab57-59e9b8f3795f): created successfully Jul 08 01:55:52 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-96fa479a-06e9-44a7-b9f2-cde52f548dbb tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ef4eaf-391f-482c-ad8f-ce728caae7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:52 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-96fa479a-06e9-44a7-b9f2-cde52f548dbb tempest-CreateVolumesFromSnapshotTest-1308629226 None] Flow 'volume_create_manager' (a1adeea1-dcc8-46f1-bf0a-1f6b181efdf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:55:52 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6063a2-6c93-448d-ba52-cb0c81fa2c11]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:55:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d835ef96-3d5c-494b-af26-68d2886988a5 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:52 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-96fa479a-06e9-44a7-b9f2-cde52f548dbb tempest-CreateVolumesFromSnapshotTest-1308629226 None] Created volume successfully. Jul 08 01:55:52 devstack sudo[104640]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c9979a05-aa55-44ce-9032-f2662540d9f9 tempest-CreateVolumesFromImageTest-2115603068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7db3a0a0-5964-4bc1-a5f3-aa10391a7bf3" returned: 0 in 0.735s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:52 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c9979a05-aa55-44ce-9032-f2662540d9f9 tempest-CreateVolumesFromImageTest-2115603068 None] Lock "cinder-quobyte-7db3a0a0-5964-4bc1-a5f3-aa10391a7bf3" released by "delete_volume" :: held 1.972s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:55:52 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-c9979a05-aa55-44ce-9032-f2662540d9f9 tempest-CreateVolumesFromImageTest-2115603068 None] Created reservations ['ede8f2f2-5004-44dd-b8dd-b403f54d1dd1', 'b64c93f4-41bc-4c38-b5c6-7a6ec8f58ab3', '19d25def-ac87-431f-9fa7-0ddd3033f589', '95b8fb21-72ce-4af8-94d3-0ed4d13097ef'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:55:52 devstack sudo[104654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d835ef96-3d5c-494b-af26-68d2886988a5 Jul 08 01:55:52 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c9979a05-aa55-44ce-9032-f2662540d9f9 tempest-CreateVolumesFromImageTest-2115603068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c9979a05-aa55-44ce-9032-f2662540d9f9 tempest-CreateVolumesFromImageTest-2115603068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c9979a05-aa55-44ce-9032-f2662540d9f9 tempest-CreateVolumesFromImageTest-2115603068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:55:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c9979a05-aa55-44ce-9032-f2662540d9f9 tempest-CreateVolumesFromImageTest-2115603068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:55:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c9979a05-aa55-44ce-9032-f2662540d9f9 tempest-CreateVolumesFromImageTest-2115603068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c9979a05-aa55-44ce-9032-f2662540d9f9 tempest-CreateVolumesFromImageTest-2115603068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:52 devstack sudo[104656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:55:52 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:53 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b4064015-e677-46e8-b969-07e5e081b0ff_43mmrikkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8c1141c3-31a8-4118-8f7b-3e65763761db" returned: 0 in 1.265s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:53 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b4064015-e677-46e8-b969-07e5e081b0ff_43mmrikkdevstack@QuobyteHD, size 0.00 MB, duration 1.27 sec, destination /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8c1141c3-31a8-4118-8f7b-3e65763761db {{(pid=87284) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:55:53 devstack cinder-volume[87284]: INFO cinder.image.image_utils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 01:55:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8c1141c3-31a8-4118-8f7b-3e65763761db 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:53 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d835ef96-3d5c-494b-af26-68d2886988a5" returned: 0 in 1.223s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d835ef96-3d5c-494b-af26-68d2886988a5 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:53 devstack sudo[104668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8c1141c3-31a8-4118-8f7b-3e65763761db 1G Jul 08 01:55:53 devstack sudo[104668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:53 devstack sudo[104649]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0671be6b-a90b-41db-933a-cb381dd087d7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-e53c5384-a879-4793-b21a-5b85caced18a 1073741824" returned: 0 in 1.392s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0671be6b-a90b-41db-933a-cb381dd087d7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-e53c5384-a879-4793-b21a-5b85caced18a {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:53 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d835ef96-3d5c-494b-af26-68d2886988a5 Jul 08 01:55:53 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:54 devstack sudo[104673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-e53c5384-a879-4793-b21a-5b85caced18a Jul 08 01:55:54 devstack sudo[104673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:54 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c9979a05-aa55-44ce-9032-f2662540d9f9 tempest-CreateVolumesFromImageTest-2115603068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.183s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:54 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-c9979a05-aa55-44ce-9032-f2662540d9f9 tempest-CreateVolumesFromImageTest-2115603068 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:55:54 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-c9979a05-aa55-44ce-9032-f2662540d9f9 tempest-CreateVolumesFromImageTest-2115603068 None] Deleted volume successfully. Jul 08 01:55:54 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c9979a05-aa55-44ce-9032-f2662540d9f9 tempest-CreateVolumesFromImageTest-2115603068 None] Lock "cinder-7db3a0a0-5964-4bc1-a5f3-aa10391a7bf3-delete_volume" released by "delete_volume" :: held 3.743s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:55:54 devstack sudo[104668]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8c1141c3-31a8-4118-8f7b-3e65763761db 1G" returned: 0 in 1.042s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:54 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd51ceb9-1713-4987-8bb8-eb5ae8efbbc1]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:55:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8c1141c3-31a8-4118-8f7b-3e65763761db {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:54 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d835ef96-3d5c-494b-af26-68d2886988a5" returned: 1 in 1.164s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d835ef96-3d5c-494b-af26-68d2886988a5' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:55:54 devstack cinder-volume[87284]: DEBUG cinder.volume.volume_utils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Downloaded image b89ee2e1-9ef6-4298-a35b-27978b4ebea7 ((None, [{'url': 'file:///opt/stack/data/glance/images/b89ee2e1-9ef6-4298-a35b-27978b4ebea7', 'metadata': {}}])) to volume d835ef96-3d5c-494b-af26-68d2886988a5 successfully. {{(pid=87284) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:55:54 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Temporary image b89ee2e1-9ef6-4298-a35b-27978b4ebea7 for user 25298a9d19284ef296ea50c75495490a is deleted. {{(pid=87284) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:55:54 devstack cinder-volume[87284]: DEBUG cinder.volume.volume_utils [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Marking volume d835ef96-3d5c-494b-af26-68d2886988a5 as bootable. {{(pid=87284) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:55:55 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Copying metadata from image b89ee2e1-9ef6-4298-a35b-27978b4ebea7 to d835ef96-3d5c-494b-af26-68d2886988a5. {{(pid=87284) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:55:55 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Creating volume glance metadata for volume d835ef96-3d5c-494b-af26-68d2886988a5 backed by image b89ee2e1-9ef6-4298-a35b-27978b4ebea7 with: {'image_id': 'b89ee2e1-9ef6-4298-a35b-27978b4ebea7', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '1ef276b8c213d8e91e592f2fd0b75d7f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87284) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:55:55 devstack sudo[104673]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0671be6b-a90b-41db-933a-cb381dd087d7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-e53c5384-a879-4793-b21a-5b85caced18a" returned: 0 in 1.105s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0671be6b-a90b-41db-933a-cb381dd087d7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] <== create_volume: return (2603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:55:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0671be6b-a90b-41db-933a-cb381dd087d7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.606s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-02643a86-a2a1-45df-85f6-827d7a2202a1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.521s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-02643a86-a2a1-45df-85f6-827d7a2202a1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-990950063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14259efb-1c38-46a3-9924-dffd830ae953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a8f380c8b645a5a686943b4bcaad89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:55:46Z,use_quota=True,user_id='4851b20b18f9494194688ba217d4744f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:55:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-02643a86-a2a1-45df-85f6-827d7a2202a1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Creating volume 14259efb-1c38-46a3-9924-dffd830ae953 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:55:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-02643a86-a2a1-45df-85f6-827d7a2202a1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-02643a86-a2a1-45df-85f6-827d7a2202a1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-02643a86-a2a1-45df-85f6-827d7a2202a1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:55:55 devstack sudo[104682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8c1141c3-31a8-4118-8f7b-3e65763761db Jul 08 01:55:55 devstack sudo[104682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-02643a86-a2a1-45df-85f6-827d7a2202a1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:55:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-02643a86-a2a1-45df-85f6-827d7a2202a1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-02643a86-a2a1-45df-85f6-827d7a2202a1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:55:55 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-02643a86-a2a1-45df-85f6-827d7a2202a1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:55:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-02643a86-a2a1-45df-85f6-827d7a2202a1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-14259efb-1c38-46a3-9924-dffd830ae953 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:55 devstack sudo[104684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-14259efb-1c38-46a3-9924-dffd830ae953 1073741824 Jul 08 01:55:55 devstack sudo[104684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0671be6b-a90b-41db-933a-cb381dd087d7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (169e964c-5179-47a5-bee7-debc88d90ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e53c5384-a879-4793-b21a-5b85caced18a', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0671be6b-a90b-41db-933a-cb381dd087d7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c832af2c-66f1-42d2-98c9-452d99251349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:55 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:55:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:55:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:55:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:55 devstack sudo[104686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:55:55 devstack sudo[104686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:55 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-0671be6b-a90b-41db-933a-cb381dd087d7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Volume volume-e53c5384-a879-4793-b21a-5b85caced18a (e53c5384-a879-4793-b21a-5b85caced18a): created successfully Jul 08 01:55:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0671be6b-a90b-41db-933a-cb381dd087d7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c832af2c-66f1-42d2-98c9-452d99251349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0671be6b-a90b-41db-933a-cb381dd087d7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Flow 'volume_create_manager' (d35bbe2c-7afc-4802-a73e-3f9ab3ea8e6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:55:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b181fc87-74dd-4ad7-8e4c-a2e61a884b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d835ef96-3d5c-494b-af26-68d2886988a5', 'volume_size': 1, 'image_id': 'b89ee2e1-9ef6-4298-a35b-27978b4ebea7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b89ee2e1-9ef6-4298-a35b-27978b4ebea7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1ef276b8c213d8e91e592f2fd0b75d7f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9c81cc5f542c40b69ca753ced723b3dd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1e8faa31e99a86b16d8ed7dd3f9d923316e157db9fa8a6e1a71357b6b11672f88309ee173b23f99c2810ee9b5775d51e008dfc7613da3470dcce19c9e2e0019d', 'id': 'b89ee2e1-9ef6-4298-a35b-27978b4ebea7', 'created_at': datetime.datetime(2026, 7, 7, 23, 55, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 55, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b89ee2e1-9ef6-4298-a35b-27978b4ebea7/file', 'properties': {}}, 'image_service': }' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b6a6c1f-e367-4b5c-9135-80a7ad5a7870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:55 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-0671be6b-a90b-41db-933a-cb381dd087d7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Created volume successfully. Jul 08 01:55:55 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Volume volume-d835ef96-3d5c-494b-af26-68d2886988a5 (d835ef96-3d5c-494b-af26-68d2886988a5): created successfully Jul 08 01:55:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b6a6c1f-e367-4b5c-9135-80a7ad5a7870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Flow 'volume_create_manager' (2382e758-9acf-425a-9c4c-5de85f0538d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:55:55 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-cc5982b2-ab83-4646-bb19-285f732f43ca tempest-VolumeImageDependencyTests-1367780059 None] Created volume successfully. Jul 08 01:55:56 devstack sudo[104682]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8c1141c3-31a8-4118-8f7b-3e65763761db" returned: 0 in 1.174s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8c1141c3-31a8-4118-8f7b-3e65763761db {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:56 devstack sudo[104686]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.957s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:56 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:55:56 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager._thread_info {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:55:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread count: 29 {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:55:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread info: [<_MainThread(MainThread, started 127058402500736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:55:56 devstack sudo[104697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8c1141c3-31a8-4118-8f7b-3e65763761db Jul 08 01:55:56 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:56 devstack sudo[104684]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-02643a86-a2a1-45df-85f6-827d7a2202a1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-14259efb-1c38-46a3-9924-dffd830ae953 1073741824" returned: 0 in 1.247s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-02643a86-a2a1-45df-85f6-827d7a2202a1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-14259efb-1c38-46a3-9924-dffd830ae953 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:56 devstack sudo[104699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-14259efb-1c38-46a3-9924-dffd830ae953 Jul 08 01:55:56 devstack sudo[104699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:56 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-df465d8f-c792-4b02-81df-aae58c66ba4c tempest-VolumeImageDependencyTests-1367780059 None] Acquiring lock "cinder-d835ef96-3d5c-494b-af26-68d2886988a5-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:55:56 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-df465d8f-c792-4b02-81df-aae58c66ba4c tempest-VolumeImageDependencyTests-1367780059 None] Lock "cinder-d835ef96-3d5c-494b-af26-68d2886988a5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:55:56 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-df465d8f-c792-4b02-81df-aae58c66ba4c tempest-VolumeImageDependencyTests-1367780059 None] Acquiring lock "cinder-quobyte-d835ef96-3d5c-494b-af26-68d2886988a5" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:55:56 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-df465d8f-c792-4b02-81df-aae58c66ba4c tempest-VolumeImageDependencyTests-1367780059 None] Lock "cinder-quobyte-d835ef96-3d5c-494b-af26-68d2886988a5" acquired by "delete_volume" :: waited 0.029s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:55:56 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3ff1b9-c8bd-4f00-bf1a-b672c5de1f82]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:55:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-df465d8f-c792-4b02-81df-aae58c66ba4c tempest-VolumeImageDependencyTests-1367780059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d835ef96-3d5c-494b-af26-68d2886988a5 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:56 devstack sudo[104701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d835ef96-3d5c-494b-af26-68d2886988a5 Jul 08 01:55:56 devstack sudo[104701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:57 devstack sudo[104699]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-02643a86-a2a1-45df-85f6-827d7a2202a1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-14259efb-1c38-46a3-9924-dffd830ae953" returned: 0 in 0.870s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-02643a86-a2a1-45df-85f6-827d7a2202a1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] <== create_volume: return (2178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-02643a86-a2a1-45df-85f6-827d7a2202a1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.183s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-18f9942e-d4f1-4de7-bbb4-0bfac9f60285 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.934s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-18f9942e-d4f1-4de7-bbb4-0bfac9f60285 tempest-CreateVolumesFromSnapshotTest-1308629226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1361667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccca81d7-aa8e-41a9-ab27-3aa030a55297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a8f380c8b645a5a686943b4bcaad89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:55:47Z,use_quota=True,user_id='4851b20b18f9494194688ba217d4744f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-18f9942e-d4f1-4de7-bbb4-0bfac9f60285 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Creating volume ccca81d7-aa8e-41a9-ab27-3aa030a55297 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-18f9942e-d4f1-4de7-bbb4-0bfac9f60285 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-18f9942e-d4f1-4de7-bbb4-0bfac9f60285 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-18f9942e-d4f1-4de7-bbb4-0bfac9f60285 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-18f9942e-d4f1-4de7-bbb4-0bfac9f60285 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-18f9942e-d4f1-4de7-bbb4-0bfac9f60285 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-18f9942e-d4f1-4de7-bbb4-0bfac9f60285 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:55:57 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-18f9942e-d4f1-4de7-bbb4-0bfac9f60285 tempest-CreateVolumesFromSnapshotTest-1308629226 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-18f9942e-d4f1-4de7-bbb4-0bfac9f60285 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ccca81d7-aa8e-41a9-ab27-3aa030a55297 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-02643a86-a2a1-45df-85f6-827d7a2202a1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e2c8bca-82e3-46b4-98a4-1dc51441ea58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14259efb-1c38-46a3-9924-dffd830ae953', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-02643a86-a2a1-45df-85f6-827d7a2202a1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a920e357-cedd-4c92-8bd8-d1d7e275a9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:57 devstack sudo[104708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ccca81d7-aa8e-41a9-ab27-3aa030a55297 1073741824 Jul 08 01:55:57 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-02643a86-a2a1-45df-85f6-827d7a2202a1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Volume volume-14259efb-1c38-46a3-9924-dffd830ae953 (14259efb-1c38-46a3-9924-dffd830ae953): created successfully Jul 08 01:55:57 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-02643a86-a2a1-45df-85f6-827d7a2202a1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a920e357-cedd-4c92-8bd8-d1d7e275a9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-02643a86-a2a1-45df-85f6-827d7a2202a1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Flow 'volume_create_manager' (dc7bb95f-1e4e-45dd-8895-4e604038df75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:55:57 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-02643a86-a2a1-45df-85f6-827d7a2202a1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Created volume successfully. Jul 08 01:55:57 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8c1141c3-31a8-4118-8f7b-3e65763761db" returned: 1 in 1.349s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8c1141c3-31a8-4118-8f7b-3e65763761db' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG cinder.volume.volume_utils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Downloaded image b4064015-e677-46e8-b969-07e5e081b0ff ((None, [{'url': 'file:///opt/stack/data/glance/images/b4064015-e677-46e8-b969-07e5e081b0ff', 'metadata': {}}])) to volume 8c1141c3-31a8-4118-8f7b-3e65763761db successfully. {{(pid=87284) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Temporary image b4064015-e677-46e8-b969-07e5e081b0ff for user b8a5c4af3f8445949c5de1975c3e5aa7 is deleted. {{(pid=87284) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG cinder.volume.volume_utils [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Marking volume 8c1141c3-31a8-4118-8f7b-3e65763761db as bootable. {{(pid=87284) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Copying metadata from image b4064015-e677-46e8-b969-07e5e081b0ff to 8c1141c3-31a8-4118-8f7b-3e65763761db. {{(pid=87284) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Creating volume glance metadata for volume 8c1141c3-31a8-4118-8f7b-3e65763761db backed by image b4064015-e677-46e8-b969-07e5e081b0ff with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b4064015-e677-46e8-b969-07e5e081b0ff', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'be3d5f7cbd0761e4f699e402034ee6c9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87284) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f00fceae-d06a-4ff6-be4c-91fbb80168bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c1141c3-31a8-4118-8f7b-3e65763761db', 'volume_size': 1, 'image_id': 'b4064015-e677-46e8-b969-07e5e081b0ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b4064015-e677-46e8-b969-07e5e081b0ff', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'be3d5f7cbd0761e4f699e402034ee6c9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2f68fd7d8bf74027ab49d40723b602e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '93748f2177644ca105d2c9fe8be13b601c7c19ba2fde416befbc904e597d97d9054afebcc9930d31a8e8bf1f9f7fab725d87e5852b500001ceedc4db820f5663', 'id': 'b4064015-e677-46e8-b969-07e5e081b0ff', 'created_at': datetime.datetime(2026, 7, 7, 23, 55, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 55, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4064015-e677-46e8-b969-07e5e081b0ff/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (568c6ae3-0288-41f8-93d0-035a2d21326f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:57 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Volume volume-8c1141c3-31a8-4118-8f7b-3e65763761db (8c1141c3-31a8-4118-8f7b-3e65763761db): created successfully Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (568c6ae3-0288-41f8-93d0-035a2d21326f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Flow 'volume_create_manager' (b8ec8f3b-8dc4-4242-bdeb-fb75f6569ce6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:55:57 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-daee832e-6056-4785-a963-85f754f341ea tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Created volume successfully. Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-40f9c45d-3fc2-45cb-9531-02e0bcd8b38f tempest-VolumeDependencyTests-2049233334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-40f9c45d-3fc2-45cb-9531-02e0bcd8b38f tempest-VolumeDependencyTests-2049233334 None] Flow 'volume_create_manager' (631d6868-8484-4da1-9675-e933511c3cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-40f9c45d-3fc2-45cb-9531-02e0bcd8b38f tempest-VolumeDependencyTests-2049233334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67e65821-c1a4-4a25-8f68-54ed2da45d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-40f9c45d-3fc2-45cb-9531-02e0bcd8b38f tempest-VolumeDependencyTests-2049233334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67e65821-c1a4-4a25-8f68-54ed2da45d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-967486294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f74217a-1edd-4118-a7b3-6cdab2b51544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af7332c52eb34f49b8bb451f92b41968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:55:58Z,use_quota=True,user_id='9f0470e416dc467e9762451efbfbd232',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-40f9c45d-3fc2-45cb-9531-02e0bcd8b38f tempest-VolumeDependencyTests-2049233334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee06251d-8d12-4b86-9c8d-2b33170d9ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-40f9c45d-3fc2-45cb-9531-02e0bcd8b38f tempest-VolumeDependencyTests-2049233334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee06251d-8d12-4b86-9c8d-2b33170d9ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-40f9c45d-3fc2-45cb-9531-02e0bcd8b38f tempest-VolumeDependencyTests-2049233334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eebd84c2-66a0-439a-9bfe-18f93c43ce65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-40f9c45d-3fc2-45cb-9531-02e0bcd8b38f tempest-VolumeDependencyTests-2049233334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eebd84c2-66a0-439a-9bfe-18f93c43ce65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f74217a-1edd-4118-a7b3-6cdab2b51544', 'volume_name': 'volume-3f74217a-1edd-4118-a7b3-6cdab2b51544', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-40f9c45d-3fc2-45cb-9531-02e0bcd8b38f tempest-VolumeDependencyTests-2049233334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f0b574e-f699-46da-a342-c426fe25c19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-40f9c45d-3fc2-45cb-9531-02e0bcd8b38f tempest-VolumeDependencyTests-2049233334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f0b574e-f699-46da-a342-c426fe25c19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-40f9c45d-3fc2-45cb-9531-02e0bcd8b38f tempest-VolumeDependencyTests-2049233334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfdef9fb-70ab-4d97-aa22-51761a7363b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:57 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-40f9c45d-3fc2-45cb-9531-02e0bcd8b38f tempest-VolumeDependencyTests-2049233334 None] Volume 3f74217a-1edd-4118-a7b3-6cdab2b51544: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f74217a-1edd-4118-a7b3-6cdab2b51544', 'volume_size': 1} Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-40f9c45d-3fc2-45cb-9531-02e0bcd8b38f tempest-VolumeDependencyTests-2049233334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:57 devstack sudo[104701]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-df465d8f-c792-4b02-81df-aae58c66ba4c tempest-VolumeImageDependencyTests-1367780059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d835ef96-3d5c-494b-af26-68d2886988a5" returned: 0 in 1.274s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-df465d8f-c792-4b02-81df-aae58c66ba4c tempest-VolumeImageDependencyTests-1367780059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d835ef96-3d5c-494b-af26-68d2886988a5 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:58 devstack sudo[104714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d835ef96-3d5c-494b-af26-68d2886988a5 Jul 08 01:55:58 devstack sudo[104714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:58 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ea508c88-ca19-4ae8-b4b4-2a30f6b602fc tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Acquiring lock "cinder-8c1141c3-31a8-4118-8f7b-3e65763761db-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:55:58 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ea508c88-ca19-4ae8-b4b4-2a30f6b602fc tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Lock "cinder-8c1141c3-31a8-4118-8f7b-3e65763761db-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:55:58 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-18f9942e-d4f1-4de7-bbb4-0bfac9f60285 tempest-CreateVolumesFromSnapshotTest-1308629226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ccca81d7-aa8e-41a9-ab27-3aa030a55297 1073741824" returned: 0 in 1.174s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:58 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ea508c88-ca19-4ae8-b4b4-2a30f6b602fc tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Acquiring lock "cinder-quobyte-8c1141c3-31a8-4118-8f7b-3e65763761db" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:55:58 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ea508c88-ca19-4ae8-b4b4-2a30f6b602fc tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Lock "cinder-quobyte-8c1141c3-31a8-4118-8f7b-3e65763761db" acquired by "delete_volume" :: waited 0.024s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:55:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-18f9942e-d4f1-4de7-bbb4-0bfac9f60285 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ccca81d7-aa8e-41a9-ab27-3aa030a55297 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:58 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47628d1-ba60-4315-a54f-ec1c7174a778]: (4, 'raw') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:55:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ea508c88-ca19-4ae8-b4b4-2a30f6b602fc tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8c1141c3-31a8-4118-8f7b-3e65763761db {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:58 devstack sudo[104719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ccca81d7-aa8e-41a9-ab27-3aa030a55297 Jul 08 01:55:58 devstack sudo[104719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:58 devstack sudo[104720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8c1141c3-31a8-4118-8f7b-3e65763761db Jul 08 01:55:58 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:58 devstack sudo[104714]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-df465d8f-c792-4b02-81df-aae58c66ba4c tempest-VolumeImageDependencyTests-1367780059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d835ef96-3d5c-494b-af26-68d2886988a5" returned: 1 in 1.018s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-df465d8f-c792-4b02-81df-aae58c66ba4c tempest-VolumeImageDependencyTests-1367780059 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d835ef96-3d5c-494b-af26-68d2886988a5' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:55:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-df465d8f-c792-4b02-81df-aae58c66ba4c tempest-VolumeImageDependencyTests-1367780059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d835ef96-3d5c-494b-af26-68d2886988a5 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:58 devstack sudo[104726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d835ef96-3d5c-494b-af26-68d2886988a5 Jul 08 01:55:58 devstack sudo[104726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:59 devstack sudo[104719]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-18f9942e-d4f1-4de7-bbb4-0bfac9f60285 tempest-CreateVolumesFromSnapshotTest-1308629226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ccca81d7-aa8e-41a9-ab27-3aa030a55297" returned: 0 in 0.700s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:59 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-18f9942e-d4f1-4de7-bbb4-0bfac9f60285 tempest-CreateVolumesFromSnapshotTest-1308629226 None] <== create_volume: return (1985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:55:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-18f9942e-d4f1-4de7-bbb4-0bfac9f60285 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.993s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-40f9c45d-3fc2-45cb-9531-02e0bcd8b38f tempest-VolumeDependencyTests-2049233334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.442s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:59 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-40f9c45d-3fc2-45cb-9531-02e0bcd8b38f tempest-VolumeDependencyTests-2049233334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-967486294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f74217a-1edd-4118-a7b3-6cdab2b51544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af7332c52eb34f49b8bb451f92b41968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:55:58Z,use_quota=True,user_id='9f0470e416dc467e9762451efbfbd232',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:55:59 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-40f9c45d-3fc2-45cb-9531-02e0bcd8b38f tempest-VolumeDependencyTests-2049233334 None] Creating volume 3f74217a-1edd-4118-a7b3-6cdab2b51544 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:55:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-40f9c45d-3fc2-45cb-9531-02e0bcd8b38f tempest-VolumeDependencyTests-2049233334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-40f9c45d-3fc2-45cb-9531-02e0bcd8b38f tempest-VolumeDependencyTests-2049233334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:59 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-40f9c45d-3fc2-45cb-9531-02e0bcd8b38f tempest-VolumeDependencyTests-2049233334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:55:59 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-40f9c45d-3fc2-45cb-9531-02e0bcd8b38f tempest-VolumeDependencyTests-2049233334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:55:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-40f9c45d-3fc2-45cb-9531-02e0bcd8b38f tempest-VolumeDependencyTests-2049233334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:59 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-40f9c45d-3fc2-45cb-9531-02e0bcd8b38f tempest-VolumeDependencyTests-2049233334 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:55:59 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-40f9c45d-3fc2-45cb-9531-02e0bcd8b38f tempest-VolumeDependencyTests-2049233334 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:55:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-40f9c45d-3fc2-45cb-9531-02e0bcd8b38f tempest-VolumeDependencyTests-2049233334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-18f9942e-d4f1-4de7-bbb4-0bfac9f60285 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bac29cf1-0803-4ac0-abb3-fd38166e61fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccca81d7-aa8e-41a9-ab27-3aa030a55297', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:59 devstack sudo[104729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544 1073741824 Jul 08 01:55:59 devstack sudo[104729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-18f9942e-d4f1-4de7-bbb4-0bfac9f60285 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf08e2fb-d738-4e78-9ca0-47f96e73f698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:59 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-18f9942e-d4f1-4de7-bbb4-0bfac9f60285 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Volume volume-ccca81d7-aa8e-41a9-ab27-3aa030a55297 (ccca81d7-aa8e-41a9-ab27-3aa030a55297): created successfully Jul 08 01:55:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-18f9942e-d4f1-4de7-bbb4-0bfac9f60285 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf08e2fb-d738-4e78-9ca0-47f96e73f698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:59 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-18f9942e-d4f1-4de7-bbb4-0bfac9f60285 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Flow 'volume_create_manager' (20be1420-8899-4b34-bac4-8a263c4f1dd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:55:59 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-18f9942e-d4f1-4de7-bbb4-0bfac9f60285 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Created volume successfully. Jul 08 01:55:59 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ea508c88-ca19-4ae8-b4b4-2a30f6b602fc tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8c1141c3-31a8-4118-8f7b-3e65763761db" returned: 0 in 1.057s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ea508c88-ca19-4ae8-b4b4-2a30f6b602fc tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8c1141c3-31a8-4118-8f7b-3e65763761db {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:59 devstack sudo[104726]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-df465d8f-c792-4b02-81df-aae58c66ba4c tempest-VolumeImageDependencyTests-1367780059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d835ef96-3d5c-494b-af26-68d2886988a5" returned: 0 in 0.750s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:59 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-df465d8f-c792-4b02-81df-aae58c66ba4c tempest-VolumeImageDependencyTests-1367780059 None] Lock "cinder-quobyte-d835ef96-3d5c-494b-af26-68d2886988a5" released by "delete_volume" :: held 3.155s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:55:59 devstack sudo[104734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8c1141c3-31a8-4118-8f7b-3e65763761db Jul 08 01:55:59 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:59 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-df465d8f-c792-4b02-81df-aae58c66ba4c tempest-VolumeImageDependencyTests-1367780059 None] Created reservations ['e0bb98ee-774b-4ba8-86ae-107a0a5ab29e', 'df6618ed-c39f-4b03-bbc7-2f14367ba355', '7e0bfe56-71c5-4f4f-b811-09335edb35b7', 'bacec3be-f479-4878-bff7-0930c47ba79d'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:55:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-df465d8f-c792-4b02-81df-aae58c66ba4c tempest-VolumeImageDependencyTests-1367780059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-df465d8f-c792-4b02-81df-aae58c66ba4c tempest-VolumeImageDependencyTests-1367780059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:59 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-df465d8f-c792-4b02-81df-aae58c66ba4c tempest-VolumeImageDependencyTests-1367780059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:55:59 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-df465d8f-c792-4b02-81df-aae58c66ba4c tempest-VolumeImageDependencyTests-1367780059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:55:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-df465d8f-c792-4b02-81df-aae58c66ba4c tempest-VolumeImageDependencyTests-1367780059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-df465d8f-c792-4b02-81df-aae58c66ba4c tempest-VolumeImageDependencyTests-1367780059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:59 devstack sudo[104736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:55:59 devstack sudo[104736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:59 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-39c1f564-f0f0-4bf2-b7ac-b93517e412d8 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Acquiring lock "cinder-ccca81d7-aa8e-41a9-ab27-3aa030a55297-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:00 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-39c1f564-f0f0-4bf2-b7ac-b93517e412d8 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "cinder-ccca81d7-aa8e-41a9-ab27-3aa030a55297-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:00 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-39c1f564-f0f0-4bf2-b7ac-b93517e412d8 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Acquiring lock "cinder-quobyte-ccca81d7-aa8e-41a9-ab27-3aa030a55297" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:00 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-39c1f564-f0f0-4bf2-b7ac-b93517e412d8 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "cinder-quobyte-ccca81d7-aa8e-41a9-ab27-3aa030a55297" acquired by "delete_volume" :: waited 0.031s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:00 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[0404db3a-4c87-4985-8fa6-e0aeed35bc27]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-39c1f564-f0f0-4bf2-b7ac-b93517e412d8 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ccca81d7-aa8e-41a9-ab27-3aa030a55297 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:00 devstack sudo[104741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ccca81d7-aa8e-41a9-ab27-3aa030a55297 Jul 08 01:56:00 devstack sudo[104741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:00 devstack sudo[104729]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-40f9c45d-3fc2-45cb-9531-02e0bcd8b38f tempest-VolumeDependencyTests-2049233334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544 1073741824" returned: 0 in 1.387s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:00 devstack sudo[104736]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-40f9c45d-3fc2-45cb-9531-02e0bcd8b38f tempest-VolumeDependencyTests-2049233334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-df465d8f-c792-4b02-81df-aae58c66ba4c tempest-VolumeImageDependencyTests-1367780059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.904s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:00 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-df465d8f-c792-4b02-81df-aae58c66ba4c tempest-VolumeImageDependencyTests-1367780059 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:56:00 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-df465d8f-c792-4b02-81df-aae58c66ba4c tempest-VolumeImageDependencyTests-1367780059 None] Deleted volume successfully. Jul 08 01:56:00 devstack sudo[104748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544 Jul 08 01:56:00 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:00 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-df465d8f-c792-4b02-81df-aae58c66ba4c tempest-VolumeImageDependencyTests-1367780059 None] Lock "cinder-d835ef96-3d5c-494b-af26-68d2886988a5-delete_volume" released by "delete_volume" :: held 4.429s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:01 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ea508c88-ca19-4ae8-b4b4-2a30f6b602fc tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8c1141c3-31a8-4118-8f7b-3e65763761db" returned: 1 in 1.417s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ea508c88-ca19-4ae8-b4b4-2a30f6b602fc tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8c1141c3-31a8-4118-8f7b-3e65763761db' failed. Not Retrying. {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:56:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ea508c88-ca19-4ae8-b4b4-2a30f6b602fc tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8c1141c3-31a8-4118-8f7b-3e65763761db {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:01 devstack sudo[104750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8c1141c3-31a8-4118-8f7b-3e65763761db Jul 08 01:56:01 devstack sudo[104750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:01 devstack sudo[104741]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-39c1f564-f0f0-4bf2-b7ac-b93517e412d8 tempest-CreateVolumesFromSnapshotTest-1308629226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ccca81d7-aa8e-41a9-ab27-3aa030a55297" returned: 0 in 1.175s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-39c1f564-f0f0-4bf2-b7ac-b93517e412d8 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ccca81d7-aa8e-41a9-ab27-3aa030a55297 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:01 devstack sudo[104755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ccca81d7-aa8e-41a9-ab27-3aa030a55297 Jul 08 01:56:01 devstack sudo[104755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:01 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-40f9c45d-3fc2-45cb-9531-02e0bcd8b38f tempest-VolumeDependencyTests-2049233334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544" returned: 0 in 1.083s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:01 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-40f9c45d-3fc2-45cb-9531-02e0bcd8b38f tempest-VolumeDependencyTests-2049233334 None] <== create_volume: return (2635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:56:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-40f9c45d-3fc2-45cb-9531-02e0bcd8b38f tempest-VolumeDependencyTests-2049233334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.638s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-40f9c45d-3fc2-45cb-9531-02e0bcd8b38f tempest-VolumeDependencyTests-2049233334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfdef9fb-70ab-4d97-aa22-51761a7363b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f74217a-1edd-4118-a7b3-6cdab2b51544', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-40f9c45d-3fc2-45cb-9531-02e0bcd8b38f tempest-VolumeDependencyTests-2049233334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c94ba4d9-52a9-432d-a0ec-6e64d020b836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:01 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-40f9c45d-3fc2-45cb-9531-02e0bcd8b38f tempest-VolumeDependencyTests-2049233334 None] Volume volume-3f74217a-1edd-4118-a7b3-6cdab2b51544 (3f74217a-1edd-4118-a7b3-6cdab2b51544): created successfully Jul 08 01:56:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-40f9c45d-3fc2-45cb-9531-02e0bcd8b38f tempest-VolumeDependencyTests-2049233334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c94ba4d9-52a9-432d-a0ec-6e64d020b836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:01 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-40f9c45d-3fc2-45cb-9531-02e0bcd8b38f tempest-VolumeDependencyTests-2049233334 None] Flow 'volume_create_manager' (631d6868-8484-4da1-9675-e933511c3cba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:56:01 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-40f9c45d-3fc2-45cb-9531-02e0bcd8b38f tempest-VolumeDependencyTests-2049233334 None] Created volume successfully. Jul 08 01:56:02 devstack sudo[104750]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ea508c88-ca19-4ae8-b4b4-2a30f6b602fc tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-8c1141c3-31a8-4118-8f7b-3e65763761db" returned: 0 in 0.960s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:02 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ea508c88-ca19-4ae8-b4b4-2a30f6b602fc tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Lock "cinder-quobyte-8c1141c3-31a8-4118-8f7b-3e65763761db" released by "delete_volume" :: held 3.526s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:02 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-ea508c88-ca19-4ae8-b4b4-2a30f6b602fc tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Created reservations ['21a2e352-d723-49dc-8e1a-b67b022ca25f', 'cdf3a3bf-c728-464c-9756-2d394592356c', 'ece3eae7-12ac-4cff-9a50-85ec6ee34b4d', 'dd5a5529-9750-4662-9cfc-f0b72e8b024d'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:56:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ea508c88-ca19-4ae8-b4b4-2a30f6b602fc tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ea508c88-ca19-4ae8-b4b4-2a30f6b602fc tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:02 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-ea508c88-ca19-4ae8-b4b4-2a30f6b602fc tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:02 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-ea508c88-ca19-4ae8-b4b4-2a30f6b602fc tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ea508c88-ca19-4ae8-b4b4-2a30f6b602fc tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ea508c88-ca19-4ae8-b4b4-2a30f6b602fc tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:02 devstack sudo[104760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:56:02 devstack sudo[104760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:02 devstack sudo[104755]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-39c1f564-f0f0-4bf2-b7ac-b93517e412d8 tempest-CreateVolumesFromSnapshotTest-1308629226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ccca81d7-aa8e-41a9-ab27-3aa030a55297" returned: 0 in 1.016s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:02 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-39c1f564-f0f0-4bf2-b7ac-b93517e412d8 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "cinder-quobyte-ccca81d7-aa8e-41a9-ab27-3aa030a55297" released by "delete_volume" :: held 2.265s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:02 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-39c1f564-f0f0-4bf2-b7ac-b93517e412d8 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Created reservations ['b2ab80a2-5f67-4a1b-b17b-57fdab207730', 'a8bdb21d-55cc-453c-9cb2-211c069cde38', '9c8f3b50-ed5e-4713-9f93-b1da2d7f5c7f', 'a0b6a93b-084b-4863-aab5-91fde88af449'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:56:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-39c1f564-f0f0-4bf2-b7ac-b93517e412d8 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-39c1f564-f0f0-4bf2-b7ac-b93517e412d8 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:02 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-39c1f564-f0f0-4bf2-b7ac-b93517e412d8 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:02 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-39c1f564-f0f0-4bf2-b7ac-b93517e412d8 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-39c1f564-f0f0-4bf2-b7ac-b93517e412d8 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-39c1f564-f0f0-4bf2-b7ac-b93517e412d8 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:02 devstack sudo[104762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:56:02 devstack sudo[104762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:03 devstack sudo[104760]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ea508c88-ca19-4ae8-b4b4-2a30f6b602fc tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.072s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:03 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-ea508c88-ca19-4ae8-b4b4-2a30f6b602fc tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:56:03 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-ea508c88-ca19-4ae8-b4b4-2a30f6b602fc tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Deleted volume successfully. Jul 08 01:56:03 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ea508c88-ca19-4ae8-b4b4-2a30f6b602fc tempest-VolumeAndVolumeTypeFromImageTest-2016351166 None] Lock "cinder-8c1141c3-31a8-4118-8f7b-3e65763761db-delete_volume" released by "delete_volume" :: held 4.910s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:03 devstack sudo[104762]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-39c1f564-f0f0-4bf2-b7ac-b93517e412d8 tempest-CreateVolumesFromSnapshotTest-1308629226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.942s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:03 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-39c1f564-f0f0-4bf2-b7ac-b93517e412d8 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:56:03 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-39c1f564-f0f0-4bf2-b7ac-b93517e412d8 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Deleted volume successfully. Jul 08 01:56:03 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-53580a06-1a5e-4c64-aa98-1ff11442afe7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Acquiring lock "cinder-14259efb-1c38-46a3-9924-dffd830ae953-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c60b5103-c882-4921-b57a-2f21364f2683 tempest-VolumeDependencyTests-2049233334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c60b5103-c882-4921-b57a-2f21364f2683 tempest-VolumeDependencyTests-2049233334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:03 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-c60b5103-c882-4921-b57a-2f21364f2683 tempest-VolumeDependencyTests-2049233334 None] Creating offline snapshot ffd6fa04-49aa-4021-95b9-785836f00cb6 of volume 3f74217a-1edd-4118-a7b3-6cdab2b51544 {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:56:03 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-39c1f564-f0f0-4bf2-b7ac-b93517e412d8 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "cinder-ccca81d7-aa8e-41a9-ab27-3aa030a55297-delete_volume" released by "delete_volume" :: held 3.603s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:03 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-53580a06-1a5e-4c64-aa98-1ff11442afe7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "cinder-14259efb-1c38-46a3-9924-dffd830ae953-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:03 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[b117b588-6fdf-44fb-aef5-fc9cd79fc926]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c60b5103-c882-4921-b57a-2f21364f2683 tempest-VolumeDependencyTests-2049233334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:03 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-53580a06-1a5e-4c64-aa98-1ff11442afe7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Acquiring lock "cinder-quobyte-14259efb-1c38-46a3-9924-dffd830ae953" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:03 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-53580a06-1a5e-4c64-aa98-1ff11442afe7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "cinder-quobyte-14259efb-1c38-46a3-9924-dffd830ae953" acquired by "delete_volume" :: waited 0.029s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:03 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6644b08-8bdd-4742-a216-ed913e5506ff]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-53580a06-1a5e-4c64-aa98-1ff11442afe7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-14259efb-1c38-46a3-9924-dffd830ae953 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:03 devstack sudo[104766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544 Jul 08 01:56:03 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:03 devstack sudo[104767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-14259efb-1c38-46a3-9924-dffd830ae953 Jul 08 01:56:03 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:04 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c60b5103-c882-4921-b57a-2f21364f2683 tempest-VolumeDependencyTests-2049233334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544" returned: 0 in 1.073s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c60b5103-c882-4921-b57a-2f21364f2683 tempest-VolumeDependencyTests-2049233334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544.ffd6fa04-49aa-4021-95b9-785836f00cb6 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:04 devstack sudo[104777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544.ffd6fa04-49aa-4021-95b9-785836f00cb6 1G Jul 08 01:56:04 devstack sudo[104777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:04 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-53580a06-1a5e-4c64-aa98-1ff11442afe7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-14259efb-1c38-46a3-9924-dffd830ae953" returned: 0 in 1.180s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-53580a06-1a5e-4c64-aa98-1ff11442afe7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-14259efb-1c38-46a3-9924-dffd830ae953 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:04 devstack sudo[104779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-14259efb-1c38-46a3-9924-dffd830ae953 Jul 08 01:56:04 devstack sudo[104779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:05 devstack sudo[104777]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c60b5103-c882-4921-b57a-2f21364f2683 tempest-VolumeDependencyTests-2049233334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544.ffd6fa04-49aa-4021-95b9-785836f00cb6 1G" returned: 0 in 1.150s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c60b5103-c882-4921-b57a-2f21364f2683 tempest-VolumeDependencyTests-2049233334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f74217a-1edd-4118-a7b3-6cdab2b51544 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544.ffd6fa04-49aa-4021-95b9-785836f00cb6 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:05 devstack sudo[104787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f74217a-1edd-4118-a7b3-6cdab2b51544 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544.ffd6fa04-49aa-4021-95b9-785836f00cb6 Jul 08 01:56:05 devstack sudo[104787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:05 devstack sudo[104779]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-53580a06-1a5e-4c64-aa98-1ff11442afe7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-14259efb-1c38-46a3-9924-dffd830ae953" returned: 0 in 0.958s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:05 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-53580a06-1a5e-4c64-aa98-1ff11442afe7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "cinder-quobyte-14259efb-1c38-46a3-9924-dffd830ae953" released by "delete_volume" :: held 2.214s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:06 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-53580a06-1a5e-4c64-aa98-1ff11442afe7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Created reservations ['b3b4f865-551c-42ff-8d66-a10cbc2d7b99', '17654dc8-6a9b-4c0b-89a9-866e4a087fce', '00cd5daf-cd65-46ae-a105-d9fec6d43c62', '48853e21-5ac2-40ee-b064-b02197fc24ae'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:56:06 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f77de840-8730-409f-b73e-518b3630c300 tempest-ProjectAdminTests-1708742807 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6908683776855, 'free_capacity_gb': 1775.6908683776855, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87284) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 01:56:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-53580a06-1a5e-4c64-aa98-1ff11442afe7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-53580a06-1a5e-4c64-aa98-1ff11442afe7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:06 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-53580a06-1a5e-4c64-aa98-1ff11442afe7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:06 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-53580a06-1a5e-4c64-aa98-1ff11442afe7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-53580a06-1a5e-4c64-aa98-1ff11442afe7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-53580a06-1a5e-4c64-aa98-1ff11442afe7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:06 devstack sudo[104789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:56:06 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:06 devstack sudo[104787]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c60b5103-c882-4921-b57a-2f21364f2683 tempest-VolumeDependencyTests-2049233334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f74217a-1edd-4118-a7b3-6cdab2b51544 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544.ffd6fa04-49aa-4021-95b9-785836f00cb6" returned: 0 in 0.920s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:06 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-c60b5103-c882-4921-b57a-2f21364f2683 tempest-VolumeDependencyTests-2049233334 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544.ffd6fa04-49aa-4021-95b9-785836f00cb6 is being set with open permissions: ugo+rw Jul 08 01:56:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c60b5103-c882-4921-b57a-2f21364f2683 tempest-VolumeDependencyTests-2049233334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544.ffd6fa04-49aa-4021-95b9-785836f00cb6 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:06 devstack sudo[104794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544.ffd6fa04-49aa-4021-95b9-785836f00cb6 Jul 08 01:56:06 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:07 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-19acafe5-ec5b-4727-9670-3ce5fba87abd tempest-CreateVolumesFromSnapshotTest-1308629226 None] Acquiring lock "cinder-e53c5384-a879-4793-b21a-5b85caced18a-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:07 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-19acafe5-ec5b-4727-9670-3ce5fba87abd tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "cinder-e53c5384-a879-4793-b21a-5b85caced18a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:07 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-19acafe5-ec5b-4727-9670-3ce5fba87abd tempest-CreateVolumesFromSnapshotTest-1308629226 None] Acquiring lock "cinder-quobyte-e53c5384-a879-4793-b21a-5b85caced18a" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:07 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-19acafe5-ec5b-4727-9670-3ce5fba87abd tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "cinder-quobyte-e53c5384-a879-4793-b21a-5b85caced18a" acquired by "delete_volume" :: waited 0.039s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:07 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f9de79-e875-4768-9707-f6042ddcef93]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-19acafe5-ec5b-4727-9670-3ce5fba87abd tempest-CreateVolumesFromSnapshotTest-1308629226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-e53c5384-a879-4793-b21a-5b85caced18a {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:07 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-53580a06-1a5e-4c64-aa98-1ff11442afe7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.319s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:07 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-53580a06-1a5e-4c64-aa98-1ff11442afe7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:56:07 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-53580a06-1a5e-4c64-aa98-1ff11442afe7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Deleted volume successfully. Jul 08 01:56:07 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-53580a06-1a5e-4c64-aa98-1ff11442afe7 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "cinder-14259efb-1c38-46a3-9924-dffd830ae953-delete_volume" released by "delete_volume" :: held 3.920s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:07 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-e53c5384-a879-4793-b21a-5b85caced18a Jul 08 01:56:07 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:07 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c60b5103-c882-4921-b57a-2f21364f2683 tempest-VolumeDependencyTests-2049233334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544.ffd6fa04-49aa-4021-95b9-785836f00cb6" returned: 0 in 0.951s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c60b5103-c882-4921-b57a-2f21364f2683 tempest-VolumeDependencyTests-2049233334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:07 devstack sudo[104800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544.info Jul 08 01:56:07 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:08 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-19acafe5-ec5b-4727-9670-3ce5fba87abd tempest-CreateVolumesFromSnapshotTest-1308629226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-e53c5384-a879-4793-b21a-5b85caced18a" returned: 0 in 1.366s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-19acafe5-ec5b-4727-9670-3ce5fba87abd tempest-CreateVolumesFromSnapshotTest-1308629226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-e53c5384-a879-4793-b21a-5b85caced18a {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:08 devstack sudo[104806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-e53c5384-a879-4793-b21a-5b85caced18a Jul 08 01:56:08 devstack sudo[104806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:08 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c60b5103-c882-4921-b57a-2f21364f2683 tempest-VolumeDependencyTests-2049233334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544.info" returned: 0 in 1.114s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:08 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-c60b5103-c882-4921-b57a-2f21364f2683 tempest-VolumeDependencyTests-2049233334 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544.info is being set with open permissions: ugo+rw Jul 08 01:56:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c60b5103-c882-4921-b57a-2f21364f2683 tempest-VolumeDependencyTests-2049233334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:09 devstack sudo[104808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544.info Jul 08 01:56:09 devstack sudo[104808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:09 devstack sudo[104806]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-19acafe5-ec5b-4727-9670-3ce5fba87abd tempest-CreateVolumesFromSnapshotTest-1308629226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-e53c5384-a879-4793-b21a-5b85caced18a" returned: 0 in 0.947s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:09 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-19acafe5-ec5b-4727-9670-3ce5fba87abd tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "cinder-quobyte-e53c5384-a879-4793-b21a-5b85caced18a" released by "delete_volume" :: held 2.403s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:09 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-19acafe5-ec5b-4727-9670-3ce5fba87abd tempest-CreateVolumesFromSnapshotTest-1308629226 None] Created reservations ['4d910ac5-f4bc-43c2-8922-07ac0a3e35e8', '881307d9-fa80-45a4-959e-cb2291985910', 'd6091fdb-0ab3-4650-abdc-04cb9f6dc083', '1de9b1c4-e4fa-4ec8-bddd-a1c90c86329c'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:56:09 devstack sudo[104808]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c60b5103-c882-4921-b57a-2f21364f2683 tempest-VolumeDependencyTests-2049233334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544.info" returned: 0 in 0.882s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c60b5103-c882-4921-b57a-2f21364f2683 tempest-VolumeDependencyTests-2049233334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.296s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:09 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-c60b5103-c882-4921-b57a-2f21364f2683 tempest-VolumeDependencyTests-2049233334 None] Create snapshot completed successfully Jul 08 01:56:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-19acafe5-ec5b-4727-9670-3ce5fba87abd tempest-CreateVolumesFromSnapshotTest-1308629226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-19acafe5-ec5b-4727-9670-3ce5fba87abd tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:09 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-19acafe5-ec5b-4727-9670-3ce5fba87abd tempest-CreateVolumesFromSnapshotTest-1308629226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:09 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-19acafe5-ec5b-4727-9670-3ce5fba87abd tempest-CreateVolumesFromSnapshotTest-1308629226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-19acafe5-ec5b-4727-9670-3ce5fba87abd tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-19acafe5-ec5b-4727-9670-3ce5fba87abd tempest-CreateVolumesFromSnapshotTest-1308629226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:09 devstack sudo[104812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:56:10 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:10 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-335c1da1-d240-4374-b72c-4f3b79a4995e tempest-CreateVolumesFromSnapshotTest-1308629226 None] Acquiring lock "cinder-c358e221-3fdc-47a4-ab57-59e9b8f3795f-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:10 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-335c1da1-d240-4374-b72c-4f3b79a4995e tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "cinder-c358e221-3fdc-47a4-ab57-59e9b8f3795f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:10 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-335c1da1-d240-4374-b72c-4f3b79a4995e tempest-CreateVolumesFromSnapshotTest-1308629226 None] Acquiring lock "cinder-quobyte-c358e221-3fdc-47a4-ab57-59e9b8f3795f" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:10 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-335c1da1-d240-4374-b72c-4f3b79a4995e tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "cinder-quobyte-c358e221-3fdc-47a4-ab57-59e9b8f3795f" acquired by "delete_volume" :: waited 0.032s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:10 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-19acafe5-ec5b-4727-9670-3ce5fba87abd tempest-CreateVolumesFromSnapshotTest-1308629226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.825s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:10 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-19acafe5-ec5b-4727-9670-3ce5fba87abd tempest-CreateVolumesFromSnapshotTest-1308629226 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:56:10 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-19acafe5-ec5b-4727-9670-3ce5fba87abd tempest-CreateVolumesFromSnapshotTest-1308629226 None] Deleted volume successfully. Jul 08 01:56:10 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[8947f290-1786-4093-b665-fa18d53f73f3]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-335c1da1-d240-4374-b72c-4f3b79a4995e tempest-CreateVolumesFromSnapshotTest-1308629226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c358e221-3fdc-47a4-ab57-59e9b8f3795f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:10 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-19acafe5-ec5b-4727-9670-3ce5fba87abd tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "cinder-e53c5384-a879-4793-b21a-5b85caced18a-delete_volume" released by "delete_volume" :: held 3.646s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:10 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c358e221-3fdc-47a4-ab57-59e9b8f3795f Jul 08 01:56:10 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:11 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:56:11 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Flow 'volume_create_manager' (6cdfa97f-ccf4-4e39-8a27-3a593dec0b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:56:11 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56cd1e1b-1684-4de0-a800-031f6709cd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:11 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56cd1e1b-1684-4de0-a800-031f6709cd57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1794574436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c024d28e-bebc-4676-a83a-5b109b11ffa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af7332c52eb34f49b8bb451f92b41968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ffd6fa04-49aa-4021-95b9-785836f00cb6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:56:12Z,use_quota=True,user_id='9f0470e416dc467e9762451efbfbd232',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:11 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5947b1af-7edf-4ee9-bc86-1539b14ac674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:11 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5947b1af-7edf-4ee9-bc86-1539b14ac674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:11 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4803dffc-2e4a-4e3d-b038-0613aa43eceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:11 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4803dffc-2e4a-4e3d-b038-0613aa43eceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c024d28e-bebc-4676-a83a-5b109b11ffa0', 'volume_name': 'volume-c024d28e-bebc-4676-a83a-5b109b11ffa0', 'volume_size': 1, 'snapshot_id': 'ffd6fa04-49aa-4021-95b9-785836f00cb6'}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:11 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e181d519-1886-4585-8f3e-79d71a87df03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:11 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e181d519-1886-4585-8f3e-79d71a87df03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:11 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5066bb5b-7e3b-4d8f-9544-3dad4d8bcaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:11 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Volume c024d28e-bebc-4676-a83a-5b109b11ffa0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c024d28e-bebc-4676-a83a-5b109b11ffa0', 'volume_size': 1, 'snapshot_id': 'ffd6fa04-49aa-4021-95b9-785836f00cb6'} Jul 08 01:56:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:11 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Acquiring lock "cinder-quobyte-ffd6fa04-49aa-4021-95b9-785836f00cb6-c024d28e-bebc-4676-a83a-5b109b11ffa0" by "_create_volume_from_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:11 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-80427bcc-fe46-4ed2-af47-b883f3c18b81 tempest-ProjectReaderTests-756482943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:56:11 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-80427bcc-fe46-4ed2-af47-b883f3c18b81 tempest-ProjectReaderTests-756482943 None] Flow 'volume_create_manager' (9d214244-3a3d-4327-a19e-0777ac4d1ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:56:11 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-80427bcc-fe46-4ed2-af47-b883f3c18b81 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b94420f9-ca82-4962-bd5a-27e899313bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:11 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Lock "cinder-quobyte-ffd6fa04-49aa-4021-95b9-785836f00cb6-c024d28e-bebc-4676-a83a-5b109b11ffa0" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:11 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Creating volume c024d28e-bebc-4676-a83a-5b109b11ffa0 from snapshot ffd6fa04-49aa-4021-95b9-785836f00cb6 {{(pid=87284) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 01:56:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:11 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:11 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:11 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:56:11 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Acquiring lock "cinder-quobyte-c024d28e-bebc-4676-a83a-5b109b11ffa0" by "_copy_volume_from_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:11 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-80427bcc-fe46-4ed2-af47-b883f3c18b81 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b94420f9-ca82-4962-bd5a-27e899313bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-17923291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f58e786-4c67-414a-be6e-a5029fbf7374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cedff66a12b04885a54b318907f70246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:56:12Z,use_quota=True,user_id='42422d5e57294adbb2ba38426c0322eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:11 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-80427bcc-fe46-4ed2-af47-b883f3c18b81 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cfa41fa-91f3-4bdf-be5e-8e5796180a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:11 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-80427bcc-fe46-4ed2-af47-b883f3c18b81 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cfa41fa-91f3-4bdf-be5e-8e5796180a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:11 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-80427bcc-fe46-4ed2-af47-b883f3c18b81 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (127a0d85-933b-499b-b9e7-cc10cdaa7849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:12 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-80427bcc-fe46-4ed2-af47-b883f3c18b81 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (127a0d85-933b-499b-b9e7-cc10cdaa7849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f58e786-4c67-414a-be6e-a5029fbf7374', 'volume_name': 'volume-9f58e786-4c67-414a-be6e-a5029fbf7374', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:12 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-80427bcc-fe46-4ed2-af47-b883f3c18b81 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (695d657c-9027-4949-b916-0ef9c9e024ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:12 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-80427bcc-fe46-4ed2-af47-b883f3c18b81 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (695d657c-9027-4949-b916-0ef9c9e024ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:12 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-80427bcc-fe46-4ed2-af47-b883f3c18b81 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a70f0c-66b5-4e86-aded-7bb665786101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:12 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-80427bcc-fe46-4ed2-af47-b883f3c18b81 tempest-ProjectReaderTests-756482943 None] Volume 9f58e786-4c67-414a-be6e-a5029fbf7374: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f58e786-4c67-414a-be6e-a5029fbf7374', 'volume_size': 1} Jul 08 01:56:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-80427bcc-fe46-4ed2-af47-b883f3c18b81 tempest-ProjectReaderTests-756482943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:12 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Lock "cinder-quobyte-c024d28e-bebc-4676-a83a-5b109b11ffa0" acquired by "_copy_volume_from_snapshot" :: waited 0.064s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:12 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] snapshot: ffd6fa04-49aa-4021-95b9-785836f00cb6, volume: c024d28e-bebc-4676-a83a-5b109b11ffa0, {{(pid=87284) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:56:12 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:12 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:12 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-335c1da1-d240-4374-b72c-4f3b79a4995e tempest-CreateVolumesFromSnapshotTest-1308629226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c358e221-3fdc-47a4-ab57-59e9b8f3795f" returned: 0 in 1.240s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-335c1da1-d240-4374-b72c-4f3b79a4995e tempest-CreateVolumesFromSnapshotTest-1308629226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c358e221-3fdc-47a4-ab57-59e9b8f3795f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:12 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b020a4-471f-4699-8e11-4dcb07261c41]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544.ffd6fa04-49aa-4021-95b9-785836f00cb6 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:12 devstack sudo[104820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c358e221-3fdc-47a4-ab57-59e9b8f3795f Jul 08 01:56:12 devstack sudo[104820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:12 devstack sudo[104821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544.ffd6fa04-49aa-4021-95b9-785836f00cb6 Jul 08 01:56:12 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:12 devstack sudo[104820]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-335c1da1-d240-4374-b72c-4f3b79a4995e tempest-CreateVolumesFromSnapshotTest-1308629226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c358e221-3fdc-47a4-ab57-59e9b8f3795f" returned: 0 in 0.798s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:12 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-335c1da1-d240-4374-b72c-4f3b79a4995e tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "cinder-quobyte-c358e221-3fdc-47a4-ab57-59e9b8f3795f" released by "delete_volume" :: held 2.117s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:12 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-335c1da1-d240-4374-b72c-4f3b79a4995e tempest-CreateVolumesFromSnapshotTest-1308629226 None] Created reservations ['87b4ee96-5dff-4a36-8934-f563952ad64f', '8bbbf8a8-a859-41d4-a715-9df007fceb1d', '17c7cdf5-78c7-4e98-89fc-32ba1bb97a22', '022322c5-1e95-4e0c-a3f8-d55b7e96d0b8'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:56:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-335c1da1-d240-4374-b72c-4f3b79a4995e tempest-CreateVolumesFromSnapshotTest-1308629226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-335c1da1-d240-4374-b72c-4f3b79a4995e tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:13 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-335c1da1-d240-4374-b72c-4f3b79a4995e tempest-CreateVolumesFromSnapshotTest-1308629226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:13 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-335c1da1-d240-4374-b72c-4f3b79a4995e tempest-CreateVolumesFromSnapshotTest-1308629226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-335c1da1-d240-4374-b72c-4f3b79a4995e tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-335c1da1-d240-4374-b72c-4f3b79a4995e tempest-CreateVolumesFromSnapshotTest-1308629226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:13 devstack sudo[104829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:56:13 devstack sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:13 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544.ffd6fa04-49aa-4021-95b9-785836f00cb6" returned: 0 in 1.064s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:13 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f74217a-1edd-4118-a7b3-6cdab2b51544(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:56:13 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544 {{(pid=87284) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:56:13 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Creating direct copy from snapshot {{(pid=87284) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:56:13 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5155511-9a20-4d91-b16f-bee9650b4737]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:13 devstack sudo[104831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544 Jul 08 01:56:13 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:13 devstack sudo[104829]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-335c1da1-d240-4374-b72c-4f3b79a4995e tempest-CreateVolumesFromSnapshotTest-1308629226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.839s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:13 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-335c1da1-d240-4374-b72c-4f3b79a4995e tempest-CreateVolumesFromSnapshotTest-1308629226 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:56:13 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-335c1da1-d240-4374-b72c-4f3b79a4995e tempest-CreateVolumesFromSnapshotTest-1308629226 None] Deleted volume successfully. Jul 08 01:56:13 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-335c1da1-d240-4374-b72c-4f3b79a4995e tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "cinder-c358e221-3fdc-47a4-ab57-59e9b8f3795f-delete_volume" released by "delete_volume" :: held 3.303s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:13 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544" returned: 0 in 0.825s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:14 devstack cinder-volume[87284]: DEBUG cinder.utils [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Path /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c024d28e-bebc-4676-a83a-5b109b11ffa0 not found in is_blk_device check {{(pid=87284) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:56:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c024d28e-bebc-4676-a83a-5b109b11ffa0 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:14 devstack sudo[104837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c024d28e-bebc-4676-a83a-5b109b11ffa0 Jul 08 01:56:14 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:14 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b58cd350-973b-40cb-8af3-ab44e6dc31c1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Acquiring lock "cinder-1964e503-a2bc-41b7-a7ab-065936432cd8-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:14 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b58cd350-973b-40cb-8af3-ab44e6dc31c1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "cinder-1964e503-a2bc-41b7-a7ab-065936432cd8-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:14 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b58cd350-973b-40cb-8af3-ab44e6dc31c1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Acquiring lock "cinder-quobyte-1964e503-a2bc-41b7-a7ab-065936432cd8" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:14 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b58cd350-973b-40cb-8af3-ab44e6dc31c1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "cinder-quobyte-1964e503-a2bc-41b7-a7ab-065936432cd8" acquired by "delete_volume" :: waited 0.021s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:14 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ea288f-3387-4045-9ed8-d3cf4bbe64e9]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b58cd350-973b-40cb-8af3-ab44e6dc31c1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1964e503-a2bc-41b7-a7ab-065936432cd8 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:14 devstack sudo[104839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1964e503-a2bc-41b7-a7ab-065936432cd8 Jul 08 01:56:14 devstack sudo[104839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:15 devstack sudo[104839]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b58cd350-973b-40cb-8af3-ab44e6dc31c1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1964e503-a2bc-41b7-a7ab-065936432cd8" returned: 0 in 1.430s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b58cd350-973b-40cb-8af3-ab44e6dc31c1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1964e503-a2bc-41b7-a7ab-065936432cd8 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:15 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1964e503-a2bc-41b7-a7ab-065936432cd8 Jul 08 01:56:15 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:16 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b58cd350-973b-40cb-8af3-ab44e6dc31c1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1964e503-a2bc-41b7-a7ab-065936432cd8" returned: 0 in 1.260s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:16 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b58cd350-973b-40cb-8af3-ab44e6dc31c1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "cinder-quobyte-1964e503-a2bc-41b7-a7ab-065936432cd8" released by "delete_volume" :: held 2.768s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:17 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-b58cd350-973b-40cb-8af3-ab44e6dc31c1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Created reservations ['801c2803-9cda-42c3-b551-3c6a3cbfb58f', 'c4b4903d-7a65-4e68-851b-ee6e33c1c6a9', '5a15f40b-896f-4e52-885e-94d76e87a769', '0216dd9c-5f08-43cc-89d8-55cb8f40617a'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:56:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b58cd350-973b-40cb-8af3-ab44e6dc31c1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b58cd350-973b-40cb-8af3-ab44e6dc31c1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:17 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b58cd350-973b-40cb-8af3-ab44e6dc31c1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:17 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b58cd350-973b-40cb-8af3-ab44e6dc31c1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b58cd350-973b-40cb-8af3-ab44e6dc31c1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b58cd350-973b-40cb-8af3-ab44e6dc31c1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:17 devstack sudo[104861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:56:17 devstack sudo[104861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:17 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3ba73325-e3b6-46e7-b74e-a8cd81955f25 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Acquiring lock "cinder-8eb90949-a87c-4b63-afd2-6b5f7c40913f-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:18 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3ba73325-e3b6-46e7-b74e-a8cd81955f25 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "cinder-8eb90949-a87c-4b63-afd2-6b5f7c40913f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:18 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3ba73325-e3b6-46e7-b74e-a8cd81955f25 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Acquiring lock "cinder-quobyte-6e6155d5-fbf2-43ea-a765-4584980f9098" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:18 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3ba73325-e3b6-46e7-b74e-a8cd81955f25 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "cinder-quobyte-6e6155d5-fbf2-43ea-a765-4584980f9098" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:18 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3ba73325-e3b6-46e7-b74e-a8cd81955f25 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Acquiring lock "cinder-quobyte-8eb90949-a87c-4b63-afd2-6b5f7c40913f" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:18 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3ba73325-e3b6-46e7-b74e-a8cd81955f25 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "cinder-quobyte-8eb90949-a87c-4b63-afd2-6b5f7c40913f" acquired by "_delete_snapshot" :: waited 0.079s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:18 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-3ba73325-e3b6-46e7-b74e-a8cd81955f25 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Deleting offline snapshot 8eb90949-a87c-4b63-afd2-6b5f7c40913f of volume 6e6155d5-fbf2-43ea-a765-4584980f9098 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:56:18 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-3ba73325-e3b6-46e7-b74e-a8cd81955f25 tempest-CreateVolumesFromSnapshotTest-1308629226 None] snapshot_file for this snap is: volume-6e6155d5-fbf2-43ea-a765-4584980f9098.8eb90949-a87c-4b63-afd2-6b5f7c40913f {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:56:18 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01ec51c-5815-4714-b35e-5348f4dcda09]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3ba73325-e3b6-46e7-b74e-a8cd81955f25 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098.8eb90949-a87c-4b63-afd2-6b5f7c40913f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:18 devstack sudo[104863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098.8eb90949-a87c-4b63-afd2-6b5f7c40913f Jul 08 01:56:18 devstack sudo[104863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:19 devstack sudo[104861]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b58cd350-973b-40cb-8af3-ab44e6dc31c1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 2.355s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:19 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-b58cd350-973b-40cb-8af3-ab44e6dc31c1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:56:19 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-b58cd350-973b-40cb-8af3-ab44e6dc31c1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Deleted volume successfully. Jul 08 01:56:19 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=109,cinder:UPDATE=139,cinder:INSERT=44,cinder:DELETE=15 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:56:19 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b58cd350-973b-40cb-8af3-ab44e6dc31c1 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "cinder-1964e503-a2bc-41b7-a7ab-065936432cd8-delete_volume" released by "delete_volume" :: held 5.879s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:20 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c024d28e-bebc-4676-a83a-5b109b11ffa0" returned: 0 in 6.109s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:20 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc384ad-1b17-4b42-92c3-742351509319]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:20 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544 Jul 08 01:56:20 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:20 devstack sudo[104863]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3ba73325-e3b6-46e7-b74e-a8cd81955f25 tempest-CreateVolumesFromSnapshotTest-1308629226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098.8eb90949-a87c-4b63-afd2-6b5f7c40913f" returned: 0 in 2.249s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:20 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-3ba73325-e3b6-46e7-b74e-a8cd81955f25 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e6155d5-fbf2-43ea-a765-4584980f9098(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:56:20 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[6999f7cd-ef01-4052-bc04-02ed4da8ef12]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3ba73325-e3b6-46e7-b74e-a8cd81955f25 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:20 devstack sudo[104872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098 Jul 08 01:56:20 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:21 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544" returned: 0 in 1.171s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:21 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Image conversion details: src /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544, size 1024.00 MB, duration 6.11 sec, destination /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c024d28e-bebc-4676-a83a-5b109b11ffa0 {{(pid=87284) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:56:21 devstack cinder-volume[87284]: INFO cinder.image.image_utils [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Converted 1024.00 MB image at 167.58 MB/s Jul 08 01:56:21 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c024d28e-bebc-4676-a83a-5b109b11ffa0 is being set with open permissions: ugo+rw Jul 08 01:56:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c024d28e-bebc-4676-a83a-5b109b11ffa0 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:21 devstack sudo[104877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c024d28e-bebc-4676-a83a-5b109b11ffa0 Jul 08 01:56:21 devstack sudo[104877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:21 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3ba73325-e3b6-46e7-b74e-a8cd81955f25 tempest-CreateVolumesFromSnapshotTest-1308629226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098" returned: 0 in 0.991s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3ba73325-e3b6-46e7-b74e-a8cd81955f25 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098.8eb90949-a87c-4b63-afd2-6b5f7c40913f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:21 devstack sudo[104882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098.8eb90949-a87c-4b63-afd2-6b5f7c40913f Jul 08 01:56:21 devstack sudo[104882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:22 devstack sudo[104877]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c024d28e-bebc-4676-a83a-5b109b11ffa0" returned: 0 in 0.748s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:22 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Lock "cinder-quobyte-c024d28e-bebc-4676-a83a-5b109b11ffa0" released by "_copy_volume_from_snapshot" :: held 10.044s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:22 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Lock "cinder-quobyte-ffd6fa04-49aa-4021-95b9-785836f00cb6-c024d28e-bebc-4676-a83a-5b109b11ffa0" released by "_create_volume_from_snapshot" :: held 10.128s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.177s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-80427bcc-fe46-4ed2-af47-b883f3c18b81 tempest-ProjectReaderTests-756482943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.063s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:22 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-80427bcc-fe46-4ed2-af47-b883f3c18b81 tempest-ProjectReaderTests-756482943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-17923291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f58e786-4c67-414a-be6e-a5029fbf7374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cedff66a12b04885a54b318907f70246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:56:12Z,use_quota=True,user_id='42422d5e57294adbb2ba38426c0322eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:56:22 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-80427bcc-fe46-4ed2-af47-b883f3c18b81 tempest-ProjectReaderTests-756482943 None] Creating volume 9f58e786-4c67-414a-be6e-a5029fbf7374 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:56:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-80427bcc-fe46-4ed2-af47-b883f3c18b81 tempest-ProjectReaderTests-756482943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-80427bcc-fe46-4ed2-af47-b883f3c18b81 tempest-ProjectReaderTests-756482943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:22 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-80427bcc-fe46-4ed2-af47-b883f3c18b81 tempest-ProjectReaderTests-756482943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:22 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-80427bcc-fe46-4ed2-af47-b883f3c18b81 tempest-ProjectReaderTests-756482943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-80427bcc-fe46-4ed2-af47-b883f3c18b81 tempest-ProjectReaderTests-756482943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:22 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-80427bcc-fe46-4ed2-af47-b883f3c18b81 tempest-ProjectReaderTests-756482943 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:56:22 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-80427bcc-fe46-4ed2-af47-b883f3c18b81 tempest-ProjectReaderTests-756482943 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:56:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-80427bcc-fe46-4ed2-af47-b883f3c18b81 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:22 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:UPDATE=151,cinder:SELECT=111,cinder:INSERT=39,cinder:DELETE=13 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:56:22 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374 1073741824 Jul 08 01:56:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5066bb5b-7e3b-4d8f-9544-3dad4d8bcaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c024d28e-bebc-4676-a83a-5b109b11ffa0', 'volume_size': 1, 'snapshot_id': 'ffd6fa04-49aa-4021-95b9-785836f00cb6'}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:22 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d03d5cc-2ae7-4d0c-b589-7299069f1e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:22 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Volume volume-c024d28e-bebc-4676-a83a-5b109b11ffa0 (c024d28e-bebc-4676-a83a-5b109b11ffa0): created successfully Jul 08 01:56:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d03d5cc-2ae7-4d0c-b589-7299069f1e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Flow 'volume_create_manager' (6cdfa97f-ccf4-4e39-8a27-3a593dec0b3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:56:22 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-2d976c19-b3fc-40a4-bcb8-bbd011bedde8 tempest-VolumeDependencyTests-2049233334 None] Created volume successfully. Jul 08 01:56:22 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-c074ad3f-c8d2-4371-ba7d-67b18845e278 tempest-ProjectReaderTests-1853369274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:56:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c074ad3f-c8d2-4371-ba7d-67b18845e278 tempest-ProjectReaderTests-1853369274 None] Flow 'volume_create_manager' (3f98c596-3e42-407f-9fe0-a4768c32bf4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:56:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c074ad3f-c8d2-4371-ba7d-67b18845e278 tempest-ProjectReaderTests-1853369274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (645b1b28-894c-47c4-b00f-9c66fa1e567c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:22 devstack sudo[104882]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3ba73325-e3b6-46e7-b74e-a8cd81955f25 tempest-CreateVolumesFromSnapshotTest-1308629226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098.8eb90949-a87c-4b63-afd2-6b5f7c40913f" returned: 0 in 1.010s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3ba73325-e3b6-46e7-b74e-a8cd81955f25 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098.8eb90949-a87c-4b63-afd2-6b5f7c40913f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c074ad3f-c8d2-4371-ba7d-67b18845e278 tempest-ProjectReaderTests-1853369274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (645b1b28-894c-47c4-b00f-9c66fa1e567c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1708269799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffb226f6-f1c1-4297-932f-5ac14e2c149f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ea7304851a54e909902b31ad8c7b9fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:56:22Z,use_quota=True,user_id='6cbcf048279543ac91fcda34e34af5c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:22 devstack sudo[104891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098.8eb90949-a87c-4b63-afd2-6b5f7c40913f Jul 08 01:56:22 devstack sudo[104891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c074ad3f-c8d2-4371-ba7d-67b18845e278 tempest-ProjectReaderTests-1853369274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (780aef8b-3f0e-4301-8042-cb59f21a7918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c074ad3f-c8d2-4371-ba7d-67b18845e278 tempest-ProjectReaderTests-1853369274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (780aef8b-3f0e-4301-8042-cb59f21a7918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c074ad3f-c8d2-4371-ba7d-67b18845e278 tempest-ProjectReaderTests-1853369274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68b4a9e1-4184-40f2-9d6e-d652c5af57f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c074ad3f-c8d2-4371-ba7d-67b18845e278 tempest-ProjectReaderTests-1853369274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68b4a9e1-4184-40f2-9d6e-d652c5af57f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffb226f6-f1c1-4297-932f-5ac14e2c149f', 'volume_name': 'volume-ffb226f6-f1c1-4297-932f-5ac14e2c149f', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c074ad3f-c8d2-4371-ba7d-67b18845e278 tempest-ProjectReaderTests-1853369274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e898e944-668e-4080-a838-a8ac909c7884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c074ad3f-c8d2-4371-ba7d-67b18845e278 tempest-ProjectReaderTests-1853369274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e898e944-668e-4080-a838-a8ac909c7884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c074ad3f-c8d2-4371-ba7d-67b18845e278 tempest-ProjectReaderTests-1853369274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a94953d-19ab-42ed-8cc2-65c76a41db53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:22 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-c074ad3f-c8d2-4371-ba7d-67b18845e278 tempest-ProjectReaderTests-1853369274 None] Volume ffb226f6-f1c1-4297-932f-5ac14e2c149f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffb226f6-f1c1-4297-932f-5ac14e2c149f', 'volume_size': 1} Jul 08 01:56:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c074ad3f-c8d2-4371-ba7d-67b18845e278 tempest-ProjectReaderTests-1853369274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:23 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-dfcba224-2303-4946-b068-76df1e9dddd3 tempest-VolumeDependencyTests-2049233334 None] Acquiring lock "cinder-ffd6fa04-49aa-4021-95b9-785836f00cb6-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:23 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-dfcba224-2303-4946-b068-76df1e9dddd3 tempest-VolumeDependencyTests-2049233334 None] Lock "cinder-ffd6fa04-49aa-4021-95b9-785836f00cb6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:23 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-dfcba224-2303-4946-b068-76df1e9dddd3 tempest-VolumeDependencyTests-2049233334 None] Acquiring lock "cinder-quobyte-3f74217a-1edd-4118-a7b3-6cdab2b51544" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:23 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-dfcba224-2303-4946-b068-76df1e9dddd3 tempest-VolumeDependencyTests-2049233334 None] Lock "cinder-quobyte-3f74217a-1edd-4118-a7b3-6cdab2b51544" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:23 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-dfcba224-2303-4946-b068-76df1e9dddd3 tempest-VolumeDependencyTests-2049233334 None] Acquiring lock "cinder-quobyte-ffd6fa04-49aa-4021-95b9-785836f00cb6" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:23 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-dfcba224-2303-4946-b068-76df1e9dddd3 tempest-VolumeDependencyTests-2049233334 None] Lock "cinder-quobyte-ffd6fa04-49aa-4021-95b9-785836f00cb6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:23 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-dfcba224-2303-4946-b068-76df1e9dddd3 tempest-VolumeDependencyTests-2049233334 None] Deleting offline snapshot ffd6fa04-49aa-4021-95b9-785836f00cb6 of volume 3f74217a-1edd-4118-a7b3-6cdab2b51544 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:56:23 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-dfcba224-2303-4946-b068-76df1e9dddd3 tempest-VolumeDependencyTests-2049233334 None] snapshot_file for this snap is: volume-3f74217a-1edd-4118-a7b3-6cdab2b51544.ffd6fa04-49aa-4021-95b9-785836f00cb6 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:56:23 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93f304c-37cf-4523-af3d-f68f109aa77f]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-dfcba224-2303-4946-b068-76df1e9dddd3 tempest-VolumeDependencyTests-2049233334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544.ffd6fa04-49aa-4021-95b9-785836f00cb6 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:23 devstack sudo[104896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544.ffd6fa04-49aa-4021-95b9-785836f00cb6 Jul 08 01:56:23 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:23 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-80427bcc-fe46-4ed2-af47-b883f3c18b81 tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374 1073741824" returned: 0 in 1.155s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-80427bcc-fe46-4ed2-af47-b883f3c18b81 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:23 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374 Jul 08 01:56:23 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:23 devstack sudo[104891]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3ba73325-e3b6-46e7-b74e-a8cd81955f25 tempest-CreateVolumesFromSnapshotTest-1308629226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098.8eb90949-a87c-4b63-afd2-6b5f7c40913f" returned: 0 in 0.840s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:23 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3ba73325-e3b6-46e7-b74e-a8cd81955f25 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "cinder-quobyte-8eb90949-a87c-4b63-afd2-6b5f7c40913f" released by "_delete_snapshot" :: held 5.286s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:23 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3ba73325-e3b6-46e7-b74e-a8cd81955f25 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "cinder-quobyte-6e6155d5-fbf2-43ea-a765-4584980f9098" released by "delete_snapshot" :: held 5.374s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:23 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-3ba73325-e3b6-46e7-b74e-a8cd81955f25 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Created reservations ['d9486a38-b34b-4509-acd2-23a699491ede', 'cf44228c-72cb-4531-bd2f-793ad9c750ca', '442bcb04-ec31-4769-a751-2d87a4b6830e', '9e31c104-c093-4e11-9977-2ec4e2d2c3eb'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:56:23 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-3ba73325-e3b6-46e7-b74e-a8cd81955f25 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Delete snapshot completed successfully. Jul 08 01:56:23 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3ba73325-e3b6-46e7-b74e-a8cd81955f25 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "cinder-8eb90949-a87c-4b63-afd2-6b5f7c40913f-delete_snapshot" released by "delete_snapshot" :: held 5.562s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:24 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-dfcba224-2303-4946-b068-76df1e9dddd3 tempest-VolumeDependencyTests-2049233334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544.ffd6fa04-49aa-4021-95b9-785836f00cb6" returned: 0 in 0.895s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:24 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-dfcba224-2303-4946-b068-76df1e9dddd3 tempest-VolumeDependencyTests-2049233334 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f74217a-1edd-4118-a7b3-6cdab2b51544(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:56:24 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[33077361-36e1-43f9-baab-01c0dbd80ffd]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-dfcba224-2303-4946-b068-76df1e9dddd3 tempest-VolumeDependencyTests-2049233334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:24 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-80427bcc-fe46-4ed2-af47-b883f3c18b81 tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374" returned: 0 in 0.772s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:24 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-80427bcc-fe46-4ed2-af47-b883f3c18b81 tempest-ProjectReaderTests-756482943 None] <== create_volume: return (2000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:56:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-80427bcc-fe46-4ed2-af47-b883f3c18b81 tempest-ProjectReaderTests-756482943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.004s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c074ad3f-c8d2-4371-ba7d-67b18845e278 tempest-ProjectReaderTests-1853369274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.493s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:24 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c074ad3f-c8d2-4371-ba7d-67b18845e278 tempest-ProjectReaderTests-1853369274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1708269799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffb226f6-f1c1-4297-932f-5ac14e2c149f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ea7304851a54e909902b31ad8c7b9fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:56:22Z,use_quota=True,user_id='6cbcf048279543ac91fcda34e34af5c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:56:24 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-c074ad3f-c8d2-4371-ba7d-67b18845e278 tempest-ProjectReaderTests-1853369274 None] Creating volume ffb226f6-f1c1-4297-932f-5ac14e2c149f {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:56:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c074ad3f-c8d2-4371-ba7d-67b18845e278 tempest-ProjectReaderTests-1853369274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c074ad3f-c8d2-4371-ba7d-67b18845e278 tempest-ProjectReaderTests-1853369274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:24 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c074ad3f-c8d2-4371-ba7d-67b18845e278 tempest-ProjectReaderTests-1853369274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:24 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c074ad3f-c8d2-4371-ba7d-67b18845e278 tempest-ProjectReaderTests-1853369274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c074ad3f-c8d2-4371-ba7d-67b18845e278 tempest-ProjectReaderTests-1853369274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:24 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c074ad3f-c8d2-4371-ba7d-67b18845e278 tempest-ProjectReaderTests-1853369274 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:56:24 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-c074ad3f-c8d2-4371-ba7d-67b18845e278 tempest-ProjectReaderTests-1853369274 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:56:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c074ad3f-c8d2-4371-ba7d-67b18845e278 tempest-ProjectReaderTests-1853369274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ffb226f6-f1c1-4297-932f-5ac14e2c149f 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:24 devstack sudo[104906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ffb226f6-f1c1-4297-932f-5ac14e2c149f 1073741824 Jul 08 01:56:24 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-80427bcc-fe46-4ed2-af47-b883f3c18b81 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a70f0c-66b5-4e86-aded-7bb665786101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f58e786-4c67-414a-be6e-a5029fbf7374', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-80427bcc-fe46-4ed2-af47-b883f3c18b81 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27c7e99d-4720-487f-b03b-777b01705937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:24 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-80427bcc-fe46-4ed2-af47-b883f3c18b81 tempest-ProjectReaderTests-756482943 None] Volume volume-9f58e786-4c67-414a-be6e-a5029fbf7374 (9f58e786-4c67-414a-be6e-a5029fbf7374): created successfully Jul 08 01:56:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-80427bcc-fe46-4ed2-af47-b883f3c18b81 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27c7e99d-4720-487f-b03b-777b01705937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-80427bcc-fe46-4ed2-af47-b883f3c18b81 tempest-ProjectReaderTests-756482943 None] Flow 'volume_create_manager' (9d214244-3a3d-4327-a19e-0777ac4d1ae1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:56:24 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-80427bcc-fe46-4ed2-af47-b883f3c18b81 tempest-ProjectReaderTests-756482943 None] Created volume successfully. Jul 08 01:56:24 devstack sudo[104905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544 Jul 08 01:56:24 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:24 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-211246b0-c3bf-43d3-a595-c224b8111198 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Acquiring lock "cinder-6e6155d5-fbf2-43ea-a765-4584980f9098-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:24 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-211246b0-c3bf-43d3-a595-c224b8111198 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "cinder-6e6155d5-fbf2-43ea-a765-4584980f9098-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:24 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-211246b0-c3bf-43d3-a595-c224b8111198 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Acquiring lock "cinder-quobyte-6e6155d5-fbf2-43ea-a765-4584980f9098" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:24 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-211246b0-c3bf-43d3-a595-c224b8111198 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "cinder-quobyte-6e6155d5-fbf2-43ea-a765-4584980f9098" acquired by "delete_volume" :: waited 0.021s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:24 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e87a79-8528-41b3-a24f-e88fa0b6cd8f]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-211246b0-c3bf-43d3-a595-c224b8111198 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:24 devstack sudo[104909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098 Jul 08 01:56:24 devstack sudo[104909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:25 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-dfcba224-2303-4946-b068-76df1e9dddd3 tempest-VolumeDependencyTests-2049233334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544" returned: 0 in 1.038s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-dfcba224-2303-4946-b068-76df1e9dddd3 tempest-VolumeDependencyTests-2049233334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544.ffd6fa04-49aa-4021-95b9-785836f00cb6 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:25 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c074ad3f-c8d2-4371-ba7d-67b18845e278 tempest-ProjectReaderTests-1853369274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ffb226f6-f1c1-4297-932f-5ac14e2c149f 1073741824" returned: 0 in 1.012s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:25 devstack sudo[104918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544.ffd6fa04-49aa-4021-95b9-785836f00cb6 Jul 08 01:56:25 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c074ad3f-c8d2-4371-ba7d-67b18845e278 tempest-ProjectReaderTests-1853369274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ffb226f6-f1c1-4297-932f-5ac14e2c149f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:25 devstack sudo[104920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ffb226f6-f1c1-4297-932f-5ac14e2c149f Jul 08 01:56:25 devstack sudo[104920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-09f45565-75cd-4dba-a8b8-a1da8074f0c6 tempest-ProjectReaderTests-756482943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:25 devstack sudo[104909]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-211246b0-c3bf-43d3-a595-c224b8111198 tempest-CreateVolumesFromSnapshotTest-1308629226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098" returned: 0 in 1.206s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-211246b0-c3bf-43d3-a595-c224b8111198 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:25 devstack sudo[104926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098 Jul 08 01:56:25 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:26 devstack sudo[104920]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c074ad3f-c8d2-4371-ba7d-67b18845e278 tempest-ProjectReaderTests-1853369274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ffb226f6-f1c1-4297-932f-5ac14e2c149f" returned: 0 in 0.916s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:26 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c074ad3f-c8d2-4371-ba7d-67b18845e278 tempest-ProjectReaderTests-1853369274 None] <== create_volume: return (2003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:56:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c074ad3f-c8d2-4371-ba7d-67b18845e278 tempest-ProjectReaderTests-1853369274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-09f45565-75cd-4dba-a8b8-a1da8074f0c6 tempest-ProjectReaderTests-756482943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.341s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c074ad3f-c8d2-4371-ba7d-67b18845e278 tempest-ProjectReaderTests-1853369274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a94953d-19ab-42ed-8cc2-65c76a41db53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffb226f6-f1c1-4297-932f-5ac14e2c149f', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c074ad3f-c8d2-4371-ba7d-67b18845e278 tempest-ProjectReaderTests-1853369274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa0af290-0a4d-4766-a66f-4dfa62435a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:26 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-09f45565-75cd-4dba-a8b8-a1da8074f0c6 tempest-ProjectReaderTests-756482943 None] Creating offline snapshot eaae56f0-3c25-4c98-9715-4d1dadea0c97 of volume 9f58e786-4c67-414a-be6e-a5029fbf7374 {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:56:26 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-c074ad3f-c8d2-4371-ba7d-67b18845e278 tempest-ProjectReaderTests-1853369274 None] Volume volume-ffb226f6-f1c1-4297-932f-5ac14e2c149f (ffb226f6-f1c1-4297-932f-5ac14e2c149f): created successfully Jul 08 01:56:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c074ad3f-c8d2-4371-ba7d-67b18845e278 tempest-ProjectReaderTests-1853369274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa0af290-0a4d-4766-a66f-4dfa62435a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-c074ad3f-c8d2-4371-ba7d-67b18845e278 tempest-ProjectReaderTests-1853369274 None] Flow 'volume_create_manager' (3f98c596-3e42-407f-9fe0-a4768c32bf4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:56:26 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8fbd7f-8cc7-4ae5-b016-92b9930c6416]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-09f45565-75cd-4dba-a8b8-a1da8074f0c6 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:26 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-dfcba224-2303-4946-b068-76df1e9dddd3 tempest-VolumeDependencyTests-2049233334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544.ffd6fa04-49aa-4021-95b9-785836f00cb6" returned: 0 in 1.115s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-dfcba224-2303-4946-b068-76df1e9dddd3 tempest-VolumeDependencyTests-2049233334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544.ffd6fa04-49aa-4021-95b9-785836f00cb6 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:26 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-c074ad3f-c8d2-4371-ba7d-67b18845e278 tempest-ProjectReaderTests-1853369274 None] Created volume successfully. Jul 08 01:56:26 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544.ffd6fa04-49aa-4021-95b9-785836f00cb6 Jul 08 01:56:26 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:26 devstack sudo[104932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374 Jul 08 01:56:26 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:26 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-211246b0-c3bf-43d3-a595-c224b8111198 tempest-CreateVolumesFromSnapshotTest-1308629226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6e6155d5-fbf2-43ea-a765-4584980f9098" returned: 0 in 0.911s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:26 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-211246b0-c3bf-43d3-a595-c224b8111198 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "cinder-quobyte-6e6155d5-fbf2-43ea-a765-4584980f9098" released by "delete_volume" :: held 2.206s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:26 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-211246b0-c3bf-43d3-a595-c224b8111198 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Created reservations ['ff75c914-657b-4727-b5c8-21d2f4d455c4', 'd4f1bef3-bcae-4079-8d94-8bd81eb42321', 'ea0eae78-cae2-4eb0-a4d5-b877731bf090', '18b8eea8-6edd-4fe5-924b-e7d6e82df7ac'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:56:27 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-59f9ac8a-2211-450b-94a6-8355c6b82a49 tempest-ProjectReaderTests-1853369274 None] Acquiring lock "cinder-ffb226f6-f1c1-4297-932f-5ac14e2c149f-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-211246b0-c3bf-43d3-a595-c224b8111198 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-211246b0-c3bf-43d3-a595-c224b8111198 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:27 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-211246b0-c3bf-43d3-a595-c224b8111198 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:27 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-211246b0-c3bf-43d3-a595-c224b8111198 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-211246b0-c3bf-43d3-a595-c224b8111198 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-211246b0-c3bf-43d3-a595-c224b8111198 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:27 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-dfcba224-2303-4946-b068-76df1e9dddd3 tempest-VolumeDependencyTests-2049233334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544.ffd6fa04-49aa-4021-95b9-785836f00cb6" returned: 0 in 0.856s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:27 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-59f9ac8a-2211-450b-94a6-8355c6b82a49 tempest-ProjectReaderTests-1853369274 None] Lock "cinder-ffb226f6-f1c1-4297-932f-5ac14e2c149f-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:27 devstack sudo[104938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:56:27 devstack sudo[104938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:27 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-dfcba224-2303-4946-b068-76df1e9dddd3 tempest-VolumeDependencyTests-2049233334 None] Lock "cinder-quobyte-ffd6fa04-49aa-4021-95b9-785836f00cb6" released by "_delete_snapshot" :: held 4.047s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:27 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-dfcba224-2303-4946-b068-76df1e9dddd3 tempest-VolumeDependencyTests-2049233334 None] Lock "cinder-quobyte-3f74217a-1edd-4118-a7b3-6cdab2b51544" released by "delete_snapshot" :: held 4.075s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:27 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-59f9ac8a-2211-450b-94a6-8355c6b82a49 tempest-ProjectReaderTests-1853369274 None] Acquiring lock "cinder-quobyte-ffb226f6-f1c1-4297-932f-5ac14e2c149f" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:27 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-59f9ac8a-2211-450b-94a6-8355c6b82a49 tempest-ProjectReaderTests-1853369274 None] Lock "cinder-quobyte-ffb226f6-f1c1-4297-932f-5ac14e2c149f" acquired by "delete_volume" :: waited 0.022s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:27 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[b132bbce-73e0-4ebc-8d98-b9ec035227e1]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-59f9ac8a-2211-450b-94a6-8355c6b82a49 tempest-ProjectReaderTests-1853369274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ffb226f6-f1c1-4297-932f-5ac14e2c149f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:27 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-09f45565-75cd-4dba-a8b8-a1da8074f0c6 tempest-ProjectReaderTests-756482943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374" returned: 0 in 1.056s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-09f45565-75cd-4dba-a8b8-a1da8074f0c6 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374.eaae56f0-3c25-4c98-9715-4d1dadea0c97 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:27 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-dfcba224-2303-4946-b068-76df1e9dddd3 tempest-VolumeDependencyTests-2049233334 None] Created reservations ['cf2b95c4-bf3c-4436-a45d-0b9e1f4b596f', '9372ff5b-f598-4af8-8842-01e586e0d56f', '4c318c8b-7be2-4032-983f-0577353df502', '8cc69a75-28a3-4a0e-9e44-07e2389ce76d'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:56:27 devstack sudo[104944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374.eaae56f0-3c25-4c98-9715-4d1dadea0c97 1G Jul 08 01:56:27 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:27 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-dfcba224-2303-4946-b068-76df1e9dddd3 tempest-VolumeDependencyTests-2049233334 None] Delete snapshot completed successfully. Jul 08 01:56:27 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-dfcba224-2303-4946-b068-76df1e9dddd3 tempest-VolumeDependencyTests-2049233334 None] Lock "cinder-ffd6fa04-49aa-4021-95b9-785836f00cb6-delete_snapshot" released by "delete_snapshot" :: held 4.328s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:27 devstack sudo[104943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ffb226f6-f1c1-4297-932f-5ac14e2c149f Jul 08 01:56:27 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-211246b0-c3bf-43d3-a595-c224b8111198 tempest-CreateVolumesFromSnapshotTest-1308629226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.785s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:27 devstack sudo[104938]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:27 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-211246b0-c3bf-43d3-a595-c224b8111198 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:56:27 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-211246b0-c3bf-43d3-a595-c224b8111198 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Deleted volume successfully. Jul 08 01:56:27 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-211246b0-c3bf-43d3-a595-c224b8111198 tempest-CreateVolumesFromSnapshotTest-1308629226 None] Lock "cinder-6e6155d5-fbf2-43ea-a765-4584980f9098-delete_volume" released by "delete_volume" :: held 3.335s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:28 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-59f9ac8a-2211-450b-94a6-8355c6b82a49 tempest-ProjectReaderTests-1853369274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ffb226f6-f1c1-4297-932f-5ac14e2c149f" returned: 0 in 0.995s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-59f9ac8a-2211-450b-94a6-8355c6b82a49 tempest-ProjectReaderTests-1853369274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ffb226f6-f1c1-4297-932f-5ac14e2c149f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:28 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ffb226f6-f1c1-4297-932f-5ac14e2c149f Jul 08 01:56:28 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:28 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-09f45565-75cd-4dba-a8b8-a1da8074f0c6 tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374.eaae56f0-3c25-4c98-9715-4d1dadea0c97 1G" returned: 0 in 1.111s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-09f45565-75cd-4dba-a8b8-a1da8074f0c6 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f58e786-4c67-414a-be6e-a5029fbf7374 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374.eaae56f0-3c25-4c98-9715-4d1dadea0c97 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:28 devstack sudo[104965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f58e786-4c67-414a-be6e-a5029fbf7374 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374.eaae56f0-3c25-4c98-9715-4d1dadea0c97 Jul 08 01:56:28 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:28 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-a9c8ff76-1fb2-4883-a50c-9965c4fe18d4 tempest-VolumeDependencyTests-2049233334 None] Acquiring lock "cinder-3f74217a-1edd-4118-a7b3-6cdab2b51544-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:28 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-a9c8ff76-1fb2-4883-a50c-9965c4fe18d4 tempest-VolumeDependencyTests-2049233334 None] Lock "cinder-3f74217a-1edd-4118-a7b3-6cdab2b51544-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:28 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-a9c8ff76-1fb2-4883-a50c-9965c4fe18d4 tempest-VolumeDependencyTests-2049233334 None] Acquiring lock "cinder-quobyte-3f74217a-1edd-4118-a7b3-6cdab2b51544" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:28 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-a9c8ff76-1fb2-4883-a50c-9965c4fe18d4 tempest-VolumeDependencyTests-2049233334 None] Lock "cinder-quobyte-3f74217a-1edd-4118-a7b3-6cdab2b51544" acquired by "delete_volume" :: waited 0.032s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:28 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[8005d124-db8e-488b-ac0f-4be47de488d2]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a9c8ff76-1fb2-4883-a50c-9965c4fe18d4 tempest-VolumeDependencyTests-2049233334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:28 devstack sudo[104967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544 Jul 08 01:56:28 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:29 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-59f9ac8a-2211-450b-94a6-8355c6b82a49 tempest-ProjectReaderTests-1853369274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-ffb226f6-f1c1-4297-932f-5ac14e2c149f" returned: 0 in 0.891s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:29 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-59f9ac8a-2211-450b-94a6-8355c6b82a49 tempest-ProjectReaderTests-1853369274 None] Lock "cinder-quobyte-ffb226f6-f1c1-4297-932f-5ac14e2c149f" released by "delete_volume" :: held 1.963s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:29 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-59f9ac8a-2211-450b-94a6-8355c6b82a49 tempest-ProjectReaderTests-1853369274 None] Created reservations ['74405f40-def0-4f8d-8c16-1de21770a9f6', 'd941923a-cf3e-4549-8293-8dfcef3c13bc', 'be14e677-afbc-495a-9414-58fdbdea4516', '6aaa19c6-8ba3-4386-90e2-9ade0f43aa64'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:56:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-59f9ac8a-2211-450b-94a6-8355c6b82a49 tempest-ProjectReaderTests-1853369274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-59f9ac8a-2211-450b-94a6-8355c6b82a49 tempest-ProjectReaderTests-1853369274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:29 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-59f9ac8a-2211-450b-94a6-8355c6b82a49 tempest-ProjectReaderTests-1853369274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:29 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-59f9ac8a-2211-450b-94a6-8355c6b82a49 tempest-ProjectReaderTests-1853369274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-59f9ac8a-2211-450b-94a6-8355c6b82a49 tempest-ProjectReaderTests-1853369274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-59f9ac8a-2211-450b-94a6-8355c6b82a49 tempest-ProjectReaderTests-1853369274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:29 devstack sudo[104974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:56:29 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:29 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-09f45565-75cd-4dba-a8b8-a1da8074f0c6 tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f58e786-4c67-414a-be6e-a5029fbf7374 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374.eaae56f0-3c25-4c98-9715-4d1dadea0c97" returned: 0 in 1.137s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:29 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-09f45565-75cd-4dba-a8b8-a1da8074f0c6 tempest-ProjectReaderTests-756482943 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374.eaae56f0-3c25-4c98-9715-4d1dadea0c97 is being set with open permissions: ugo+rw Jul 08 01:56:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-09f45565-75cd-4dba-a8b8-a1da8074f0c6 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374.eaae56f0-3c25-4c98-9715-4d1dadea0c97 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:29 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374.eaae56f0-3c25-4c98-9715-4d1dadea0c97 Jul 08 01:56:29 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:29 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a9c8ff76-1fb2-4883-a50c-9965c4fe18d4 tempest-VolumeDependencyTests-2049233334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544" returned: 0 in 1.055s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a9c8ff76-1fb2-4883-a50c-9965c4fe18d4 tempest-VolumeDependencyTests-2049233334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:29 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544 Jul 08 01:56:29 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:30 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-09f45565-75cd-4dba-a8b8-a1da8074f0c6 tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374.eaae56f0-3c25-4c98-9715-4d1dadea0c97" returned: 0 in 0.846s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:30 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-59f9ac8a-2211-450b-94a6-8355c6b82a49 tempest-ProjectReaderTests-1853369274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.016s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:30 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-59f9ac8a-2211-450b-94a6-8355c6b82a49 tempest-ProjectReaderTests-1853369274 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:56:30 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-59f9ac8a-2211-450b-94a6-8355c6b82a49 tempest-ProjectReaderTests-1853369274 None] Deleted volume successfully. Jul 08 01:56:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-09f45565-75cd-4dba-a8b8-a1da8074f0c6 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:30 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-59f9ac8a-2211-450b-94a6-8355c6b82a49 tempest-ProjectReaderTests-1853369274 None] Lock "cinder-ffb226f6-f1c1-4297-932f-5ac14e2c149f-delete_volume" released by "delete_volume" :: held 3.361s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:30 devstack sudo[104986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374.info Jul 08 01:56:30 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:30 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a9c8ff76-1fb2-4883-a50c-9965c4fe18d4 tempest-VolumeDependencyTests-2049233334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f74217a-1edd-4118-a7b3-6cdab2b51544" returned: 0 in 1.054s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:30 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-a9c8ff76-1fb2-4883-a50c-9965c4fe18d4 tempest-VolumeDependencyTests-2049233334 None] Lock "cinder-quobyte-3f74217a-1edd-4118-a7b3-6cdab2b51544" released by "delete_volume" :: held 2.207s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:30 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-a9c8ff76-1fb2-4883-a50c-9965c4fe18d4 tempest-VolumeDependencyTests-2049233334 None] Created reservations ['08146178-dc68-4f2d-8f2d-0a0c76b0f59e', '4a170ac9-0858-469a-a44a-68347344656e', 'c709ccab-b923-4360-9a77-7bc40e5c0702', 'a1e8d75d-5386-4702-92db-3c689d20ed9b'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:56:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a9c8ff76-1fb2-4883-a50c-9965c4fe18d4 tempest-VolumeDependencyTests-2049233334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a9c8ff76-1fb2-4883-a50c-9965c4fe18d4 tempest-VolumeDependencyTests-2049233334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:31 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a9c8ff76-1fb2-4883-a50c-9965c4fe18d4 tempest-VolumeDependencyTests-2049233334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:31 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a9c8ff76-1fb2-4883-a50c-9965c4fe18d4 tempest-VolumeDependencyTests-2049233334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a9c8ff76-1fb2-4883-a50c-9965c4fe18d4 tempest-VolumeDependencyTests-2049233334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a9c8ff76-1fb2-4883-a50c-9965c4fe18d4 tempest-VolumeDependencyTests-2049233334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:31 devstack sudo[104989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:56:31 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:31 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa74094b-b13d-4cb2-9b7b-02b983196306 tempest-ProjectReaderTests-1853369274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:56:31 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-aa74094b-b13d-4cb2-9b7b-02b983196306 tempest-ProjectReaderTests-1853369274 None] Flow 'volume_create_manager' (4fc256bb-7a93-4ce9-8bf4-b442953ebda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:56:31 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-aa74094b-b13d-4cb2-9b7b-02b983196306 tempest-ProjectReaderTests-1853369274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7d37c26-78f8-4c4e-82ae-d3139ab3bb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:31 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-aa74094b-b13d-4cb2-9b7b-02b983196306 tempest-ProjectReaderTests-1853369274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7d37c26-78f8-4c4e-82ae-d3139ab3bb40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1871241833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0232c746-b505-4ed0-9387-520021641f29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ea7304851a54e909902b31ad8c7b9fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:56:31Z,use_quota=True,user_id='6cbcf048279543ac91fcda34e34af5c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:31 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-aa74094b-b13d-4cb2-9b7b-02b983196306 tempest-ProjectReaderTests-1853369274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec1965b-4cb1-4bfb-9ad0-21718a5ed512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:31 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-aa74094b-b13d-4cb2-9b7b-02b983196306 tempest-ProjectReaderTests-1853369274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec1965b-4cb1-4bfb-9ad0-21718a5ed512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:31 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-aa74094b-b13d-4cb2-9b7b-02b983196306 tempest-ProjectReaderTests-1853369274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c9aa339-dd54-4e1e-8b2d-65ec202665f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:31 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-aa74094b-b13d-4cb2-9b7b-02b983196306 tempest-ProjectReaderTests-1853369274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c9aa339-dd54-4e1e-8b2d-65ec202665f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0232c746-b505-4ed0-9387-520021641f29', 'volume_name': 'volume-0232c746-b505-4ed0-9387-520021641f29', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:31 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-aa74094b-b13d-4cb2-9b7b-02b983196306 tempest-ProjectReaderTests-1853369274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0793d3b-11fc-4501-b5ba-e0d262b0cfd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:31 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-aa74094b-b13d-4cb2-9b7b-02b983196306 tempest-ProjectReaderTests-1853369274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0793d3b-11fc-4501-b5ba-e0d262b0cfd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:31 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-aa74094b-b13d-4cb2-9b7b-02b983196306 tempest-ProjectReaderTests-1853369274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbe31314-3e32-421a-a531-d42619e368b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:31 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-aa74094b-b13d-4cb2-9b7b-02b983196306 tempest-ProjectReaderTests-1853369274 None] Volume 0232c746-b505-4ed0-9387-520021641f29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0232c746-b505-4ed0-9387-520021641f29', 'volume_size': 1} Jul 08 01:56:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-aa74094b-b13d-4cb2-9b7b-02b983196306 tempest-ProjectReaderTests-1853369274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:31 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-09f45565-75cd-4dba-a8b8-a1da8074f0c6 tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374.info" returned: 0 in 1.050s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:31 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-09f45565-75cd-4dba-a8b8-a1da8074f0c6 tempest-ProjectReaderTests-756482943 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374.info is being set with open permissions: ugo+rw Jul 08 01:56:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-09f45565-75cd-4dba-a8b8-a1da8074f0c6 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:31 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374.info Jul 08 01:56:31 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:31 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a9c8ff76-1fb2-4883-a50c-9965c4fe18d4 tempest-VolumeDependencyTests-2049233334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.770s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:31 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-a9c8ff76-1fb2-4883-a50c-9965c4fe18d4 tempest-VolumeDependencyTests-2049233334 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:56:31 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-a9c8ff76-1fb2-4883-a50c-9965c4fe18d4 tempest-VolumeDependencyTests-2049233334 None] Deleted volume successfully. Jul 08 01:56:31 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-a9c8ff76-1fb2-4883-a50c-9965c4fe18d4 tempest-VolumeDependencyTests-2049233334 None] Lock "cinder-3f74217a-1edd-4118-a7b3-6cdab2b51544-delete_volume" released by "delete_volume" :: held 3.409s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:31 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-8c2f41a1-5688-4a9f-af76-cce79f5f6b02 tempest-VolumeDependencyTests-2049233334 None] Acquiring lock "cinder-c024d28e-bebc-4676-a83a-5b109b11ffa0-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:32 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-8c2f41a1-5688-4a9f-af76-cce79f5f6b02 tempest-VolumeDependencyTests-2049233334 None] Lock "cinder-c024d28e-bebc-4676-a83a-5b109b11ffa0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:32 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-8c2f41a1-5688-4a9f-af76-cce79f5f6b02 tempest-VolumeDependencyTests-2049233334 None] Acquiring lock "cinder-quobyte-c024d28e-bebc-4676-a83a-5b109b11ffa0" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:32 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-8c2f41a1-5688-4a9f-af76-cce79f5f6b02 tempest-VolumeDependencyTests-2049233334 None] Lock "cinder-quobyte-c024d28e-bebc-4676-a83a-5b109b11ffa0" acquired by "delete_volume" :: waited 0.030s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:32 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[99309d49-be58-44bb-a178-dd93204d83b4]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8c2f41a1-5688-4a9f-af76-cce79f5f6b02 tempest-VolumeDependencyTests-2049233334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c024d28e-bebc-4676-a83a-5b109b11ffa0 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:32 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-73307c44-b895-4827-97a6-141f920ef3b1 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:56:32 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-73307c44-b895-4827-97a6-141f920ef3b1 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Flow 'volume_create_manager' (99d3ee14-43d6-4741-b0b1-57488755060c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:56:32 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-73307c44-b895-4827-97a6-141f920ef3b1 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d629e7f-cfcc-4be5-86a5-e2e823495473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:32 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-73307c44-b895-4827-97a6-141f920ef3b1 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d629e7f-cfcc-4be5-86a5-e2e823495473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-256053084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0634d5d-8fa2-42cb-b8a9-b6c4dbc98e34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad1b04cb019344aabcaeea2557ef554c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:56:32Z,use_quota=True,user_id='ea2d1ca756ac493386f8be1f25c8c45b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:32 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-73307c44-b895-4827-97a6-141f920ef3b1 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b795479b-b673-425a-8f32-f8599de3557c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:32 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-73307c44-b895-4827-97a6-141f920ef3b1 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b795479b-b673-425a-8f32-f8599de3557c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:32 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-73307c44-b895-4827-97a6-141f920ef3b1 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e194d01-1ed3-4353-ab46-61da06933cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:32 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-73307c44-b895-4827-97a6-141f920ef3b1 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e194d01-1ed3-4353-ab46-61da06933cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0634d5d-8fa2-42cb-b8a9-b6c4dbc98e34', 'volume_name': 'volume-c0634d5d-8fa2-42cb-b8a9-b6c4dbc98e34', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:32 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-73307c44-b895-4827-97a6-141f920ef3b1 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21f8bedb-d5b5-48d8-a51a-4d5688cf34fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:32 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-73307c44-b895-4827-97a6-141f920ef3b1 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21f8bedb-d5b5-48d8-a51a-4d5688cf34fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:32 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-73307c44-b895-4827-97a6-141f920ef3b1 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faddc766-896c-4458-917a-6be3efa7d446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:32 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-73307c44-b895-4827-97a6-141f920ef3b1 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Volume c0634d5d-8fa2-42cb-b8a9-b6c4dbc98e34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0634d5d-8fa2-42cb-b8a9-b6c4dbc98e34', 'volume_size': 1} Jul 08 01:56:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-73307c44-b895-4827-97a6-141f920ef3b1 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:32 devstack sudo[104995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c024d28e-bebc-4676-a83a-5b109b11ffa0 Jul 08 01:56:32 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:32 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-09f45565-75cd-4dba-a8b8-a1da8074f0c6 tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374.info" returned: 0 in 0.907s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-09f45565-75cd-4dba-a8b8-a1da8074f0c6 tempest-ProjectReaderTests-756482943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.291s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-aa74094b-b13d-4cb2-9b7b-02b983196306 tempest-ProjectReaderTests-1853369274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.036s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:32 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-aa74094b-b13d-4cb2-9b7b-02b983196306 tempest-ProjectReaderTests-1853369274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1871241833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0232c746-b505-4ed0-9387-520021641f29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ea7304851a54e909902b31ad8c7b9fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:56:31Z,use_quota=True,user_id='6cbcf048279543ac91fcda34e34af5c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:56:32 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-aa74094b-b13d-4cb2-9b7b-02b983196306 tempest-ProjectReaderTests-1853369274 None] Creating volume 0232c746-b505-4ed0-9387-520021641f29 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:56:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-aa74094b-b13d-4cb2-9b7b-02b983196306 tempest-ProjectReaderTests-1853369274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-aa74094b-b13d-4cb2-9b7b-02b983196306 tempest-ProjectReaderTests-1853369274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:32 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-aa74094b-b13d-4cb2-9b7b-02b983196306 tempest-ProjectReaderTests-1853369274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:32 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-aa74094b-b13d-4cb2-9b7b-02b983196306 tempest-ProjectReaderTests-1853369274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-aa74094b-b13d-4cb2-9b7b-02b983196306 tempest-ProjectReaderTests-1853369274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:32 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-aa74094b-b13d-4cb2-9b7b-02b983196306 tempest-ProjectReaderTests-1853369274 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:56:32 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-aa74094b-b13d-4cb2-9b7b-02b983196306 tempest-ProjectReaderTests-1853369274 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:56:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-aa74094b-b13d-4cb2-9b7b-02b983196306 tempest-ProjectReaderTests-1853369274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0232c746-b505-4ed0-9387-520021641f29 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:32 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0232c746-b505-4ed0-9387-520021641f29 1073741824 Jul 08 01:56:32 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:32 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-09f45565-75cd-4dba-a8b8-a1da8074f0c6 tempest-ProjectReaderTests-756482943 None] Create snapshot completed successfully Jul 08 01:56:32 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8c2f41a1-5688-4a9f-af76-cce79f5f6b02 tempest-VolumeDependencyTests-2049233334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c024d28e-bebc-4676-a83a-5b109b11ffa0" returned: 0 in 0.858s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8c2f41a1-5688-4a9f-af76-cce79f5f6b02 tempest-VolumeDependencyTests-2049233334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c024d28e-bebc-4676-a83a-5b109b11ffa0 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:33 devstack sudo[105003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c024d28e-bebc-4676-a83a-5b109b11ffa0 Jul 08 01:56:33 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:33 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6f116a19-f758-405f-b827-11fb5495ea6e tempest-ProjectReaderTests-756482943 None] Acquiring lock "cinder-eaae56f0-3c25-4c98-9715-4d1dadea0c97-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:33 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6f116a19-f758-405f-b827-11fb5495ea6e tempest-ProjectReaderTests-756482943 None] Lock "cinder-eaae56f0-3c25-4c98-9715-4d1dadea0c97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:33 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6f116a19-f758-405f-b827-11fb5495ea6e tempest-ProjectReaderTests-756482943 None] Acquiring lock "cinder-quobyte-9f58e786-4c67-414a-be6e-a5029fbf7374" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:33 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-aa74094b-b13d-4cb2-9b7b-02b983196306 tempest-ProjectReaderTests-1853369274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0232c746-b505-4ed0-9387-520021641f29 1073741824" returned: 0 in 1.094s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:33 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6f116a19-f758-405f-b827-11fb5495ea6e tempest-ProjectReaderTests-756482943 None] Lock "cinder-quobyte-9f58e786-4c67-414a-be6e-a5029fbf7374" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:33 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6f116a19-f758-405f-b827-11fb5495ea6e tempest-ProjectReaderTests-756482943 None] Acquiring lock "cinder-quobyte-eaae56f0-3c25-4c98-9715-4d1dadea0c97" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:33 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6f116a19-f758-405f-b827-11fb5495ea6e tempest-ProjectReaderTests-756482943 None] Lock "cinder-quobyte-eaae56f0-3c25-4c98-9715-4d1dadea0c97" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:33 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-6f116a19-f758-405f-b827-11fb5495ea6e tempest-ProjectReaderTests-756482943 None] Deleting offline snapshot eaae56f0-3c25-4c98-9715-4d1dadea0c97 of volume 9f58e786-4c67-414a-be6e-a5029fbf7374 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:56:33 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-6f116a19-f758-405f-b827-11fb5495ea6e tempest-ProjectReaderTests-756482943 None] snapshot_file for this snap is: volume-9f58e786-4c67-414a-be6e-a5029fbf7374.eaae56f0-3c25-4c98-9715-4d1dadea0c97 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:56:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-aa74094b-b13d-4cb2-9b7b-02b983196306 tempest-ProjectReaderTests-1853369274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0232c746-b505-4ed0-9387-520021641f29 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:33 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e85076-324e-4dcc-a995-25a950d4f12f]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6f116a19-f758-405f-b827-11fb5495ea6e tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374.eaae56f0-3c25-4c98-9715-4d1dadea0c97 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:33 devstack sudo[105008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0232c746-b505-4ed0-9387-520021641f29 Jul 08 01:56:33 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:33 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374.eaae56f0-3c25-4c98-9715-4d1dadea0c97 Jul 08 01:56:33 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:33 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8c2f41a1-5688-4a9f-af76-cce79f5f6b02 tempest-VolumeDependencyTests-2049233334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c024d28e-bebc-4676-a83a-5b109b11ffa0" returned: 0 in 0.905s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:33 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-8c2f41a1-5688-4a9f-af76-cce79f5f6b02 tempest-VolumeDependencyTests-2049233334 None] Lock "cinder-quobyte-c024d28e-bebc-4676-a83a-5b109b11ffa0" released by "delete_volume" :: held 1.826s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:33 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-8c2f41a1-5688-4a9f-af76-cce79f5f6b02 tempest-VolumeDependencyTests-2049233334 None] Created reservations ['c50e82fc-d65c-4c6f-99f9-55b636c567f8', '0d4e8409-9333-48c3-830e-dc155c9edd72', 'e463685f-1885-44da-b5e4-f8c3c0d37fb7', '4c8d90b5-11d5-4d5d-96e1-dd1e3a033b85'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:56:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8c2f41a1-5688-4a9f-af76-cce79f5f6b02 tempest-VolumeDependencyTests-2049233334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8c2f41a1-5688-4a9f-af76-cce79f5f6b02 tempest-VolumeDependencyTests-2049233334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:34 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-8c2f41a1-5688-4a9f-af76-cce79f5f6b02 tempest-VolumeDependencyTests-2049233334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:34 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-8c2f41a1-5688-4a9f-af76-cce79f5f6b02 tempest-VolumeDependencyTests-2049233334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8c2f41a1-5688-4a9f-af76-cce79f5f6b02 tempest-VolumeDependencyTests-2049233334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8c2f41a1-5688-4a9f-af76-cce79f5f6b02 tempest-VolumeDependencyTests-2049233334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:34 devstack sudo[105013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:56:34 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:34 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-aa74094b-b13d-4cb2-9b7b-02b983196306 tempest-ProjectReaderTests-1853369274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0232c746-b505-4ed0-9387-520021641f29" returned: 0 in 0.923s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:34 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-aa74094b-b13d-4cb2-9b7b-02b983196306 tempest-ProjectReaderTests-1853369274 None] <== create_volume: return (2113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:56:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-aa74094b-b13d-4cb2-9b7b-02b983196306 tempest-ProjectReaderTests-1853369274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.117s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-73307c44-b895-4827-97a6-141f920ef3b1 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.281s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:34 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-73307c44-b895-4827-97a6-141f920ef3b1 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-256053084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0634d5d-8fa2-42cb-b8a9-b6c4dbc98e34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad1b04cb019344aabcaeea2557ef554c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:56:32Z,use_quota=True,user_id='ea2d1ca756ac493386f8be1f25c8c45b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:56:34 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-73307c44-b895-4827-97a6-141f920ef3b1 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Creating volume c0634d5d-8fa2-42cb-b8a9-b6c4dbc98e34 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:56:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-73307c44-b895-4827-97a6-141f920ef3b1 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-73307c44-b895-4827-97a6-141f920ef3b1 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:34 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-73307c44-b895-4827-97a6-141f920ef3b1 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:34 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-73307c44-b895-4827-97a6-141f920ef3b1 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-73307c44-b895-4827-97a6-141f920ef3b1 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:34 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-73307c44-b895-4827-97a6-141f920ef3b1 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:56:34 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-73307c44-b895-4827-97a6-141f920ef3b1 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:56:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-73307c44-b895-4827-97a6-141f920ef3b1 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0634d5d-8fa2-42cb-b8a9-b6c4dbc98e34 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:34 devstack sudo[105018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0634d5d-8fa2-42cb-b8a9-b6c4dbc98e34 1073741824 Jul 08 01:56:34 devstack sudo[105018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:34 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-aa74094b-b13d-4cb2-9b7b-02b983196306 tempest-ProjectReaderTests-1853369274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbe31314-3e32-421a-a531-d42619e368b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0232c746-b505-4ed0-9387-520021641f29', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:34 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-aa74094b-b13d-4cb2-9b7b-02b983196306 tempest-ProjectReaderTests-1853369274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a0e877f-295b-46ab-8fcf-e80c710be43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:34 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-aa74094b-b13d-4cb2-9b7b-02b983196306 tempest-ProjectReaderTests-1853369274 None] Volume volume-0232c746-b505-4ed0-9387-520021641f29 (0232c746-b505-4ed0-9387-520021641f29): created successfully Jul 08 01:56:34 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-aa74094b-b13d-4cb2-9b7b-02b983196306 tempest-ProjectReaderTests-1853369274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a0e877f-295b-46ab-8fcf-e80c710be43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:34 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-aa74094b-b13d-4cb2-9b7b-02b983196306 tempest-ProjectReaderTests-1853369274 None] Flow 'volume_create_manager' (4fc256bb-7a93-4ce9-8bf4-b442953ebda0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:56:34 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-aa74094b-b13d-4cb2-9b7b-02b983196306 tempest-ProjectReaderTests-1853369274 None] Created volume successfully. Jul 08 01:56:34 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6f116a19-f758-405f-b827-11fb5495ea6e tempest-ProjectReaderTests-756482943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374.eaae56f0-3c25-4c98-9715-4d1dadea0c97" returned: 0 in 1.101s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:34 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-6f116a19-f758-405f-b827-11fb5495ea6e tempest-ProjectReaderTests-756482943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f58e786-4c67-414a-be6e-a5029fbf7374(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:56:34 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6efb33f-9931-4a71-9b33-2ac0964e32cc]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6f116a19-f758-405f-b827-11fb5495ea6e tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:34 devstack sudo[105021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374 Jul 08 01:56:34 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:34 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8c2f41a1-5688-4a9f-af76-cce79f5f6b02 tempest-VolumeDependencyTests-2049233334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.926s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:34 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-8c2f41a1-5688-4a9f-af76-cce79f5f6b02 tempest-VolumeDependencyTests-2049233334 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:56:35 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-8c2f41a1-5688-4a9f-af76-cce79f5f6b02 tempest-VolumeDependencyTests-2049233334 None] Deleted volume successfully. Jul 08 01:56:35 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-8c2f41a1-5688-4a9f-af76-cce79f5f6b02 tempest-VolumeDependencyTests-2049233334 None] Lock "cinder-c024d28e-bebc-4676-a83a-5b109b11ffa0-delete_volume" released by "delete_volume" :: held 3.029s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:35 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-4e377895-d49f-4b40-9b46-1b3acf7053eb tempest-ProjectReaderTests-1853369274 None] Acquiring lock "cinder-0232c746-b505-4ed0-9387-520021641f29-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:35 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6f116a19-f758-405f-b827-11fb5495ea6e tempest-ProjectReaderTests-756482943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374" returned: 0 in 0.953s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:35 devstack sudo[105018]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6f116a19-f758-405f-b827-11fb5495ea6e tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374.eaae56f0-3c25-4c98-9715-4d1dadea0c97 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-73307c44-b895-4827-97a6-141f920ef3b1 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0634d5d-8fa2-42cb-b8a9-b6c4dbc98e34 1073741824" returned: 0 in 1.206s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:35 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-4e377895-d49f-4b40-9b46-1b3acf7053eb tempest-ProjectReaderTests-1853369274 None] Lock "cinder-0232c746-b505-4ed0-9387-520021641f29-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:35 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374.eaae56f0-3c25-4c98-9715-4d1dadea0c97 Jul 08 01:56:35 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-73307c44-b895-4827-97a6-141f920ef3b1 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0634d5d-8fa2-42cb-b8a9-b6c4dbc98e34 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:35 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-4e377895-d49f-4b40-9b46-1b3acf7053eb tempest-ProjectReaderTests-1853369274 None] Acquiring lock "cinder-quobyte-0232c746-b505-4ed0-9387-520021641f29" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:35 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0634d5d-8fa2-42cb-b8a9-b6c4dbc98e34 Jul 08 01:56:35 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:35 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-4e377895-d49f-4b40-9b46-1b3acf7053eb tempest-ProjectReaderTests-1853369274 None] Lock "cinder-quobyte-0232c746-b505-4ed0-9387-520021641f29" acquired by "delete_volume" :: waited 0.023s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:35 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d4b605-5830-47bd-ad25-8306f30a5d65]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4e377895-d49f-4b40-9b46-1b3acf7053eb tempest-ProjectReaderTests-1853369274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0232c746-b505-4ed0-9387-520021641f29 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:36 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0232c746-b505-4ed0-9387-520021641f29 Jul 08 01:56:36 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:36 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-73307c44-b895-4827-97a6-141f920ef3b1 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0634d5d-8fa2-42cb-b8a9-b6c4dbc98e34" returned: 0 in 0.935s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-73307c44-b895-4827-97a6-141f920ef3b1 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] <== create_volume: return (2215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:56:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-73307c44-b895-4827-97a6-141f920ef3b1 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.220s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-73307c44-b895-4827-97a6-141f920ef3b1 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faddc766-896c-4458-917a-6be3efa7d446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0634d5d-8fa2-42cb-b8a9-b6c4dbc98e34', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-73307c44-b895-4827-97a6-141f920ef3b1 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e1c12f-c30b-4efe-b445-498379e7e127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:36 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-73307c44-b895-4827-97a6-141f920ef3b1 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Volume volume-c0634d5d-8fa2-42cb-b8a9-b6c4dbc98e34 (c0634d5d-8fa2-42cb-b8a9-b6c4dbc98e34): created successfully Jul 08 01:56:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-73307c44-b895-4827-97a6-141f920ef3b1 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e1c12f-c30b-4efe-b445-498379e7e127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:36 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-73307c44-b895-4827-97a6-141f920ef3b1 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Flow 'volume_create_manager' (99d3ee14-43d6-4741-b0b1-57488755060c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:56:36 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-73307c44-b895-4827-97a6-141f920ef3b1 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Created volume successfully. Jul 08 01:56:36 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6f116a19-f758-405f-b827-11fb5495ea6e tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374.eaae56f0-3c25-4c98-9715-4d1dadea0c97" returned: 0 in 1.275s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6f116a19-f758-405f-b827-11fb5495ea6e tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374.eaae56f0-3c25-4c98-9715-4d1dadea0c97 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:37 devstack sudo[105047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374.eaae56f0-3c25-4c98-9715-4d1dadea0c97 Jul 08 01:56:37 devstack sudo[105047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:37 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4e377895-d49f-4b40-9b46-1b3acf7053eb tempest-ProjectReaderTests-1853369274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0232c746-b505-4ed0-9387-520021641f29" returned: 0 in 1.214s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4e377895-d49f-4b40-9b46-1b3acf7053eb tempest-ProjectReaderTests-1853369274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0232c746-b505-4ed0-9387-520021641f29 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:37 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0232c746-b505-4ed0-9387-520021641f29 Jul 08 01:56:37 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:37 devstack sudo[105047]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6f116a19-f758-405f-b827-11fb5495ea6e tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374.eaae56f0-3c25-4c98-9715-4d1dadea0c97" returned: 0 in 0.737s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:37 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6f116a19-f758-405f-b827-11fb5495ea6e tempest-ProjectReaderTests-756482943 None] Lock "cinder-quobyte-eaae56f0-3c25-4c98-9715-4d1dadea0c97" released by "_delete_snapshot" :: held 4.240s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:37 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6f116a19-f758-405f-b827-11fb5495ea6e tempest-ProjectReaderTests-756482943 None] Lock "cinder-quobyte-9f58e786-4c67-414a-be6e-a5029fbf7374" released by "delete_snapshot" :: held 4.273s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:37 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4e377895-d49f-4b40-9b46-1b3acf7053eb tempest-ProjectReaderTests-1853369274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-0232c746-b505-4ed0-9387-520021641f29" returned: 0 in 0.873s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-4e377895-d49f-4b40-9b46-1b3acf7053eb tempest-ProjectReaderTests-1853369274 None] Lock "cinder-quobyte-0232c746-b505-4ed0-9387-520021641f29" released by "delete_volume" :: held 2.164s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-6f116a19-f758-405f-b827-11fb5495ea6e tempest-ProjectReaderTests-756482943 None] Created reservations ['e22c7bab-a9dd-44d5-bec2-75e5665c2f49', 'ebf4c32b-0c41-463d-b03d-135695551852', '659d0566-ff32-46a4-96da-84fcd6fa7f21', 'c801b672-8407-4239-87d7-7eeff45eac8a'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:56:38 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-6f116a19-f758-405f-b827-11fb5495ea6e tempest-ProjectReaderTests-756482943 None] Delete snapshot completed successfully. Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6f116a19-f758-405f-b827-11fb5495ea6e tempest-ProjectReaderTests-756482943 None] Lock "cinder-eaae56f0-3c25-4c98-9715-4d1dadea0c97-delete_snapshot" released by "delete_snapshot" :: held 4.661s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-4e377895-d49f-4b40-9b46-1b3acf7053eb tempest-ProjectReaderTests-1853369274 None] Created reservations ['551a99a4-1f7d-4fb4-9d51-cf7685c26f0e', '21358c15-8342-40da-a288-7dd8a96303b9', '5fa97309-553f-4537-a5f7-891f381564c4', 'fada298d-c2f9-4fb9-b213-f414f4faf1ef'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4e377895-d49f-4b40-9b46-1b3acf7053eb tempest-ProjectReaderTests-1853369274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4e377895-d49f-4b40-9b46-1b3acf7053eb tempest-ProjectReaderTests-1853369274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-4e377895-d49f-4b40-9b46-1b3acf7053eb tempest-ProjectReaderTests-1853369274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-4e377895-d49f-4b40-9b46-1b3acf7053eb tempest-ProjectReaderTests-1853369274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-4e377895-d49f-4b40-9b46-1b3acf7053eb tempest-ProjectReaderTests-1853369274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4e377895-d49f-4b40-9b46-1b3acf7053eb tempest-ProjectReaderTests-1853369274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:38 devstack sudo[105053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:56:38 devstack sudo[105053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-a83faca3-f5ef-4596-aa4e-734ab0bc63f4 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a83faca3-f5ef-4596-aa4e-734ab0bc63f4 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Flow 'volume_create_manager' (78cfe46c-cbbb-430c-8eeb-bd761b6f5b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a83faca3-f5ef-4596-aa4e-734ab0bc63f4 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e8a6306-70dd-4a32-b8e8-6e51638bd7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a83faca3-f5ef-4596-aa4e-734ab0bc63f4 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e8a6306-70dd-4a32-b8e8-6e51638bd7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2014751946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f8b445b-b5b7-40e3-a36f-3ecaa42ad1ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad1b04cb019344aabcaeea2557ef554c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:56:38Z,use_quota=True,user_id='ea2d1ca756ac493386f8be1f25c8c45b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a83faca3-f5ef-4596-aa4e-734ab0bc63f4 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7129c193-4716-45bc-a138-03baa9165071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a83faca3-f5ef-4596-aa4e-734ab0bc63f4 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7129c193-4716-45bc-a138-03baa9165071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a83faca3-f5ef-4596-aa4e-734ab0bc63f4 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3e4f6e9-867b-40d5-a74a-18b6fbb562f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a83faca3-f5ef-4596-aa4e-734ab0bc63f4 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3e4f6e9-867b-40d5-a74a-18b6fbb562f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f8b445b-b5b7-40e3-a36f-3ecaa42ad1ff', 'volume_name': 'volume-3f8b445b-b5b7-40e3-a36f-3ecaa42ad1ff', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a83faca3-f5ef-4596-aa4e-734ab0bc63f4 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cb422c3-7f1b-47c1-be0d-1c3cf539e492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a83faca3-f5ef-4596-aa4e-734ab0bc63f4 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cb422c3-7f1b-47c1-be0d-1c3cf539e492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a83faca3-f5ef-4596-aa4e-734ab0bc63f4 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74baaf4f-db14-4095-af61-26f882c4805e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:38 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-a83faca3-f5ef-4596-aa4e-734ab0bc63f4 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Volume 3f8b445b-b5b7-40e3-a36f-3ecaa42ad1ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f8b445b-b5b7-40e3-a36f-3ecaa42ad1ff', 'volume_size': 1} Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a83faca3-f5ef-4596-aa4e-734ab0bc63f4 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a83faca3-f5ef-4596-aa4e-734ab0bc63f4 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a83faca3-f5ef-4596-aa4e-734ab0bc63f4 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2014751946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f8b445b-b5b7-40e3-a36f-3ecaa42ad1ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad1b04cb019344aabcaeea2557ef554c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:56:38Z,use_quota=True,user_id='ea2d1ca756ac493386f8be1f25c8c45b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-a83faca3-f5ef-4596-aa4e-734ab0bc63f4 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Creating volume 3f8b445b-b5b7-40e3-a36f-3ecaa42ad1ff {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a83faca3-f5ef-4596-aa4e-734ab0bc63f4 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a83faca3-f5ef-4596-aa4e-734ab0bc63f4 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a83faca3-f5ef-4596-aa4e-734ab0bc63f4 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a83faca3-f5ef-4596-aa4e-734ab0bc63f4 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a83faca3-f5ef-4596-aa4e-734ab0bc63f4 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a83faca3-f5ef-4596-aa4e-734ab0bc63f4 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:56:38 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-a83faca3-f5ef-4596-aa4e-734ab0bc63f4 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a83faca3-f5ef-4596-aa4e-734ab0bc63f4 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f8b445b-b5b7-40e3-a36f-3ecaa42ad1ff 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:38 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f8b445b-b5b7-40e3-a36f-3ecaa42ad1ff 1073741824 Jul 08 01:56:38 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-af7ab4b6-b134-45c9-8458-4bfc9d4d581b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-af7ab4b6-b134-45c9-8458-4bfc9d4d581b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Flow 'volume_create_manager' (d35db095-a02c-4d93-bc95-652227deb72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-af7ab4b6-b134-45c9-8458-4bfc9d4d581b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd14bd63-768e-4bae-89ea-8735a89ff609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-af7ab4b6-b134-45c9-8458-4bfc9d4d581b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd14bd63-768e-4bae-89ea-8735a89ff609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1212636641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1610c9f-fe5f-43de-a9ec-cc0a3095ac5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad1b04cb019344aabcaeea2557ef554c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:56:39Z,use_quota=True,user_id='ea2d1ca756ac493386f8be1f25c8c45b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-af7ab4b6-b134-45c9-8458-4bfc9d4d581b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eb51b36-5229-4c8a-ba33-963cdd00b24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-af7ab4b6-b134-45c9-8458-4bfc9d4d581b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eb51b36-5229-4c8a-ba33-963cdd00b24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-af7ab4b6-b134-45c9-8458-4bfc9d4d581b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b1d0e76-a328-4939-ad8a-ae26a5bb57cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-af7ab4b6-b134-45c9-8458-4bfc9d4d581b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b1d0e76-a328-4939-ad8a-ae26a5bb57cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1610c9f-fe5f-43de-a9ec-cc0a3095ac5d', 'volume_name': 'volume-b1610c9f-fe5f-43de-a9ec-cc0a3095ac5d', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-af7ab4b6-b134-45c9-8458-4bfc9d4d581b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d5b9293-5300-47c9-b3fd-93720a05a8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-af7ab4b6-b134-45c9-8458-4bfc9d4d581b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d5b9293-5300-47c9-b3fd-93720a05a8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-af7ab4b6-b134-45c9-8458-4bfc9d4d581b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73befe02-0342-4035-a440-aee3e84bc66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:38 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-af7ab4b6-b134-45c9-8458-4bfc9d4d581b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Volume b1610c9f-fe5f-43de-a9ec-cc0a3095ac5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1610c9f-fe5f-43de-a9ec-cc0a3095ac5d', 'volume_size': 1} Jul 08 01:56:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-af7ab4b6-b134-45c9-8458-4bfc9d4d581b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:39 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-8aeea94d-2f0a-4c2e-9472-5f10c47a0d44 tempest-ProjectReaderTests-756482943 None] Acquiring lock "cinder-9f58e786-4c67-414a-be6e-a5029fbf7374-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:39 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-8aeea94d-2f0a-4c2e-9472-5f10c47a0d44 tempest-ProjectReaderTests-756482943 None] Lock "cinder-9f58e786-4c67-414a-be6e-a5029fbf7374-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:39 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-8aeea94d-2f0a-4c2e-9472-5f10c47a0d44 tempest-ProjectReaderTests-756482943 None] Acquiring lock "cinder-quobyte-9f58e786-4c67-414a-be6e-a5029fbf7374" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:39 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-8aeea94d-2f0a-4c2e-9472-5f10c47a0d44 tempest-ProjectReaderTests-756482943 None] Lock "cinder-quobyte-9f58e786-4c67-414a-be6e-a5029fbf7374" acquired by "delete_volume" :: waited 0.025s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:39 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[756d95cc-ad9f-4411-af57-31b5bcea1fc1]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8aeea94d-2f0a-4c2e-9472-5f10c47a0d44 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:39 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f4ca47b-4f97-44cc-92ef-6cf01e092424 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:56:39 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374 Jul 08 01:56:39 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0f4ca47b-4f97-44cc-92ef-6cf01e092424 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Flow 'volume_create_manager' (ae0a7280-2e2c-4675-8808-674390b5fe35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:56:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0f4ca47b-4f97-44cc-92ef-6cf01e092424 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8e95e0e-1b74-438d-8f2a-ccf4eca75b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0f4ca47b-4f97-44cc-92ef-6cf01e092424 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8e95e0e-1b74-438d-8f2a-ccf4eca75b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-681420132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e77cccb-bef4-4e29-b266-005f27377c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad1b04cb019344aabcaeea2557ef554c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:56:39Z,use_quota=True,user_id='ea2d1ca756ac493386f8be1f25c8c45b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0f4ca47b-4f97-44cc-92ef-6cf01e092424 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cef9b90-70a7-41fa-8a3a-2d6f4ffdef8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0f4ca47b-4f97-44cc-92ef-6cf01e092424 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cef9b90-70a7-41fa-8a3a-2d6f4ffdef8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0f4ca47b-4f97-44cc-92ef-6cf01e092424 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (047e2290-e445-4f7f-9563-fe3a5317132f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0f4ca47b-4f97-44cc-92ef-6cf01e092424 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (047e2290-e445-4f7f-9563-fe3a5317132f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e77cccb-bef4-4e29-b266-005f27377c3f', 'volume_name': 'volume-4e77cccb-bef4-4e29-b266-005f27377c3f', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0f4ca47b-4f97-44cc-92ef-6cf01e092424 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d05884dc-f7aa-44d1-994f-f6d88880dd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0f4ca47b-4f97-44cc-92ef-6cf01e092424 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d05884dc-f7aa-44d1-994f-f6d88880dd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:39 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0f4ca47b-4f97-44cc-92ef-6cf01e092424 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f5d8d69-3add-40b2-8896-001f0c582f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:39 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-0f4ca47b-4f97-44cc-92ef-6cf01e092424 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Volume 4e77cccb-bef4-4e29-b266-005f27377c3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e77cccb-bef4-4e29-b266-005f27377c3f', 'volume_size': 1} Jul 08 01:56:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0f4ca47b-4f97-44cc-92ef-6cf01e092424 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:39 devstack sudo[105053]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-4e377895-d49f-4b40-9b46-1b3acf7053eb tempest-ProjectReaderTests-1853369274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.522s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:39 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-4e377895-d49f-4b40-9b46-1b3acf7053eb tempest-ProjectReaderTests-1853369274 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:56:39 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-4e377895-d49f-4b40-9b46-1b3acf7053eb tempest-ProjectReaderTests-1853369274 None] Deleted volume successfully. Jul 08 01:56:39 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-4e377895-d49f-4b40-9b46-1b3acf7053eb tempest-ProjectReaderTests-1853369274 None] Lock "cinder-0232c746-b505-4ed0-9387-520021641f29-delete_volume" released by "delete_volume" :: held 4.072s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:40 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb2cc666-ec45-42a4-a4fc-073573a52b19 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:56:40 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eb2cc666-ec45-42a4-a4fc-073573a52b19 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Flow 'volume_create_manager' (96c8e04a-ff8d-45db-884f-aed1751e23d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:56:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eb2cc666-ec45-42a4-a4fc-073573a52b19 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c66a864-fc05-4c43-ac0b-3c69cb5da5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a83faca3-f5ef-4596-aa4e-734ab0bc63f4 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f8b445b-b5b7-40e3-a36f-3ecaa42ad1ff 1073741824" returned: 0 in 1.770s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eb2cc666-ec45-42a4-a4fc-073573a52b19 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c66a864-fc05-4c43-ac0b-3c69cb5da5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1040959348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8d0adaf-df05-4639-8980-46d2ad2efbc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad1b04cb019344aabcaeea2557ef554c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:56:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:56:40Z,use_quota=True,user_id='ea2d1ca756ac493386f8be1f25c8c45b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eb2cc666-ec45-42a4-a4fc-073573a52b19 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61c0ca33-e91d-4948-bb87-09c241efa257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eb2cc666-ec45-42a4-a4fc-073573a52b19 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61c0ca33-e91d-4948-bb87-09c241efa257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eb2cc666-ec45-42a4-a4fc-073573a52b19 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a7438c2-c540-4214-96f4-8518c05571b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eb2cc666-ec45-42a4-a4fc-073573a52b19 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a7438c2-c540-4214-96f4-8518c05571b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8d0adaf-df05-4639-8980-46d2ad2efbc7', 'volume_name': 'volume-a8d0adaf-df05-4639-8980-46d2ad2efbc7', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eb2cc666-ec45-42a4-a4fc-073573a52b19 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe1d9b50-777a-44e2-af39-e1c959891945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eb2cc666-ec45-42a4-a4fc-073573a52b19 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe1d9b50-777a-44e2-af39-e1c959891945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eb2cc666-ec45-42a4-a4fc-073573a52b19 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afb3c7a8-611a-4bb9-adb4-98ad555ef74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:40 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-eb2cc666-ec45-42a4-a4fc-073573a52b19 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Volume a8d0adaf-df05-4639-8980-46d2ad2efbc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8d0adaf-df05-4639-8980-46d2ad2efbc7', 'volume_size': 1} Jul 08 01:56:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-eb2cc666-ec45-42a4-a4fc-073573a52b19 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a83faca3-f5ef-4596-aa4e-734ab0bc63f4 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f8b445b-b5b7-40e3-a36f-3ecaa42ad1ff {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:40 devstack sudo[105063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f8b445b-b5b7-40e3-a36f-3ecaa42ad1ff Jul 08 01:56:40 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:40 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0ce0507-1239-4177-98fb-ffb8aaac9e01 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:56:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a0ce0507-1239-4177-98fb-ffb8aaac9e01 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Flow 'volume_create_manager' (ed9210e8-7506-498e-a337-f6af473366c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:56:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a0ce0507-1239-4177-98fb-ffb8aaac9e01 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (736284bc-1ea0-4f3c-9629-6ca7f732651d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a0ce0507-1239-4177-98fb-ffb8aaac9e01 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (736284bc-1ea0-4f3c-9629-6ca7f732651d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-794030180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=580fd968-b275-46e9-ac75-8a36b016c69b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad1b04cb019344aabcaeea2557ef554c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:56:41Z,use_quota=True,user_id='ea2d1ca756ac493386f8be1f25c8c45b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a0ce0507-1239-4177-98fb-ffb8aaac9e01 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe20c9d5-507f-42ca-bf77-57796ec11540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a0ce0507-1239-4177-98fb-ffb8aaac9e01 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe20c9d5-507f-42ca-bf77-57796ec11540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a0ce0507-1239-4177-98fb-ffb8aaac9e01 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e9d6077-ff13-4432-ac49-64b559833983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a0ce0507-1239-4177-98fb-ffb8aaac9e01 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e9d6077-ff13-4432-ac49-64b559833983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '580fd968-b275-46e9-ac75-8a36b016c69b', 'volume_name': 'volume-580fd968-b275-46e9-ac75-8a36b016c69b', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a0ce0507-1239-4177-98fb-ffb8aaac9e01 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d21f847f-5f3b-4d04-b52d-e16240cee6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a0ce0507-1239-4177-98fb-ffb8aaac9e01 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d21f847f-5f3b-4d04-b52d-e16240cee6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:40 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a0ce0507-1239-4177-98fb-ffb8aaac9e01 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5e86499-8cf1-4410-a068-13a31c028d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:40 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-a0ce0507-1239-4177-98fb-ffb8aaac9e01 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Volume 580fd968-b275-46e9-ac75-8a36b016c69b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-580fd968-b275-46e9-ac75-8a36b016c69b', 'volume_size': 1} Jul 08 01:56:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a0ce0507-1239-4177-98fb-ffb8aaac9e01 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:40 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8aeea94d-2f0a-4c2e-9472-5f10c47a0d44 tempest-ProjectReaderTests-756482943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374" returned: 0 in 1.616s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8aeea94d-2f0a-4c2e-9472-5f10c47a0d44 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:40 devstack sudo[105068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374 Jul 08 01:56:40 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:41 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a83faca3-f5ef-4596-aa4e-734ab0bc63f4 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f8b445b-b5b7-40e3-a36f-3ecaa42ad1ff" returned: 0 in 1.029s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:41 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a83faca3-f5ef-4596-aa4e-734ab0bc63f4 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] <== create_volume: return (2965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:56:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a83faca3-f5ef-4596-aa4e-734ab0bc63f4 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.970s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-af7ab4b6-b134-45c9-8458-4bfc9d4d581b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.447s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:41 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-af7ab4b6-b134-45c9-8458-4bfc9d4d581b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1212636641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1610c9f-fe5f-43de-a9ec-cc0a3095ac5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad1b04cb019344aabcaeea2557ef554c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:56:39Z,use_quota=True,user_id='ea2d1ca756ac493386f8be1f25c8c45b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:56:41 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-af7ab4b6-b134-45c9-8458-4bfc9d4d581b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Creating volume b1610c9f-fe5f-43de-a9ec-cc0a3095ac5d {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:56:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-af7ab4b6-b134-45c9-8458-4bfc9d4d581b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-af7ab4b6-b134-45c9-8458-4bfc9d4d581b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:41 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-af7ab4b6-b134-45c9-8458-4bfc9d4d581b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:41 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-af7ab4b6-b134-45c9-8458-4bfc9d4d581b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-af7ab4b6-b134-45c9-8458-4bfc9d4d581b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:41 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-af7ab4b6-b134-45c9-8458-4bfc9d4d581b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:56:41 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-af7ab4b6-b134-45c9-8458-4bfc9d4d581b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:56:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-af7ab4b6-b134-45c9-8458-4bfc9d4d581b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b1610c9f-fe5f-43de-a9ec-cc0a3095ac5d 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:41 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b1610c9f-fe5f-43de-a9ec-cc0a3095ac5d 1073741824 Jul 08 01:56:41 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:41 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a83faca3-f5ef-4596-aa4e-734ab0bc63f4 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74baaf4f-db14-4095-af61-26f882c4805e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f8b445b-b5b7-40e3-a36f-3ecaa42ad1ff', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:41 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a83faca3-f5ef-4596-aa4e-734ab0bc63f4 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7774763a-6bc4-4ec3-9b45-c74cc0df21c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:41 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-a83faca3-f5ef-4596-aa4e-734ab0bc63f4 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Volume volume-3f8b445b-b5b7-40e3-a36f-3ecaa42ad1ff (3f8b445b-b5b7-40e3-a36f-3ecaa42ad1ff): created successfully Jul 08 01:56:41 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a83faca3-f5ef-4596-aa4e-734ab0bc63f4 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7774763a-6bc4-4ec3-9b45-c74cc0df21c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:41 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a83faca3-f5ef-4596-aa4e-734ab0bc63f4 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Flow 'volume_create_manager' (78cfe46c-cbbb-430c-8eeb-bd761b6f5b6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:56:41 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-a83faca3-f5ef-4596-aa4e-734ab0bc63f4 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Created volume successfully. Jul 08 01:56:41 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8aeea94d-2f0a-4c2e-9472-5f10c47a0d44 tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-9f58e786-4c67-414a-be6e-a5029fbf7374" returned: 0 in 1.129s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:41 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-8aeea94d-2f0a-4c2e-9472-5f10c47a0d44 tempest-ProjectReaderTests-756482943 None] Lock "cinder-quobyte-9f58e786-4c67-414a-be6e-a5029fbf7374" released by "delete_volume" :: held 2.855s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:42 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-8aeea94d-2f0a-4c2e-9472-5f10c47a0d44 tempest-ProjectReaderTests-756482943 None] Created reservations ['d5c46fe9-05f9-43f6-802e-543d91ff0672', '30d24ba0-ee78-43b3-8f03-c67188509048', 'd076f8e0-ce30-4b6a-9404-cb61a2755b04', 'dc42577f-39c9-48c5-8afd-70523be89a43'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:56:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8aeea94d-2f0a-4c2e-9472-5f10c47a0d44 tempest-ProjectReaderTests-756482943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8aeea94d-2f0a-4c2e-9472-5f10c47a0d44 tempest-ProjectReaderTests-756482943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:42 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-8aeea94d-2f0a-4c2e-9472-5f10c47a0d44 tempest-ProjectReaderTests-756482943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:42 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-8aeea94d-2f0a-4c2e-9472-5f10c47a0d44 tempest-ProjectReaderTests-756482943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8aeea94d-2f0a-4c2e-9472-5f10c47a0d44 tempest-ProjectReaderTests-756482943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8aeea94d-2f0a-4c2e-9472-5f10c47a0d44 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:42 devstack sudo[105110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:56:42 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:43 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-af7ab4b6-b134-45c9-8458-4bfc9d4d581b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b1610c9f-fe5f-43de-a9ec-cc0a3095ac5d 1073741824" returned: 0 in 1.797s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-af7ab4b6-b134-45c9-8458-4bfc9d4d581b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b1610c9f-fe5f-43de-a9ec-cc0a3095ac5d {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:43 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b1610c9f-fe5f-43de-a9ec-cc0a3095ac5d Jul 08 01:56:43 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:43 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1a65397-034c-434a-86e6-90cd25bf631f tempest-ProjectReaderTests-756482943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:56:43 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e1a65397-034c-434a-86e6-90cd25bf631f tempest-ProjectReaderTests-756482943 None] Flow 'volume_create_manager' (cc2c2ccc-9779-437e-9721-6f6609b5ed50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:56:43 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e1a65397-034c-434a-86e6-90cd25bf631f tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e4089eb-1d9e-41c8-9f8a-6963ea6ebf17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:43 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e1a65397-034c-434a-86e6-90cd25bf631f tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e4089eb-1d9e-41c8-9f8a-6963ea6ebf17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-22423760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fe90171-ab38-458f-a233-87ecb0429afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cedff66a12b04885a54b318907f70246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:56:44Z,use_quota=True,user_id='42422d5e57294adbb2ba38426c0322eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:43 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:43 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e1a65397-034c-434a-86e6-90cd25bf631f tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (706c8763-5f2b-4dd3-bc93-0539169f8ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:43 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e1a65397-034c-434a-86e6-90cd25bf631f tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (706c8763-5f2b-4dd3-bc93-0539169f8ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:43 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e1a65397-034c-434a-86e6-90cd25bf631f tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f1f5396-1cd7-4a7e-be92-b5f45210c232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:43 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e1a65397-034c-434a-86e6-90cd25bf631f tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f1f5396-1cd7-4a7e-be92-b5f45210c232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fe90171-ab38-458f-a233-87ecb0429afe', 'volume_name': 'volume-7fe90171-ab38-458f-a233-87ecb0429afe', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:43 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e1a65397-034c-434a-86e6-90cd25bf631f tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23437a67-f3d3-474c-8fb9-8a06efef1788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:43 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e1a65397-034c-434a-86e6-90cd25bf631f tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23437a67-f3d3-474c-8fb9-8a06efef1788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:43 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e1a65397-034c-434a-86e6-90cd25bf631f tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75866556-24cb-4c93-93f8-b741da9a43a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:43 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-e1a65397-034c-434a-86e6-90cd25bf631f tempest-ProjectReaderTests-756482943 None] Volume 7fe90171-ab38-458f-a233-87ecb0429afe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fe90171-ab38-458f-a233-87ecb0429afe', 'volume_size': 1} Jul 08 01:56:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e1a65397-034c-434a-86e6-90cd25bf631f tempest-ProjectReaderTests-756482943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8aeea94d-2f0a-4c2e-9472-5f10c47a0d44 tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.598s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:43 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-8aeea94d-2f0a-4c2e-9472-5f10c47a0d44 tempest-ProjectReaderTests-756482943 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:56:43 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-8aeea94d-2f0a-4c2e-9472-5f10c47a0d44 tempest-ProjectReaderTests-756482943 None] Deleted volume successfully. Jul 08 01:56:43 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-8aeea94d-2f0a-4c2e-9472-5f10c47a0d44 tempest-ProjectReaderTests-756482943 None] Lock "cinder-9f58e786-4c67-414a-be6e-a5029fbf7374-delete_volume" released by "delete_volume" :: held 4.859s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:44 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-af7ab4b6-b134-45c9-8458-4bfc9d4d581b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b1610c9f-fe5f-43de-a9ec-cc0a3095ac5d" returned: 0 in 1.111s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:44 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-af7ab4b6-b134-45c9-8458-4bfc9d4d581b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] <== create_volume: return (3061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:56:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-af7ab4b6-b134-45c9-8458-4bfc9d4d581b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.065s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0f4ca47b-4f97-44cc-92ef-6cf01e092424 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.787s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:44 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0f4ca47b-4f97-44cc-92ef-6cf01e092424 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-681420132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e77cccb-bef4-4e29-b266-005f27377c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad1b04cb019344aabcaeea2557ef554c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:56:39Z,use_quota=True,user_id='ea2d1ca756ac493386f8be1f25c8c45b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:56:44 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-0f4ca47b-4f97-44cc-92ef-6cf01e092424 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Creating volume 4e77cccb-bef4-4e29-b266-005f27377c3f {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:56:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0f4ca47b-4f97-44cc-92ef-6cf01e092424 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0f4ca47b-4f97-44cc-92ef-6cf01e092424 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:44 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0f4ca47b-4f97-44cc-92ef-6cf01e092424 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:44 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0f4ca47b-4f97-44cc-92ef-6cf01e092424 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0f4ca47b-4f97-44cc-92ef-6cf01e092424 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:44 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0f4ca47b-4f97-44cc-92ef-6cf01e092424 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:56:44 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-0f4ca47b-4f97-44cc-92ef-6cf01e092424 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:56:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0f4ca47b-4f97-44cc-92ef-6cf01e092424 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4e77cccb-bef4-4e29-b266-005f27377c3f 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:44 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-af7ab4b6-b134-45c9-8458-4bfc9d4d581b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73befe02-0342-4035-a440-aee3e84bc66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1610c9f-fe5f-43de-a9ec-cc0a3095ac5d', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:44 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4e77cccb-bef4-4e29-b266-005f27377c3f 1073741824 Jul 08 01:56:44 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:44 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-af7ab4b6-b134-45c9-8458-4bfc9d4d581b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a13c1a2-4b5b-4cf0-a2fd-fa9515383b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:44 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-af7ab4b6-b134-45c9-8458-4bfc9d4d581b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Volume volume-b1610c9f-fe5f-43de-a9ec-cc0a3095ac5d (b1610c9f-fe5f-43de-a9ec-cc0a3095ac5d): created successfully Jul 08 01:56:44 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-af7ab4b6-b134-45c9-8458-4bfc9d4d581b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a13c1a2-4b5b-4cf0-a2fd-fa9515383b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:44 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-af7ab4b6-b134-45c9-8458-4bfc9d4d581b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Flow 'volume_create_manager' (d35db095-a02c-4d93-bc95-652227deb72d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:56:44 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-af7ab4b6-b134-45c9-8458-4bfc9d4d581b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Created volume successfully. Jul 08 01:56:45 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0f4ca47b-4f97-44cc-92ef-6cf01e092424 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4e77cccb-bef4-4e29-b266-005f27377c3f 1073741824" returned: 0 in 1.119s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0f4ca47b-4f97-44cc-92ef-6cf01e092424 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4e77cccb-bef4-4e29-b266-005f27377c3f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:45 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4e77cccb-bef4-4e29-b266-005f27377c3f Jul 08 01:56:45 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:45 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1ff540d-69a3-4702-97c0-2fc9f719b9b9 tempest-ProjectReaderTests-22232040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:56:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b1ff540d-69a3-4702-97c0-2fc9f719b9b9 tempest-ProjectReaderTests-22232040 None] Flow 'volume_create_manager' (62b4d296-0713-4eff-8ca0-a4b45014349e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:56:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b1ff540d-69a3-4702-97c0-2fc9f719b9b9 tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c04e879d-d583-4b9d-8acf-3ef584c27198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b1ff540d-69a3-4702-97c0-2fc9f719b9b9 tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c04e879d-d583-4b9d-8acf-3ef584c27198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-193466971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=368c6f78-e077-4cf7-8c57-38ac3c2fa82f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7111ef9ce00343a993a9ff8b36a1ff80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:56:46Z,use_quota=True,user_id='1658f8ce7bdd4ab79bb222d1e0bd10d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b1ff540d-69a3-4702-97c0-2fc9f719b9b9 tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aac717b-2ddf-4424-8caf-495bc2a4a13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b1ff540d-69a3-4702-97c0-2fc9f719b9b9 tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aac717b-2ddf-4424-8caf-495bc2a4a13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b1ff540d-69a3-4702-97c0-2fc9f719b9b9 tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89da90a9-e824-4d47-9d32-71d1d25e33ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b1ff540d-69a3-4702-97c0-2fc9f719b9b9 tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89da90a9-e824-4d47-9d32-71d1d25e33ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '368c6f78-e077-4cf7-8c57-38ac3c2fa82f', 'volume_name': 'volume-368c6f78-e077-4cf7-8c57-38ac3c2fa82f', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b1ff540d-69a3-4702-97c0-2fc9f719b9b9 tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3fbb41e-65f1-43c6-899c-e5dab7bcd098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b1ff540d-69a3-4702-97c0-2fc9f719b9b9 tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3fbb41e-65f1-43c6-899c-e5dab7bcd098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:45 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b1ff540d-69a3-4702-97c0-2fc9f719b9b9 tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ad3ab36-170e-4b19-a112-f4c154beb542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:45 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-b1ff540d-69a3-4702-97c0-2fc9f719b9b9 tempest-ProjectReaderTests-22232040 None] Volume 368c6f78-e077-4cf7-8c57-38ac3c2fa82f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-368c6f78-e077-4cf7-8c57-38ac3c2fa82f', 'volume_size': 1} Jul 08 01:56:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b1ff540d-69a3-4702-97c0-2fc9f719b9b9 tempest-ProjectReaderTests-22232040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:46 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-0f4ca47b-4f97-44cc-92ef-6cf01e092424 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4e77cccb-bef4-4e29-b266-005f27377c3f" returned: 0 in 0.869s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:46 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-0f4ca47b-4f97-44cc-92ef-6cf01e092424 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] <== create_volume: return (2054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:56:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-0f4ca47b-4f97-44cc-92ef-6cf01e092424 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.058s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-eb2cc666-ec45-42a4-a4fc-073573a52b19 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.201s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:46 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-eb2cc666-ec45-42a4-a4fc-073573a52b19 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1040959348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8d0adaf-df05-4639-8980-46d2ad2efbc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad1b04cb019344aabcaeea2557ef554c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:56:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:56:40Z,use_quota=True,user_id='ea2d1ca756ac493386f8be1f25c8c45b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:56:46 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-eb2cc666-ec45-42a4-a4fc-073573a52b19 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Creating volume a8d0adaf-df05-4639-8980-46d2ad2efbc7 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:56:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-eb2cc666-ec45-42a4-a4fc-073573a52b19 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-eb2cc666-ec45-42a4-a4fc-073573a52b19 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:46 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-eb2cc666-ec45-42a4-a4fc-073573a52b19 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:46 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-eb2cc666-ec45-42a4-a4fc-073573a52b19 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-eb2cc666-ec45-42a4-a4fc-073573a52b19 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:46 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-eb2cc666-ec45-42a4-a4fc-073573a52b19 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:56:46 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-eb2cc666-ec45-42a4-a4fc-073573a52b19 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:56:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-eb2cc666-ec45-42a4-a4fc-073573a52b19 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8d0adaf-df05-4639-8980-46d2ad2efbc7 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:46 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8d0adaf-df05-4639-8980-46d2ad2efbc7 1073741824 Jul 08 01:56:46 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0f4ca47b-4f97-44cc-92ef-6cf01e092424 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f5d8d69-3add-40b2-8896-001f0c582f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e77cccb-bef4-4e29-b266-005f27377c3f', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0f4ca47b-4f97-44cc-92ef-6cf01e092424 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebeadbae-05e8-4583-93fd-ab1c5e9408fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:46 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-0f4ca47b-4f97-44cc-92ef-6cf01e092424 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Volume volume-4e77cccb-bef4-4e29-b266-005f27377c3f (4e77cccb-bef4-4e29-b266-005f27377c3f): created successfully Jul 08 01:56:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0f4ca47b-4f97-44cc-92ef-6cf01e092424 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebeadbae-05e8-4583-93fd-ab1c5e9408fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-0f4ca47b-4f97-44cc-92ef-6cf01e092424 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Flow 'volume_create_manager' (ae0a7280-2e2c-4675-8808-674390b5fe35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:56:46 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-0f4ca47b-4f97-44cc-92ef-6cf01e092424 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Created volume successfully. Jul 08 01:56:47 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-98c04375-8b18-4cd1-b0dd-5875b22220e3 tempest-ProjectMemberTests-73797185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:56:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-98c04375-8b18-4cd1-b0dd-5875b22220e3 tempest-ProjectMemberTests-73797185 None] Flow 'volume_create_manager' (28d2bbc8-7cea-4a98-b541-5d127dda2678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:56:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-98c04375-8b18-4cd1-b0dd-5875b22220e3 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7ded9f5-9e49-469a-bb48-c0b0d62eb78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-98c04375-8b18-4cd1-b0dd-5875b22220e3 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7ded9f5-9e49-469a-bb48-c0b0d62eb78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-390775130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4db7ca25-3a23-403d-970b-35300a7b7858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410ede866c9145df8444c3a398ace8b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:56:47Z,use_quota=True,user_id='5f5ae65b4a584ede952a5bfc00c9a49d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-98c04375-8b18-4cd1-b0dd-5875b22220e3 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a33e95a5-f355-4a9c-9766-bbd347f5bbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-98c04375-8b18-4cd1-b0dd-5875b22220e3 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a33e95a5-f355-4a9c-9766-bbd347f5bbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-98c04375-8b18-4cd1-b0dd-5875b22220e3 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ea80adf-0068-4fa5-b958-783f5f2298b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-98c04375-8b18-4cd1-b0dd-5875b22220e3 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ea80adf-0068-4fa5-b958-783f5f2298b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4db7ca25-3a23-403d-970b-35300a7b7858', 'volume_name': 'volume-4db7ca25-3a23-403d-970b-35300a7b7858', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-98c04375-8b18-4cd1-b0dd-5875b22220e3 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5030dd26-f215-4918-8a42-549966fe0138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-98c04375-8b18-4cd1-b0dd-5875b22220e3 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5030dd26-f215-4918-8a42-549966fe0138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-98c04375-8b18-4cd1-b0dd-5875b22220e3 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b78bdd-19e4-4130-85ad-da51e8e0129d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:47 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-98c04375-8b18-4cd1-b0dd-5875b22220e3 tempest-ProjectMemberTests-73797185 None] Volume 4db7ca25-3a23-403d-970b-35300a7b7858: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4db7ca25-3a23-403d-970b-35300a7b7858', 'volume_size': 1} Jul 08 01:56:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-98c04375-8b18-4cd1-b0dd-5875b22220e3 tempest-ProjectMemberTests-73797185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:47 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-eb2cc666-ec45-42a4-a4fc-073573a52b19 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8d0adaf-df05-4639-8980-46d2ad2efbc7 1073741824" returned: 0 in 0.959s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-eb2cc666-ec45-42a4-a4fc-073573a52b19 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8d0adaf-df05-4639-8980-46d2ad2efbc7 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:47 devstack sudo[105136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8d0adaf-df05-4639-8980-46d2ad2efbc7 Jul 08 01:56:47 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:48 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-eb2cc666-ec45-42a4-a4fc-073573a52b19 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8d0adaf-df05-4639-8980-46d2ad2efbc7" returned: 0 in 0.721s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:48 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-eb2cc666-ec45-42a4-a4fc-073573a52b19 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:56:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-eb2cc666-ec45-42a4-a4fc-073573a52b19 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.722s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a0ce0507-1239-4177-98fb-ffb8aaac9e01 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.576s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:48 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a0ce0507-1239-4177-98fb-ffb8aaac9e01 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-794030180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=580fd968-b275-46e9-ac75-8a36b016c69b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad1b04cb019344aabcaeea2557ef554c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:56:41Z,use_quota=True,user_id='ea2d1ca756ac493386f8be1f25c8c45b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:56:48 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-a0ce0507-1239-4177-98fb-ffb8aaac9e01 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Creating volume 580fd968-b275-46e9-ac75-8a36b016c69b {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:56:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a0ce0507-1239-4177-98fb-ffb8aaac9e01 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a0ce0507-1239-4177-98fb-ffb8aaac9e01 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:48 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a0ce0507-1239-4177-98fb-ffb8aaac9e01 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:48 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a0ce0507-1239-4177-98fb-ffb8aaac9e01 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a0ce0507-1239-4177-98fb-ffb8aaac9e01 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:48 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a0ce0507-1239-4177-98fb-ffb8aaac9e01 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:56:48 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-a0ce0507-1239-4177-98fb-ffb8aaac9e01 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:56:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a0ce0507-1239-4177-98fb-ffb8aaac9e01 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-580fd968-b275-46e9-ac75-8a36b016c69b 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eb2cc666-ec45-42a4-a4fc-073573a52b19 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afb3c7a8-611a-4bb9-adb4-98ad555ef74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8d0adaf-df05-4639-8980-46d2ad2efbc7', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:48 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-580fd968-b275-46e9-ac75-8a36b016c69b 1073741824 Jul 08 01:56:48 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eb2cc666-ec45-42a4-a4fc-073573a52b19 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (734b22cf-0414-4afb-9024-b6f4ad6eb48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:48 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-eb2cc666-ec45-42a4-a4fc-073573a52b19 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Volume volume-a8d0adaf-df05-4639-8980-46d2ad2efbc7 (a8d0adaf-df05-4639-8980-46d2ad2efbc7): created successfully Jul 08 01:56:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eb2cc666-ec45-42a4-a4fc-073573a52b19 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (734b22cf-0414-4afb-9024-b6f4ad6eb48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:48 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-eb2cc666-ec45-42a4-a4fc-073573a52b19 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Flow 'volume_create_manager' (96c8e04a-ff8d-45db-884f-aed1751e23d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:56:48 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-eb2cc666-ec45-42a4-a4fc-073573a52b19 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Created volume successfully. Jul 08 01:56:49 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a0ce0507-1239-4177-98fb-ffb8aaac9e01 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-580fd968-b275-46e9-ac75-8a36b016c69b 1073741824" returned: 0 in 1.004s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a0ce0507-1239-4177-98fb-ffb8aaac9e01 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-580fd968-b275-46e9-ac75-8a36b016c69b {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:49 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-580fd968-b275-46e9-ac75-8a36b016c69b Jul 08 01:56:49 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:50 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a0ce0507-1239-4177-98fb-ffb8aaac9e01 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-580fd968-b275-46e9-ac75-8a36b016c69b" returned: 0 in 0.776s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a0ce0507-1239-4177-98fb-ffb8aaac9e01 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] <== create_volume: return (1830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:56:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a0ce0507-1239-4177-98fb-ffb8aaac9e01 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.834s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e1a65397-034c-434a-86e6-90cd25bf631f tempest-ProjectReaderTests-756482943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.273s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e1a65397-034c-434a-86e6-90cd25bf631f tempest-ProjectReaderTests-756482943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-22423760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fe90171-ab38-458f-a233-87ecb0429afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cedff66a12b04885a54b318907f70246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:56:44Z,use_quota=True,user_id='42422d5e57294adbb2ba38426c0322eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:56:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-e1a65397-034c-434a-86e6-90cd25bf631f tempest-ProjectReaderTests-756482943 None] Creating volume 7fe90171-ab38-458f-a233-87ecb0429afe {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:56:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e1a65397-034c-434a-86e6-90cd25bf631f tempest-ProjectReaderTests-756482943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e1a65397-034c-434a-86e6-90cd25bf631f tempest-ProjectReaderTests-756482943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e1a65397-034c-434a-86e6-90cd25bf631f tempest-ProjectReaderTests-756482943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e1a65397-034c-434a-86e6-90cd25bf631f tempest-ProjectReaderTests-756482943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e1a65397-034c-434a-86e6-90cd25bf631f tempest-ProjectReaderTests-756482943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:50 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e1a65397-034c-434a-86e6-90cd25bf631f tempest-ProjectReaderTests-756482943 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:56:50 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-e1a65397-034c-434a-86e6-90cd25bf631f tempest-ProjectReaderTests-756482943 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:56:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e1a65397-034c-434a-86e6-90cd25bf631f tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:50 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe 1073741824 Jul 08 01:56:50 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a0ce0507-1239-4177-98fb-ffb8aaac9e01 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5e86499-8cf1-4410-a068-13a31c028d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-580fd968-b275-46e9-ac75-8a36b016c69b', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a0ce0507-1239-4177-98fb-ffb8aaac9e01 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec30ba6e-bf7a-4184-84ea-faa3eed02ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:50 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-a0ce0507-1239-4177-98fb-ffb8aaac9e01 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Volume volume-580fd968-b275-46e9-ac75-8a36b016c69b (580fd968-b275-46e9-ac75-8a36b016c69b): created successfully Jul 08 01:56:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a0ce0507-1239-4177-98fb-ffb8aaac9e01 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec30ba6e-bf7a-4184-84ea-faa3eed02ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:50 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a0ce0507-1239-4177-98fb-ffb8aaac9e01 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Flow 'volume_create_manager' (ed9210e8-7506-498e-a337-f6af473366c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:56:50 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-a0ce0507-1239-4177-98fb-ffb8aaac9e01 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Created volume successfully. Jul 08 01:56:50 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-665a2e1f-1e15-4599-b394-fa9596d34a1b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Acquiring lock "cinder-580fd968-b275-46e9-ac75-8a36b016c69b-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:50 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-665a2e1f-1e15-4599-b394-fa9596d34a1b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "cinder-580fd968-b275-46e9-ac75-8a36b016c69b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:50 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-665a2e1f-1e15-4599-b394-fa9596d34a1b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Acquiring lock "cinder-quobyte-580fd968-b275-46e9-ac75-8a36b016c69b" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:50 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-665a2e1f-1e15-4599-b394-fa9596d34a1b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "cinder-quobyte-580fd968-b275-46e9-ac75-8a36b016c69b" acquired by "delete_volume" :: waited 0.017s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:51 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[26034415-0722-407d-9464-965219e939c7]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-665a2e1f-1e15-4599-b394-fa9596d34a1b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-580fd968-b275-46e9-ac75-8a36b016c69b {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:51 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e1a65397-034c-434a-86e6-90cd25bf631f tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe 1073741824" returned: 0 in 0.982s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:51 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-580fd968-b275-46e9-ac75-8a36b016c69b Jul 08 01:56:51 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e1a65397-034c-434a-86e6-90cd25bf631f tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:51 devstack sudo[105156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe Jul 08 01:56:51 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:51 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e1a65397-034c-434a-86e6-90cd25bf631f tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe" returned: 0 in 0.700s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:51 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e1a65397-034c-434a-86e6-90cd25bf631f tempest-ProjectReaderTests-756482943 None] <== create_volume: return (1730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:56:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e1a65397-034c-434a-86e6-90cd25bf631f tempest-ProjectReaderTests-756482943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b1ff540d-69a3-4702-97c0-2fc9f719b9b9 tempest-ProjectReaderTests-22232040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.900s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:51 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b1ff540d-69a3-4702-97c0-2fc9f719b9b9 tempest-ProjectReaderTests-22232040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-193466971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=368c6f78-e077-4cf7-8c57-38ac3c2fa82f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7111ef9ce00343a993a9ff8b36a1ff80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:56:46Z,use_quota=True,user_id='1658f8ce7bdd4ab79bb222d1e0bd10d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:56:51 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-b1ff540d-69a3-4702-97c0-2fc9f719b9b9 tempest-ProjectReaderTests-22232040 None] Creating volume 368c6f78-e077-4cf7-8c57-38ac3c2fa82f {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:56:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b1ff540d-69a3-4702-97c0-2fc9f719b9b9 tempest-ProjectReaderTests-22232040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b1ff540d-69a3-4702-97c0-2fc9f719b9b9 tempest-ProjectReaderTests-22232040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:51 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b1ff540d-69a3-4702-97c0-2fc9f719b9b9 tempest-ProjectReaderTests-22232040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:51 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b1ff540d-69a3-4702-97c0-2fc9f719b9b9 tempest-ProjectReaderTests-22232040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b1ff540d-69a3-4702-97c0-2fc9f719b9b9 tempest-ProjectReaderTests-22232040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:51 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b1ff540d-69a3-4702-97c0-2fc9f719b9b9 tempest-ProjectReaderTests-22232040 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:56:51 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-b1ff540d-69a3-4702-97c0-2fc9f719b9b9 tempest-ProjectReaderTests-22232040 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:56:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b1ff540d-69a3-4702-97c0-2fc9f719b9b9 tempest-ProjectReaderTests-22232040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-368c6f78-e077-4cf7-8c57-38ac3c2fa82f 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:51 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-368c6f78-e077-4cf7-8c57-38ac3c2fa82f 1073741824 Jul 08 01:56:51 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:51 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e1a65397-034c-434a-86e6-90cd25bf631f tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75866556-24cb-4c93-93f8-b741da9a43a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fe90171-ab38-458f-a233-87ecb0429afe', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:51 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e1a65397-034c-434a-86e6-90cd25bf631f tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69b133c2-0be3-486c-ac79-b5abc02aceb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:51 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-e1a65397-034c-434a-86e6-90cd25bf631f tempest-ProjectReaderTests-756482943 None] Volume volume-7fe90171-ab38-458f-a233-87ecb0429afe (7fe90171-ab38-458f-a233-87ecb0429afe): created successfully Jul 08 01:56:51 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e1a65397-034c-434a-86e6-90cd25bf631f tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69b133c2-0be3-486c-ac79-b5abc02aceb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:51 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-e1a65397-034c-434a-86e6-90cd25bf631f tempest-ProjectReaderTests-756482943 None] Flow 'volume_create_manager' (cc2c2ccc-9779-437e-9721-6f6609b5ed50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:56:51 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-665a2e1f-1e15-4599-b394-fa9596d34a1b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-580fd968-b275-46e9-ac75-8a36b016c69b" returned: 0 in 0.938s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-665a2e1f-1e15-4599-b394-fa9596d34a1b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-580fd968-b275-46e9-ac75-8a36b016c69b {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:51 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-e1a65397-034c-434a-86e6-90cd25bf631f tempest-ProjectReaderTests-756482943 None] Created volume successfully. Jul 08 01:56:51 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-580fd968-b275-46e9-ac75-8a36b016c69b Jul 08 01:56:51 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-9dec3b1d-3fbb-4f2d-94cd-351187020f06 tempest-ProjectReaderTests-756482943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:52 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-665a2e1f-1e15-4599-b394-fa9596d34a1b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-580fd968-b275-46e9-ac75-8a36b016c69b" returned: 0 in 0.833s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:52 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-665a2e1f-1e15-4599-b394-fa9596d34a1b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "cinder-quobyte-580fd968-b275-46e9-ac75-8a36b016c69b" released by "delete_volume" :: held 1.820s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:52 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b1ff540d-69a3-4702-97c0-2fc9f719b9b9 tempest-ProjectReaderTests-22232040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-368c6f78-e077-4cf7-8c57-38ac3c2fa82f 1073741824" returned: 0 in 0.954s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b1ff540d-69a3-4702-97c0-2fc9f719b9b9 tempest-ProjectReaderTests-22232040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-368c6f78-e077-4cf7-8c57-38ac3c2fa82f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:52 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-665a2e1f-1e15-4599-b394-fa9596d34a1b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Created reservations ['fbfcd33b-2dde-446c-9c61-22d40b3d6784', '49a6e004-cc75-4829-ad5c-80c7bad002b7', '43f45a08-c306-4cf8-acc8-976108f555ff', '850c2da7-0222-4558-900c-964f65cb945f'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:56:52 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-368c6f78-e077-4cf7-8c57-38ac3c2fa82f Jul 08 01:56:52 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-665a2e1f-1e15-4599-b394-fa9596d34a1b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-665a2e1f-1e15-4599-b394-fa9596d34a1b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-665a2e1f-1e15-4599-b394-fa9596d34a1b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-665a2e1f-1e15-4599-b394-fa9596d34a1b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-665a2e1f-1e15-4599-b394-fa9596d34a1b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-665a2e1f-1e15-4599-b394-fa9596d34a1b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:52 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:56:52 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:53 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-9773b60d-08a5-47e2-b72f-24df166ee735 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Acquiring lock "cinder-a8d0adaf-df05-4639-8980-46d2ad2efbc7-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:53 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-9773b60d-08a5-47e2-b72f-24df166ee735 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "cinder-a8d0adaf-df05-4639-8980-46d2ad2efbc7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:53 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-9773b60d-08a5-47e2-b72f-24df166ee735 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Acquiring lock "cinder-quobyte-a8d0adaf-df05-4639-8980-46d2ad2efbc7" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:53 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-9773b60d-08a5-47e2-b72f-24df166ee735 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "cinder-quobyte-a8d0adaf-df05-4639-8980-46d2ad2efbc7" acquired by "delete_volume" :: waited 0.016s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:53 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[1596d197-94e6-4856-b3f8-5c2a355c4516]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9773b60d-08a5-47e2-b72f-24df166ee735 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8d0adaf-df05-4639-8980-46d2ad2efbc7 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:53 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8d0adaf-df05-4639-8980-46d2ad2efbc7 Jul 08 01:56:53 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:53 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b1ff540d-69a3-4702-97c0-2fc9f719b9b9 tempest-ProjectReaderTests-22232040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-368c6f78-e077-4cf7-8c57-38ac3c2fa82f" returned: 0 in 0.857s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:53 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b1ff540d-69a3-4702-97c0-2fc9f719b9b9 tempest-ProjectReaderTests-22232040 None] <== create_volume: return (1858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:56:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b1ff540d-69a3-4702-97c0-2fc9f719b9b9 tempest-ProjectReaderTests-22232040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.861s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-98c04375-8b18-4cd1-b0dd-5875b22220e3 tempest-ProjectMemberTests-73797185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.457s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:53 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-98c04375-8b18-4cd1-b0dd-5875b22220e3 tempest-ProjectMemberTests-73797185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-390775130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4db7ca25-3a23-403d-970b-35300a7b7858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410ede866c9145df8444c3a398ace8b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:56:47Z,use_quota=True,user_id='5f5ae65b4a584ede952a5bfc00c9a49d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:56:53 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-98c04375-8b18-4cd1-b0dd-5875b22220e3 tempest-ProjectMemberTests-73797185 None] Creating volume 4db7ca25-3a23-403d-970b-35300a7b7858 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:56:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-98c04375-8b18-4cd1-b0dd-5875b22220e3 tempest-ProjectMemberTests-73797185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-98c04375-8b18-4cd1-b0dd-5875b22220e3 tempest-ProjectMemberTests-73797185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:53 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-98c04375-8b18-4cd1-b0dd-5875b22220e3 tempest-ProjectMemberTests-73797185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:53 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:53 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-98c04375-8b18-4cd1-b0dd-5875b22220e3 tempest-ProjectMemberTests-73797185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-98c04375-8b18-4cd1-b0dd-5875b22220e3 tempest-ProjectMemberTests-73797185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:53 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-98c04375-8b18-4cd1-b0dd-5875b22220e3 tempest-ProjectMemberTests-73797185 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:56:53 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-98c04375-8b18-4cd1-b0dd-5875b22220e3 tempest-ProjectMemberTests-73797185 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:56:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-98c04375-8b18-4cd1-b0dd-5875b22220e3 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-665a2e1f-1e15-4599-b394-fa9596d34a1b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.812s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:53 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-665a2e1f-1e15-4599-b394-fa9596d34a1b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:56:53 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858 1073741824 Jul 08 01:56:53 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:53 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b1ff540d-69a3-4702-97c0-2fc9f719b9b9 tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ad3ab36-170e-4b19-a112-f4c154beb542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-368c6f78-e077-4cf7-8c57-38ac3c2fa82f', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:53 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b1ff540d-69a3-4702-97c0-2fc9f719b9b9 tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae6e0b9e-d8dd-400b-b1ff-4219ffc23233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:53 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-665a2e1f-1e15-4599-b394-fa9596d34a1b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Deleted volume successfully. Jul 08 01:56:53 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-b1ff540d-69a3-4702-97c0-2fc9f719b9b9 tempest-ProjectReaderTests-22232040 None] Volume volume-368c6f78-e077-4cf7-8c57-38ac3c2fa82f (368c6f78-e077-4cf7-8c57-38ac3c2fa82f): created successfully Jul 08 01:56:53 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b1ff540d-69a3-4702-97c0-2fc9f719b9b9 tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae6e0b9e-d8dd-400b-b1ff-4219ffc23233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:53 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b1ff540d-69a3-4702-97c0-2fc9f719b9b9 tempest-ProjectReaderTests-22232040 None] Flow 'volume_create_manager' (62b4d296-0713-4eff-8ca0-a4b45014349e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:56:53 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-665a2e1f-1e15-4599-b394-fa9596d34a1b tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "cinder-580fd968-b275-46e9-ac75-8a36b016c69b-delete_volume" released by "delete_volume" :: held 2.917s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:53 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-b1ff540d-69a3-4702-97c0-2fc9f719b9b9 tempest-ProjectReaderTests-22232040 None] Created volume successfully. Jul 08 01:56:54 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9773b60d-08a5-47e2-b72f-24df166ee735 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8d0adaf-df05-4639-8980-46d2ad2efbc7" returned: 0 in 0.931s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9773b60d-08a5-47e2-b72f-24df166ee735 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8d0adaf-df05-4639-8980-46d2ad2efbc7 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:54 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8d0adaf-df05-4639-8980-46d2ad2efbc7 Jul 08 01:56:54 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:54 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-8964d082-c1ae-40d4-a65c-1b0cb21abce0 tempest-ProjectReaderTests-22232040 None] Acquiring lock "cinder-368c6f78-e077-4cf7-8c57-38ac3c2fa82f-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:54 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-8964d082-c1ae-40d4-a65c-1b0cb21abce0 tempest-ProjectReaderTests-22232040 None] Lock "cinder-368c6f78-e077-4cf7-8c57-38ac3c2fa82f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:54 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-8964d082-c1ae-40d4-a65c-1b0cb21abce0 tempest-ProjectReaderTests-22232040 None] Acquiring lock "cinder-quobyte-368c6f78-e077-4cf7-8c57-38ac3c2fa82f" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:54 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-8964d082-c1ae-40d4-a65c-1b0cb21abce0 tempest-ProjectReaderTests-22232040 None] Lock "cinder-quobyte-368c6f78-e077-4cf7-8c57-38ac3c2fa82f" acquired by "delete_volume" :: waited 0.016s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:54 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-98c04375-8b18-4cd1-b0dd-5875b22220e3 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858 1073741824" returned: 0 in 1.072s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:54 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b730b22-dd5f-4d4d-9367-0e9a373034b8]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8964d082-c1ae-40d4-a65c-1b0cb21abce0 tempest-ProjectReaderTests-22232040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-368c6f78-e077-4cf7-8c57-38ac3c2fa82f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-98c04375-8b18-4cd1-b0dd-5875b22220e3 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:54 devstack sudo[105189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858 Jul 08 01:56:54 devstack sudo[105189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:54 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-368c6f78-e077-4cf7-8c57-38ac3c2fa82f Jul 08 01:56:54 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:55 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9773b60d-08a5-47e2-b72f-24df166ee735 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-a8d0adaf-df05-4639-8980-46d2ad2efbc7" returned: 0 in 0.821s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:55 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-9773b60d-08a5-47e2-b72f-24df166ee735 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "cinder-quobyte-a8d0adaf-df05-4639-8980-46d2ad2efbc7" released by "delete_volume" :: held 1.799s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:55 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-9773b60d-08a5-47e2-b72f-24df166ee735 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Created reservations ['446297f7-c559-4269-b209-e6ea8278069c', 'de3249b3-9683-4b0f-aab3-241d80b74b3c', '9feaa278-1a96-4809-a63b-1b51ded7956d', 'f53459ef-4ed8-4880-a726-7e0d0d62530f'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:56:55 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:56:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:55 devstack sudo[105193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:56:55 devstack sudo[105193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-9773b60d-08a5-47e2-b72f-24df166ee735 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-9773b60d-08a5-47e2-b72f-24df166ee735 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-9773b60d-08a5-47e2-b72f-24df166ee735 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-9773b60d-08a5-47e2-b72f-24df166ee735 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-9773b60d-08a5-47e2-b72f-24df166ee735 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9773b60d-08a5-47e2-b72f-24df166ee735 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:55 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:56:55 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:55 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-23c24e88-3dfa-4d7e-bb4b-cbcaa04c9eb8 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Acquiring lock "cinder-4e77cccb-bef4-4e29-b266-005f27377c3f-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:55 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-23c24e88-3dfa-4d7e-bb4b-cbcaa04c9eb8 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "cinder-4e77cccb-bef4-4e29-b266-005f27377c3f-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:55 devstack sudo[105189]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-98c04375-8b18-4cd1-b0dd-5875b22220e3 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858" returned: 0 in 0.786s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-98c04375-8b18-4cd1-b0dd-5875b22220e3 tempest-ProjectMemberTests-73797185 None] <== create_volume: return (1931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:56:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-98c04375-8b18-4cd1-b0dd-5875b22220e3 tempest-ProjectMemberTests-73797185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.936s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-9dec3b1d-3fbb-4f2d-94cd-351187020f06 tempest-ProjectReaderTests-756482943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.228s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:55 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-23c24e88-3dfa-4d7e-bb4b-cbcaa04c9eb8 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Acquiring lock "cinder-quobyte-4e77cccb-bef4-4e29-b266-005f27377c3f" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-9dec3b1d-3fbb-4f2d-94cd-351187020f06 tempest-ProjectReaderTests-756482943 None] Creating offline snapshot 159f7254-cb0b-4a81-b4dc-90b30cf76a80 of volume 7fe90171-ab38-458f-a233-87ecb0429afe {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:56:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-98c04375-8b18-4cd1-b0dd-5875b22220e3 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b78bdd-19e4-4130-85ad-da51e8e0129d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4db7ca25-3a23-403d-970b-35300a7b7858', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-98c04375-8b18-4cd1-b0dd-5875b22220e3 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bbbb443-5ce5-4917-8331-57b5cede7870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:55 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[321edecb-f46c-4afc-abb0-bbbe64422971]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9dec3b1d-3fbb-4f2d-94cd-351187020f06 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:55 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-98c04375-8b18-4cd1-b0dd-5875b22220e3 tempest-ProjectMemberTests-73797185 None] Volume volume-4db7ca25-3a23-403d-970b-35300a7b7858 (4db7ca25-3a23-403d-970b-35300a7b7858): created successfully Jul 08 01:56:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-98c04375-8b18-4cd1-b0dd-5875b22220e3 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bbbb443-5ce5-4917-8331-57b5cede7870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-98c04375-8b18-4cd1-b0dd-5875b22220e3 tempest-ProjectMemberTests-73797185 None] Flow 'volume_create_manager' (28d2bbc8-7cea-4a98-b541-5d127dda2678) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:56:55 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-23c24e88-3dfa-4d7e-bb4b-cbcaa04c9eb8 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "cinder-quobyte-4e77cccb-bef4-4e29-b266-005f27377c3f" acquired by "delete_volume" :: waited 0.120s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:55 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8964d082-c1ae-40d4-a65c-1b0cb21abce0 tempest-ProjectReaderTests-22232040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-368c6f78-e077-4cf7-8c57-38ac3c2fa82f" returned: 0 in 1.003s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8964d082-c1ae-40d4-a65c-1b0cb21abce0 tempest-ProjectReaderTests-22232040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-368c6f78-e077-4cf7-8c57-38ac3c2fa82f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:55 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[44583c00-bc0b-42ff-b86c-97c5d8fd054c]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:55 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-98c04375-8b18-4cd1-b0dd-5875b22220e3 tempest-ProjectMemberTests-73797185 None] Created volume successfully. Jul 08 01:56:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-23c24e88-3dfa-4d7e-bb4b-cbcaa04c9eb8 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4e77cccb-bef4-4e29-b266-005f27377c3f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:55 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-368c6f78-e077-4cf7-8c57-38ac3c2fa82f Jul 08 01:56:55 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:55 devstack sudo[105203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe Jul 08 01:56:55 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:56 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4e77cccb-bef4-4e29-b266-005f27377c3f Jul 08 01:56:56 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:56 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9773b60d-08a5-47e2-b72f-24df166ee735 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.924s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:56 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-9773b60d-08a5-47e2-b72f-24df166ee735 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:56:56 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-9773b60d-08a5-47e2-b72f-24df166ee735 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Deleted volume successfully. Jul 08 01:56:56 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-9773b60d-08a5-47e2-b72f-24df166ee735 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "cinder-a8d0adaf-df05-4639-8980-46d2ad2efbc7-delete_volume" released by "delete_volume" :: held 3.020s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:56 devstack sudo[105193]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.145s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:56 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:56:56 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager._thread_info {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:56:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread count: 29 {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:56:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread info: [<_MainThread(MainThread, started 127058402500736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:56:56 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8964d082-c1ae-40d4-a65c-1b0cb21abce0 tempest-ProjectReaderTests-22232040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-368c6f78-e077-4cf7-8c57-38ac3c2fa82f" returned: 0 in 0.845s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:56 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9dec3b1d-3fbb-4f2d-94cd-351187020f06 tempest-ProjectReaderTests-756482943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe" returned: 0 in 0.939s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9dec3b1d-3fbb-4f2d-94cd-351187020f06 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe.159f7254-cb0b-4a81-b4dc-90b30cf76a80 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:56 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-8964d082-c1ae-40d4-a65c-1b0cb21abce0 tempest-ProjectReaderTests-22232040 None] Lock "cinder-quobyte-368c6f78-e077-4cf7-8c57-38ac3c2fa82f" released by "delete_volume" :: held 1.920s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:56 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe.159f7254-cb0b-4a81-b4dc-90b30cf76a80 1G Jul 08 01:56:56 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:56 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-8964d082-c1ae-40d4-a65c-1b0cb21abce0 tempest-ProjectReaderTests-22232040 None] Created reservations ['3f3d300f-cfc9-4b74-974f-c072372101f6', 'f165c1b2-7fbf-4283-a13b-2efa697bbdc3', '51712db7-a9b4-4ab9-82ae-0a70c2ad31d3', 'f1beed07-dc67-4eec-ba45-3642ef8beee3'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:56:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8964d082-c1ae-40d4-a65c-1b0cb21abce0 tempest-ProjectReaderTests-22232040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8964d082-c1ae-40d4-a65c-1b0cb21abce0 tempest-ProjectReaderTests-22232040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:56 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-8964d082-c1ae-40d4-a65c-1b0cb21abce0 tempest-ProjectReaderTests-22232040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:56 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-8964d082-c1ae-40d4-a65c-1b0cb21abce0 tempest-ProjectReaderTests-22232040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-8964d082-c1ae-40d4-a65c-1b0cb21abce0 tempest-ProjectReaderTests-22232040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8964d082-c1ae-40d4-a65c-1b0cb21abce0 tempest-ProjectReaderTests-22232040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:56 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:56:56 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:57 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-23c24e88-3dfa-4d7e-bb4b-cbcaa04c9eb8 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4e77cccb-bef4-4e29-b266-005f27377c3f" returned: 0 in 1.237s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-23c24e88-3dfa-4d7e-bb4b-cbcaa04c9eb8 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4e77cccb-bef4-4e29-b266-005f27377c3f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:57 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4e77cccb-bef4-4e29-b266-005f27377c3f Jul 08 01:56:57 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-be1d3b00-8a0f-499b-8aae-604bc9aa7058 tempest-ProjectMemberTests-73797185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:57 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-8964d082-c1ae-40d4-a65c-1b0cb21abce0 tempest-ProjectReaderTests-22232040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.034s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:57 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-8964d082-c1ae-40d4-a65c-1b0cb21abce0 tempest-ProjectReaderTests-22232040 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:56:57 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-8964d082-c1ae-40d4-a65c-1b0cb21abce0 tempest-ProjectReaderTests-22232040 None] Deleted volume successfully. Jul 08 01:56:57 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d8abd29-fce7-4152-824e-020429620174 tempest-ProjectReaderTests-22232040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:56:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1d8abd29-fce7-4152-824e-020429620174 tempest-ProjectReaderTests-22232040 None] Flow 'volume_create_manager' (0d6fef1b-006e-4271-a440-8a3b02562049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:56:57 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1d8abd29-fce7-4152-824e-020429620174 tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0b7e2d3-2027-4bfe-902e-66c8cb501e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:58 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-8964d082-c1ae-40d4-a65c-1b0cb21abce0 tempest-ProjectReaderTests-22232040 None] Lock "cinder-368c6f78-e077-4cf7-8c57-38ac3c2fa82f-delete_volume" released by "delete_volume" :: held 3.301s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1d8abd29-fce7-4152-824e-020429620174 tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0b7e2d3-2027-4bfe-902e-66c8cb501e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1230088733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af8720ef-6df8-4b03-b439-911667aa09db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7111ef9ce00343a993a9ff8b36a1ff80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:56:58Z,use_quota=True,user_id='1658f8ce7bdd4ab79bb222d1e0bd10d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1d8abd29-fce7-4152-824e-020429620174 tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91cd68f8-fa21-4b0b-b522-a9dc37ae0cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1d8abd29-fce7-4152-824e-020429620174 tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91cd68f8-fa21-4b0b-b522-a9dc37ae0cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1d8abd29-fce7-4152-824e-020429620174 tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6932fed-16c0-418f-ad4c-c6ba5ec7b605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1d8abd29-fce7-4152-824e-020429620174 tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6932fed-16c0-418f-ad4c-c6ba5ec7b605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af8720ef-6df8-4b03-b439-911667aa09db', 'volume_name': 'volume-af8720ef-6df8-4b03-b439-911667aa09db', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1d8abd29-fce7-4152-824e-020429620174 tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c77927-9536-4efa-8ff2-fc6b4550e870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1d8abd29-fce7-4152-824e-020429620174 tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c77927-9536-4efa-8ff2-fc6b4550e870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:58 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1d8abd29-fce7-4152-824e-020429620174 tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acfbee67-f36c-4a14-915e-6d16dca4d154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:58 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-1d8abd29-fce7-4152-824e-020429620174 tempest-ProjectReaderTests-22232040 None] Volume af8720ef-6df8-4b03-b439-911667aa09db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af8720ef-6df8-4b03-b439-911667aa09db', 'volume_size': 1} Jul 08 01:56:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-1d8abd29-fce7-4152-824e-020429620174 tempest-ProjectReaderTests-22232040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:58 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9dec3b1d-3fbb-4f2d-94cd-351187020f06 tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe.159f7254-cb0b-4a81-b4dc-90b30cf76a80 1G" returned: 0 in 1.383s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9dec3b1d-3fbb-4f2d-94cd-351187020f06 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fe90171-ab38-458f-a233-87ecb0429afe -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe.159f7254-cb0b-4a81-b4dc-90b30cf76a80 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:58 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-23c24e88-3dfa-4d7e-bb4b-cbcaa04c9eb8 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4e77cccb-bef4-4e29-b266-005f27377c3f" returned: 0 in 0.988s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:58 devstack sudo[105234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fe90171-ab38-458f-a233-87ecb0429afe -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe.159f7254-cb0b-4a81-b4dc-90b30cf76a80 Jul 08 01:56:58 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:58 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-23c24e88-3dfa-4d7e-bb4b-cbcaa04c9eb8 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "cinder-quobyte-4e77cccb-bef4-4e29-b266-005f27377c3f" released by "delete_volume" :: held 2.313s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:58 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-23c24e88-3dfa-4d7e-bb4b-cbcaa04c9eb8 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Created reservations ['7f47c0c5-2cf9-4e7f-87b4-692d2c2d92f5', '2ef0d7d4-c3ef-49f8-9305-102b813a2772', '158a9231-342b-44bd-bf66-e21aa3bfbe1f', '1367e33f-9f15-417c-b940-5bec535e966e'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:56:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-23c24e88-3dfa-4d7e-bb4b-cbcaa04c9eb8 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-23c24e88-3dfa-4d7e-bb4b-cbcaa04c9eb8 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:58 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-23c24e88-3dfa-4d7e-bb4b-cbcaa04c9eb8 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:58 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-23c24e88-3dfa-4d7e-bb4b-cbcaa04c9eb8 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-23c24e88-3dfa-4d7e-bb4b-cbcaa04c9eb8 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-23c24e88-3dfa-4d7e-bb4b-cbcaa04c9eb8 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:58 devstack sudo[105236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:56:58 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:58 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9dec3b1d-3fbb-4f2d-94cd-351187020f06 tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fe90171-ab38-458f-a233-87ecb0429afe -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe.159f7254-cb0b-4a81-b4dc-90b30cf76a80" returned: 0 in 0.768s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:58 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-9dec3b1d-3fbb-4f2d-94cd-351187020f06 tempest-ProjectReaderTests-756482943 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe.159f7254-cb0b-4a81-b4dc-90b30cf76a80 is being set with open permissions: ugo+rw Jul 08 01:56:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9dec3b1d-3fbb-4f2d-94cd-351187020f06 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe.159f7254-cb0b-4a81-b4dc-90b30cf76a80 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:58 devstack sudo[105242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe.159f7254-cb0b-4a81-b4dc-90b30cf76a80 Jul 08 01:56:58 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:58 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-23c24e88-3dfa-4d7e-bb4b-cbcaa04c9eb8 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.715s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:58 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-23c24e88-3dfa-4d7e-bb4b-cbcaa04c9eb8 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:56:58 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-23c24e88-3dfa-4d7e-bb4b-cbcaa04c9eb8 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Deleted volume successfully. Jul 08 01:56:59 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f400b1f6-0b0d-4317-87d0-931b49feecae tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Acquiring lock "cinder-b1610c9f-fe5f-43de-a9ec-cc0a3095ac5d-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:59 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-23c24e88-3dfa-4d7e-bb4b-cbcaa04c9eb8 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "cinder-4e77cccb-bef4-4e29-b266-005f27377c3f-delete_volume" released by "delete_volume" :: held 3.428s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:59 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f400b1f6-0b0d-4317-87d0-931b49feecae tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "cinder-b1610c9f-fe5f-43de-a9ec-cc0a3095ac5d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:59 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f400b1f6-0b0d-4317-87d0-931b49feecae tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Acquiring lock "cinder-quobyte-b1610c9f-fe5f-43de-a9ec-cc0a3095ac5d" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:59 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f400b1f6-0b0d-4317-87d0-931b49feecae tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "cinder-quobyte-b1610c9f-fe5f-43de-a9ec-cc0a3095ac5d" acquired by "delete_volume" :: waited 0.019s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:59 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[b975af83-d6ef-4af5-8ac4-33d57bf660c4]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f400b1f6-0b0d-4317-87d0-931b49feecae tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b1610c9f-fe5f-43de-a9ec-cc0a3095ac5d {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:59 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b1610c9f-fe5f-43de-a9ec-cc0a3095ac5d Jul 08 01:56:59 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:59 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9dec3b1d-3fbb-4f2d-94cd-351187020f06 tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe.159f7254-cb0b-4a81-b4dc-90b30cf76a80" returned: 0 in 0.798s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9dec3b1d-3fbb-4f2d-94cd-351187020f06 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:59 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe.info Jul 08 01:56:59 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:59 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f400b1f6-0b0d-4317-87d0-931b49feecae tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b1610c9f-fe5f-43de-a9ec-cc0a3095ac5d" returned: 0 in 0.863s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f400b1f6-0b0d-4317-87d0-931b49feecae tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b1610c9f-fe5f-43de-a9ec-cc0a3095ac5d {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:00 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b1610c9f-fe5f-43de-a9ec-cc0a3095ac5d Jul 08 01:57:00 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:00 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9dec3b1d-3fbb-4f2d-94cd-351187020f06 tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe.info" returned: 0 in 0.754s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:00 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-9dec3b1d-3fbb-4f2d-94cd-351187020f06 tempest-ProjectReaderTests-756482943 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe.info is being set with open permissions: ugo+rw Jul 08 01:57:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9dec3b1d-3fbb-4f2d-94cd-351187020f06 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:00 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe.info Jul 08 01:57:00 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:00 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f400b1f6-0b0d-4317-87d0-931b49feecae tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b1610c9f-fe5f-43de-a9ec-cc0a3095ac5d" returned: 0 in 0.767s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:00 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f400b1f6-0b0d-4317-87d0-931b49feecae tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "cinder-quobyte-b1610c9f-fe5f-43de-a9ec-cc0a3095ac5d" released by "delete_volume" :: held 1.682s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:00 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-f400b1f6-0b0d-4317-87d0-931b49feecae tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Created reservations ['807fd613-a6b4-426b-ad4f-d933df7381f5', 'd90aaa78-387d-4e12-b2e8-1c7039f3d104', '791b6607-3b4c-4cb2-83b3-e43eb1ff5696', '4ebf7db3-f613-4bba-95d9-1e74ae085222'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:57:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f400b1f6-0b0d-4317-87d0-931b49feecae tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f400b1f6-0b0d-4317-87d0-931b49feecae tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f400b1f6-0b0d-4317-87d0-931b49feecae tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:57:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f400b1f6-0b0d-4317-87d0-931b49feecae tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:57:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f400b1f6-0b0d-4317-87d0-931b49feecae tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f400b1f6-0b0d-4317-87d0-931b49feecae tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:00 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:57:00 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9dec3b1d-3fbb-4f2d-94cd-351187020f06 tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe.info" returned: 0 in 0.722s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:01 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-9dec3b1d-3fbb-4f2d-94cd-351187020f06 tempest-ProjectReaderTests-756482943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.509s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-be1d3b00-8a0f-499b-8aae-604bc9aa7058 tempest-ProjectMemberTests-73797185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.756s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:01 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-be1d3b00-8a0f-499b-8aae-604bc9aa7058 tempest-ProjectMemberTests-73797185 None] Creating offline snapshot 066cb218-95b5-4b7c-a54a-39910dffa7e9 of volume 4db7ca25-3a23-403d-970b-35300a7b7858 {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:57:01 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-9dec3b1d-3fbb-4f2d-94cd-351187020f06 tempest-ProjectReaderTests-756482943 None] Create snapshot completed successfully Jul 08 01:57:01 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe05c0a2-2554-4220-a8a1-c64c7e51e71c]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-be1d3b00-8a0f-499b-8aae-604bc9aa7058 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:01 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f78f7a33-666b-4b43-b7c5-7998c56a9b88 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Acquiring lock "cinder-3f8b445b-b5b7-40e3-a36f-3ecaa42ad1ff-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:01 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f78f7a33-666b-4b43-b7c5-7998c56a9b88 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "cinder-3f8b445b-b5b7-40e3-a36f-3ecaa42ad1ff-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:01 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f78f7a33-666b-4b43-b7c5-7998c56a9b88 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Acquiring lock "cinder-quobyte-3f8b445b-b5b7-40e3-a36f-3ecaa42ad1ff" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:01 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f78f7a33-666b-4b43-b7c5-7998c56a9b88 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "cinder-quobyte-3f8b445b-b5b7-40e3-a36f-3ecaa42ad1ff" acquired by "delete_volume" :: waited 0.018s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:01 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb63cf7-7c80-4e84-ab23-39a6c8352208]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f78f7a33-666b-4b43-b7c5-7998c56a9b88 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f8b445b-b5b7-40e3-a36f-3ecaa42ad1ff {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:01 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858 Jul 08 01:57:01 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:01 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f8b445b-b5b7-40e3-a36f-3ecaa42ad1ff Jul 08 01:57:01 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:01 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f400b1f6-0b0d-4317-87d0-931b49feecae tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.726s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:01 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-f400b1f6-0b0d-4317-87d0-931b49feecae tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:57:01 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-f400b1f6-0b0d-4317-87d0-931b49feecae tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Deleted volume successfully. Jul 08 01:57:01 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f400b1f6-0b0d-4317-87d0-931b49feecae tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "cinder-b1610c9f-fe5f-43de-a9ec-cc0a3095ac5d-delete_volume" released by "delete_volume" :: held 2.643s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:01 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-834f1048-3c11-4fcd-98d0-97102a350151 tempest-ProjectReaderTests-756482943 None] Acquiring lock "cinder-159f7254-cb0b-4a81-b4dc-90b30cf76a80-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:01 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-834f1048-3c11-4fcd-98d0-97102a350151 tempest-ProjectReaderTests-756482943 None] Lock "cinder-159f7254-cb0b-4a81-b4dc-90b30cf76a80-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:01 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-834f1048-3c11-4fcd-98d0-97102a350151 tempest-ProjectReaderTests-756482943 None] Acquiring lock "cinder-quobyte-7fe90171-ab38-458f-a233-87ecb0429afe" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:01 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-834f1048-3c11-4fcd-98d0-97102a350151 tempest-ProjectReaderTests-756482943 None] Lock "cinder-quobyte-7fe90171-ab38-458f-a233-87ecb0429afe" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:01 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-834f1048-3c11-4fcd-98d0-97102a350151 tempest-ProjectReaderTests-756482943 None] Acquiring lock "cinder-quobyte-159f7254-cb0b-4a81-b4dc-90b30cf76a80" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:02 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-834f1048-3c11-4fcd-98d0-97102a350151 tempest-ProjectReaderTests-756482943 None] Lock "cinder-quobyte-159f7254-cb0b-4a81-b4dc-90b30cf76a80" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:02 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-834f1048-3c11-4fcd-98d0-97102a350151 tempest-ProjectReaderTests-756482943 None] Deleting offline snapshot 159f7254-cb0b-4a81-b4dc-90b30cf76a80 of volume 7fe90171-ab38-458f-a233-87ecb0429afe {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:57:02 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-834f1048-3c11-4fcd-98d0-97102a350151 tempest-ProjectReaderTests-756482943 None] snapshot_file for this snap is: volume-7fe90171-ab38-458f-a233-87ecb0429afe.159f7254-cb0b-4a81-b4dc-90b30cf76a80 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:57:02 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[4995f5de-c818-4b11-8a5d-4276b21bf27a]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-834f1048-3c11-4fcd-98d0-97102a350151 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe.159f7254-cb0b-4a81-b4dc-90b30cf76a80 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:02 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe.159f7254-cb0b-4a81-b4dc-90b30cf76a80 Jul 08 01:57:02 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:02 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-be1d3b00-8a0f-499b-8aae-604bc9aa7058 tempest-ProjectMemberTests-73797185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858" returned: 0 in 0.948s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-be1d3b00-8a0f-499b-8aae-604bc9aa7058 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858.066cb218-95b5-4b7c-a54a-39910dffa7e9 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:02 devstack sudo[105274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858.066cb218-95b5-4b7c-a54a-39910dffa7e9 1G Jul 08 01:57:02 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:02 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f78f7a33-666b-4b43-b7c5-7998c56a9b88 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f8b445b-b5b7-40e3-a36f-3ecaa42ad1ff" returned: 0 in 0.887s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f78f7a33-666b-4b43-b7c5-7998c56a9b88 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f8b445b-b5b7-40e3-a36f-3ecaa42ad1ff {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:02 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f8b445b-b5b7-40e3-a36f-3ecaa42ad1ff Jul 08 01:57:02 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:02 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-834f1048-3c11-4fcd-98d0-97102a350151 tempest-ProjectReaderTests-756482943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe.159f7254-cb0b-4a81-b4dc-90b30cf76a80" returned: 0 in 0.877s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:02 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-834f1048-3c11-4fcd-98d0-97102a350151 tempest-ProjectReaderTests-756482943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fe90171-ab38-458f-a233-87ecb0429afe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:57:02 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[296ad6a3-bbc2-408d-ab44-50d99c757716]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-834f1048-3c11-4fcd-98d0-97102a350151 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:03 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f78f7a33-666b-4b43-b7c5-7998c56a9b88 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3f8b445b-b5b7-40e3-a36f-3ecaa42ad1ff" returned: 0 in 0.748s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:03 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f78f7a33-666b-4b43-b7c5-7998c56a9b88 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "cinder-quobyte-3f8b445b-b5b7-40e3-a36f-3ecaa42ad1ff" released by "delete_volume" :: held 1.677s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:03 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-f78f7a33-666b-4b43-b7c5-7998c56a9b88 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Created reservations ['198d7c0a-8229-475f-bfc0-bf95de6c6dfd', '1d8db3d5-460e-4ab4-9e6f-db7a9c2a5322', 'f21519f7-abbb-431b-bfbc-1fbfcaf14a27', '5e9b2223-9a86-4145-a515-6469b6c0f2ec'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:57:03 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe Jul 08 01:57:03 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:03 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-be1d3b00-8a0f-499b-8aae-604bc9aa7058 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858.066cb218-95b5-4b7c-a54a-39910dffa7e9 1G" returned: 0 in 0.962s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-be1d3b00-8a0f-499b-8aae-604bc9aa7058 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4db7ca25-3a23-403d-970b-35300a7b7858 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858.066cb218-95b5-4b7c-a54a-39910dffa7e9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:03 devstack sudo[105288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4db7ca25-3a23-403d-970b-35300a7b7858 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858.066cb218-95b5-4b7c-a54a-39910dffa7e9 Jul 08 01:57:03 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f78f7a33-666b-4b43-b7c5-7998c56a9b88 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f78f7a33-666b-4b43-b7c5-7998c56a9b88 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:03 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f78f7a33-666b-4b43-b7c5-7998c56a9b88 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:57:03 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f78f7a33-666b-4b43-b7c5-7998c56a9b88 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:57:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f78f7a33-666b-4b43-b7c5-7998c56a9b88 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f78f7a33-666b-4b43-b7c5-7998c56a9b88 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:03 devstack sudo[105290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:57:03 devstack sudo[105290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:03 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-969f0945-8b80-49f2-951f-02bea0ff835a tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Acquiring lock "cinder-c0634d5d-8fa2-42cb-b8a9-b6c4dbc98e34-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:03 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-969f0945-8b80-49f2-951f-02bea0ff835a tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "cinder-c0634d5d-8fa2-42cb-b8a9-b6c4dbc98e34-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:03 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-969f0945-8b80-49f2-951f-02bea0ff835a tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Acquiring lock "cinder-quobyte-c0634d5d-8fa2-42cb-b8a9-b6c4dbc98e34" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:03 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-969f0945-8b80-49f2-951f-02bea0ff835a tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "cinder-quobyte-c0634d5d-8fa2-42cb-b8a9-b6c4dbc98e34" acquired by "delete_volume" :: waited 0.022s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:03 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0ba17c-27a8-4a6e-9b00-14e9cd79ca27]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-969f0945-8b80-49f2-951f-02bea0ff835a tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0634d5d-8fa2-42cb-b8a9-b6c4dbc98e34 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:03 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0634d5d-8fa2-42cb-b8a9-b6c4dbc98e34 Jul 08 01:57:03 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:03 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-834f1048-3c11-4fcd-98d0-97102a350151 tempest-ProjectReaderTests-756482943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe" returned: 0 in 0.969s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-834f1048-3c11-4fcd-98d0-97102a350151 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe.159f7254-cb0b-4a81-b4dc-90b30cf76a80 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:03 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe.159f7254-cb0b-4a81-b4dc-90b30cf76a80 Jul 08 01:57:03 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:04 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-be1d3b00-8a0f-499b-8aae-604bc9aa7058 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4db7ca25-3a23-403d-970b-35300a7b7858 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858.066cb218-95b5-4b7c-a54a-39910dffa7e9" returned: 0 in 0.914s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:04 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-be1d3b00-8a0f-499b-8aae-604bc9aa7058 tempest-ProjectMemberTests-73797185 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858.066cb218-95b5-4b7c-a54a-39910dffa7e9 is being set with open permissions: ugo+rw Jul 08 01:57:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-be1d3b00-8a0f-499b-8aae-604bc9aa7058 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858.066cb218-95b5-4b7c-a54a-39910dffa7e9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:04 devstack sudo[105290]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f78f7a33-666b-4b43-b7c5-7998c56a9b88 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.889s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:04 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-f78f7a33-666b-4b43-b7c5-7998c56a9b88 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:57:04 devstack sudo[105304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858.066cb218-95b5-4b7c-a54a-39910dffa7e9 Jul 08 01:57:04 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-f78f7a33-666b-4b43-b7c5-7998c56a9b88 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Deleted volume successfully. Jul 08 01:57:04 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:04 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-f78f7a33-666b-4b43-b7c5-7998c56a9b88 tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "cinder-3f8b445b-b5b7-40e3-a36f-3ecaa42ad1ff-delete_volume" released by "delete_volume" :: held 2.847s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:04 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-969f0945-8b80-49f2-951f-02bea0ff835a tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0634d5d-8fa2-42cb-b8a9-b6c4dbc98e34" returned: 0 in 0.959s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-969f0945-8b80-49f2-951f-02bea0ff835a tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0634d5d-8fa2-42cb-b8a9-b6c4dbc98e34 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:04 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0634d5d-8fa2-42cb-b8a9-b6c4dbc98e34 Jul 08 01:57:04 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:04 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-be1d3b00-8a0f-499b-8aae-604bc9aa7058 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858.066cb218-95b5-4b7c-a54a-39910dffa7e9" returned: 0 in 0.777s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:04 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-834f1048-3c11-4fcd-98d0-97102a350151 tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe.159f7254-cb0b-4a81-b4dc-90b30cf76a80" returned: 0 in 0.934s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-834f1048-3c11-4fcd-98d0-97102a350151 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe.159f7254-cb0b-4a81-b4dc-90b30cf76a80 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:04 devstack sudo[105315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe.159f7254-cb0b-4a81-b4dc-90b30cf76a80 Jul 08 01:57:04 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-be1d3b00-8a0f-499b-8aae-604bc9aa7058 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:04 devstack sudo[105317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858.info Jul 08 01:57:04 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:05 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-969f0945-8b80-49f2-951f-02bea0ff835a tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-c0634d5d-8fa2-42cb-b8a9-b6c4dbc98e34" returned: 0 in 0.792s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:05 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-969f0945-8b80-49f2-951f-02bea0ff835a tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "cinder-quobyte-c0634d5d-8fa2-42cb-b8a9-b6c4dbc98e34" released by "delete_volume" :: held 1.813s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:05 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-969f0945-8b80-49f2-951f-02bea0ff835a tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Created reservations ['8df51163-5e6f-4ec5-aab5-66940d3aed73', '6b16e9a8-c34d-4df6-8c5e-3ff97207839d', 'caf723c3-7c98-4916-af8e-780f5e746a83', 'ebf1ee7e-1b1e-4420-9a1c-5993fd1b4fa5'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:57:05 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-834f1048-3c11-4fcd-98d0-97102a350151 tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe.159f7254-cb0b-4a81-b4dc-90b30cf76a80" returned: 0 in 0.800s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:05 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-be1d3b00-8a0f-499b-8aae-604bc9aa7058 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858.info" returned: 0 in 0.814s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:05 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-be1d3b00-8a0f-499b-8aae-604bc9aa7058 tempest-ProjectMemberTests-73797185 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858.info is being set with open permissions: ugo+rw Jul 08 01:57:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-be1d3b00-8a0f-499b-8aae-604bc9aa7058 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:05 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-834f1048-3c11-4fcd-98d0-97102a350151 tempest-ProjectReaderTests-756482943 None] Lock "cinder-quobyte-159f7254-cb0b-4a81-b4dc-90b30cf76a80" released by "_delete_snapshot" :: held 3.731s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:05 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858.info Jul 08 01:57:05 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:05 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-834f1048-3c11-4fcd-98d0-97102a350151 tempest-ProjectReaderTests-756482943 None] Lock "cinder-quobyte-7fe90171-ab38-458f-a233-87ecb0429afe" released by "delete_snapshot" :: held 3.781s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-969f0945-8b80-49f2-951f-02bea0ff835a tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-969f0945-8b80-49f2-951f-02bea0ff835a tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:05 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-969f0945-8b80-49f2-951f-02bea0ff835a tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:57:05 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-969f0945-8b80-49f2-951f-02bea0ff835a tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:57:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-969f0945-8b80-49f2-951f-02bea0ff835a tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-969f0945-8b80-49f2-951f-02bea0ff835a tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:05 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:57:05 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:05 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-834f1048-3c11-4fcd-98d0-97102a350151 tempest-ProjectReaderTests-756482943 None] Created reservations ['20b59fbf-a364-4f4f-b44b-1f5934ca0175', '121f47e9-3872-42b7-8bec-77f3e212654a', 'f8bdcea9-5388-4ac0-8d67-d4cf669c0b8d', '623ee32a-de78-4fb1-ba4f-1fd636ad0776'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:57:05 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-834f1048-3c11-4fcd-98d0-97102a350151 tempest-ProjectReaderTests-756482943 None] Delete snapshot completed successfully. Jul 08 01:57:05 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-834f1048-3c11-4fcd-98d0-97102a350151 tempest-ProjectReaderTests-756482943 None] Lock "cinder-159f7254-cb0b-4a81-b4dc-90b30cf76a80-delete_snapshot" released by "delete_snapshot" :: held 4.005s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:06 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b61ef685-98ba-4239-b218-0c66f10f14fc tempest-ProjectReaderTests-756482943 None] Acquiring lock "cinder-7fe90171-ab38-458f-a233-87ecb0429afe-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:06 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b61ef685-98ba-4239-b218-0c66f10f14fc tempest-ProjectReaderTests-756482943 None] Lock "cinder-7fe90171-ab38-458f-a233-87ecb0429afe-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:06 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b61ef685-98ba-4239-b218-0c66f10f14fc tempest-ProjectReaderTests-756482943 None] Acquiring lock "cinder-quobyte-7fe90171-ab38-458f-a233-87ecb0429afe" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:06 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b61ef685-98ba-4239-b218-0c66f10f14fc tempest-ProjectReaderTests-756482943 None] Lock "cinder-quobyte-7fe90171-ab38-458f-a233-87ecb0429afe" acquired by "delete_volume" :: waited 0.018s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:06 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc4c55d-13ad-432b-8dd0-416bf3006aaa]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b61ef685-98ba-4239-b218-0c66f10f14fc tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:06 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe Jul 08 01:57:06 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:06 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-be1d3b00-8a0f-499b-8aae-604bc9aa7058 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858.info" returned: 0 in 0.934s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:06 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-be1d3b00-8a0f-499b-8aae-604bc9aa7058 tempest-ProjectMemberTests-73797185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.484s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-1d8abd29-fce7-4152-824e-020429620174 tempest-ProjectReaderTests-22232040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.611s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:06 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-1d8abd29-fce7-4152-824e-020429620174 tempest-ProjectReaderTests-22232040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1230088733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af8720ef-6df8-4b03-b439-911667aa09db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7111ef9ce00343a993a9ff8b36a1ff80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:56:58Z,use_quota=True,user_id='1658f8ce7bdd4ab79bb222d1e0bd10d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:57:06 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-1d8abd29-fce7-4152-824e-020429620174 tempest-ProjectReaderTests-22232040 None] Creating volume af8720ef-6df8-4b03-b439-911667aa09db {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:57:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-1d8abd29-fce7-4152-824e-020429620174 tempest-ProjectReaderTests-22232040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-1d8abd29-fce7-4152-824e-020429620174 tempest-ProjectReaderTests-22232040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:06 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-1d8abd29-fce7-4152-824e-020429620174 tempest-ProjectReaderTests-22232040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:57:06 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-1d8abd29-fce7-4152-824e-020429620174 tempest-ProjectReaderTests-22232040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:57:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-1d8abd29-fce7-4152-824e-020429620174 tempest-ProjectReaderTests-22232040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:06 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-1d8abd29-fce7-4152-824e-020429620174 tempest-ProjectReaderTests-22232040 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:57:06 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-1d8abd29-fce7-4152-824e-020429620174 tempest-ProjectReaderTests-22232040 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:57:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1d8abd29-fce7-4152-824e-020429620174 tempest-ProjectReaderTests-22232040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-af8720ef-6df8-4b03-b439-911667aa09db 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-969f0945-8b80-49f2-951f-02bea0ff835a tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.932s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:06 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-969f0945-8b80-49f2-951f-02bea0ff835a tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:57:06 devstack sudo[105331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-af8720ef-6df8-4b03-b439-911667aa09db 1073741824 Jul 08 01:57:06 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:06 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-969f0945-8b80-49f2-951f-02bea0ff835a tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Deleted volume successfully. Jul 08 01:57:06 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-be1d3b00-8a0f-499b-8aae-604bc9aa7058 tempest-ProjectMemberTests-73797185 None] Create snapshot completed successfully Jul 08 01:57:06 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-969f0945-8b80-49f2-951f-02bea0ff835a tempest-CreateVolumesFromSourceVolumeTest-1428766536 None] Lock "cinder-c0634d5d-8fa2-42cb-b8a9-b6c4dbc98e34-delete_volume" released by "delete_volume" :: held 3.214s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:07 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b61ef685-98ba-4239-b218-0c66f10f14fc tempest-ProjectReaderTests-756482943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe" returned: 0 in 1.079s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b61ef685-98ba-4239-b218-0c66f10f14fc tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:07 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe Jul 08 01:57:07 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:07 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1d8abd29-fce7-4152-824e-020429620174 tempest-ProjectReaderTests-22232040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-af8720ef-6df8-4b03-b439-911667aa09db 1073741824" returned: 0 in 1.121s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1d8abd29-fce7-4152-824e-020429620174 tempest-ProjectReaderTests-22232040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-af8720ef-6df8-4b03-b439-911667aa09db {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:07 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-af8720ef-6df8-4b03-b439-911667aa09db Jul 08 01:57:07 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:07 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-cd76d7b0-28ea-4b4b-be38-78e21446d38a tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-066cb218-95b5-4b7c-a54a-39910dffa7e9-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:08 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-cd76d7b0-28ea-4b4b-be38-78e21446d38a tempest-ProjectMemberTests-73797185 None] Lock "cinder-066cb218-95b5-4b7c-a54a-39910dffa7e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:08 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-cd76d7b0-28ea-4b4b-be38-78e21446d38a tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-quobyte-4db7ca25-3a23-403d-970b-35300a7b7858" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:08 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-cd76d7b0-28ea-4b4b-be38-78e21446d38a tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-4db7ca25-3a23-403d-970b-35300a7b7858" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:08 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-cd76d7b0-28ea-4b4b-be38-78e21446d38a tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-quobyte-066cb218-95b5-4b7c-a54a-39910dffa7e9" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:08 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-cd76d7b0-28ea-4b4b-be38-78e21446d38a tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-066cb218-95b5-4b7c-a54a-39910dffa7e9" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:08 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-cd76d7b0-28ea-4b4b-be38-78e21446d38a tempest-ProjectMemberTests-73797185 None] Deleting offline snapshot 066cb218-95b5-4b7c-a54a-39910dffa7e9 of volume 4db7ca25-3a23-403d-970b-35300a7b7858 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:57:08 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-cd76d7b0-28ea-4b4b-be38-78e21446d38a tempest-ProjectMemberTests-73797185 None] snapshot_file for this snap is: volume-4db7ca25-3a23-403d-970b-35300a7b7858.066cb218-95b5-4b7c-a54a-39910dffa7e9 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:57:08 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85f47f1-8ab0-4dac-9c0e-215c9146528d]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cd76d7b0-28ea-4b4b-be38-78e21446d38a tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858.066cb218-95b5-4b7c-a54a-39910dffa7e9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:08 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858.066cb218-95b5-4b7c-a54a-39910dffa7e9 Jul 08 01:57:08 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:08 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b61ef685-98ba-4239-b218-0c66f10f14fc tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7fe90171-ab38-458f-a233-87ecb0429afe" returned: 0 in 0.835s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:08 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b61ef685-98ba-4239-b218-0c66f10f14fc tempest-ProjectReaderTests-756482943 None] Lock "cinder-quobyte-7fe90171-ab38-458f-a233-87ecb0429afe" released by "delete_volume" :: held 1.986s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:08 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-b61ef685-98ba-4239-b218-0c66f10f14fc tempest-ProjectReaderTests-756482943 None] Created reservations ['12402649-ae16-4c17-86ad-4b7eeec7dabc', 'd53cf7ce-a09e-404d-a6d9-d3a82b80558f', '8d27261d-7fc8-4c93-ba40-e267484658be', '85e1659a-dee2-44bd-9379-d9d7289e3a6a'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:57:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b61ef685-98ba-4239-b218-0c66f10f14fc tempest-ProjectReaderTests-756482943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b61ef685-98ba-4239-b218-0c66f10f14fc tempest-ProjectReaderTests-756482943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:08 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b61ef685-98ba-4239-b218-0c66f10f14fc tempest-ProjectReaderTests-756482943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:57:08 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b61ef685-98ba-4239-b218-0c66f10f14fc tempest-ProjectReaderTests-756482943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:57:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b61ef685-98ba-4239-b218-0c66f10f14fc tempest-ProjectReaderTests-756482943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b61ef685-98ba-4239-b218-0c66f10f14fc tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:08 devstack sudo[105347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:57:08 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:08 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1d8abd29-fce7-4152-824e-020429620174 tempest-ProjectReaderTests-22232040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-af8720ef-6df8-4b03-b439-911667aa09db" returned: 0 in 0.997s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:08 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-1d8abd29-fce7-4152-824e-020429620174 tempest-ProjectReaderTests-22232040 None] <== create_volume: return (2206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:57:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-1d8abd29-fce7-4152-824e-020429620174 tempest-ProjectReaderTests-22232040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.212s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:08 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1d8abd29-fce7-4152-824e-020429620174 tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acfbee67-f36c-4a14-915e-6d16dca4d154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af8720ef-6df8-4b03-b439-911667aa09db', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:08 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1d8abd29-fce7-4152-824e-020429620174 tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93badf04-b585-42ab-b1b2-80181b009c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:08 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-1d8abd29-fce7-4152-824e-020429620174 tempest-ProjectReaderTests-22232040 None] Volume volume-af8720ef-6df8-4b03-b439-911667aa09db (af8720ef-6df8-4b03-b439-911667aa09db): created successfully Jul 08 01:57:08 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1d8abd29-fce7-4152-824e-020429620174 tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93badf04-b585-42ab-b1b2-80181b009c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:09 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1d8abd29-fce7-4152-824e-020429620174 tempest-ProjectReaderTests-22232040 None] Flow 'volume_create_manager' (0d6fef1b-006e-4271-a440-8a3b02562049) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:57:09 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-1d8abd29-fce7-4152-824e-020429620174 tempest-ProjectReaderTests-22232040 None] Created volume successfully. Jul 08 01:57:09 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cd76d7b0-28ea-4b4b-be38-78e21446d38a tempest-ProjectMemberTests-73797185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858.066cb218-95b5-4b7c-a54a-39910dffa7e9" returned: 0 in 1.336s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:09 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-cd76d7b0-28ea-4b4b-be38-78e21446d38a tempest-ProjectMemberTests-73797185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4db7ca25-3a23-403d-970b-35300a7b7858(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:57:09 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e2d2ad-f510-478f-9b59-140aed39bc8d]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cd76d7b0-28ea-4b4b-be38-78e21446d38a tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:09 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-9accee0b-fd74-4dbe-aa90-a73a2b5a04f3 tempest-ProjectReaderTests-756482943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:57:09 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9accee0b-fd74-4dbe-aa90-a73a2b5a04f3 tempest-ProjectReaderTests-756482943 None] Flow 'volume_create_manager' (6eea31ff-3160-4c8d-afdb-87f47cff005f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:57:09 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9accee0b-fd74-4dbe-aa90-a73a2b5a04f3 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb7143c3-e3a9-4a7a-b1cc-9e4b393a1bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:09 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9accee0b-fd74-4dbe-aa90-a73a2b5a04f3 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb7143c3-e3a9-4a7a-b1cc-9e4b393a1bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-122318804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15d24229-202e-4b49-92b6-aaf840a1e81c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cedff66a12b04885a54b318907f70246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:57:09Z,use_quota=True,user_id='42422d5e57294adbb2ba38426c0322eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:09 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9accee0b-fd74-4dbe-aa90-a73a2b5a04f3 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ac7eba4-ffb3-484b-89d7-d05c8bc5269c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:09 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9accee0b-fd74-4dbe-aa90-a73a2b5a04f3 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ac7eba4-ffb3-484b-89d7-d05c8bc5269c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:09 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9accee0b-fd74-4dbe-aa90-a73a2b5a04f3 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4986529c-1f45-4960-98e5-bb1dd61ea0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:09 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858 Jul 08 01:57:09 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:09 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9accee0b-fd74-4dbe-aa90-a73a2b5a04f3 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4986529c-1f45-4960-98e5-bb1dd61ea0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15d24229-202e-4b49-92b6-aaf840a1e81c', 'volume_name': 'volume-15d24229-202e-4b49-92b6-aaf840a1e81c', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:09 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9accee0b-fd74-4dbe-aa90-a73a2b5a04f3 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d16e739-e831-447e-bc8a-ca39877577d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:09 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9accee0b-fd74-4dbe-aa90-a73a2b5a04f3 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d16e739-e831-447e-bc8a-ca39877577d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:09 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9accee0b-fd74-4dbe-aa90-a73a2b5a04f3 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db76ad9b-2b0d-40bf-9781-93956e0df312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:09 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-9accee0b-fd74-4dbe-aa90-a73a2b5a04f3 tempest-ProjectReaderTests-756482943 None] Volume 15d24229-202e-4b49-92b6-aaf840a1e81c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15d24229-202e-4b49-92b6-aaf840a1e81c', 'volume_size': 1} Jul 08 01:57:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-9accee0b-fd74-4dbe-aa90-a73a2b5a04f3 tempest-ProjectReaderTests-756482943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-9accee0b-fd74-4dbe-aa90-a73a2b5a04f3 tempest-ProjectReaderTests-756482943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:09 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-9accee0b-fd74-4dbe-aa90-a73a2b5a04f3 tempest-ProjectReaderTests-756482943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-122318804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15d24229-202e-4b49-92b6-aaf840a1e81c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cedff66a12b04885a54b318907f70246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:57:09Z,use_quota=True,user_id='42422d5e57294adbb2ba38426c0322eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:57:09 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-9accee0b-fd74-4dbe-aa90-a73a2b5a04f3 tempest-ProjectReaderTests-756482943 None] Creating volume 15d24229-202e-4b49-92b6-aaf840a1e81c {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:57:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-9accee0b-fd74-4dbe-aa90-a73a2b5a04f3 tempest-ProjectReaderTests-756482943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-9accee0b-fd74-4dbe-aa90-a73a2b5a04f3 tempest-ProjectReaderTests-756482943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:09 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-9accee0b-fd74-4dbe-aa90-a73a2b5a04f3 tempest-ProjectReaderTests-756482943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:57:09 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-9accee0b-fd74-4dbe-aa90-a73a2b5a04f3 tempest-ProjectReaderTests-756482943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:57:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-9accee0b-fd74-4dbe-aa90-a73a2b5a04f3 tempest-ProjectReaderTests-756482943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:09 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-9accee0b-fd74-4dbe-aa90-a73a2b5a04f3 tempest-ProjectReaderTests-756482943 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:57:09 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-9accee0b-fd74-4dbe-aa90-a73a2b5a04f3 tempest-ProjectReaderTests-756482943 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:57:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9accee0b-fd74-4dbe-aa90-a73a2b5a04f3 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:09 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b61ef685-98ba-4239-b218-0c66f10f14fc tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.087s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:09 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-b61ef685-98ba-4239-b218-0c66f10f14fc tempest-ProjectReaderTests-756482943 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:57:09 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-b61ef685-98ba-4239-b218-0c66f10f14fc tempest-ProjectReaderTests-756482943 None] Deleted volume successfully. Jul 08 01:57:09 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c 1073741824 Jul 08 01:57:09 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:09 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b61ef685-98ba-4239-b218-0c66f10f14fc tempest-ProjectReaderTests-756482943 None] Lock "cinder-7fe90171-ab38-458f-a233-87ecb0429afe-delete_volume" released by "delete_volume" :: held 3.468s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:09 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-44ac1e90-f153-4f28-b194-c5c623995f6b tempest-ProjectReaderTests-22232040 None] Acquiring lock "cinder-af8720ef-6df8-4b03-b439-911667aa09db-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:10 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-44ac1e90-f153-4f28-b194-c5c623995f6b tempest-ProjectReaderTests-22232040 None] Lock "cinder-af8720ef-6df8-4b03-b439-911667aa09db-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:10 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-44ac1e90-f153-4f28-b194-c5c623995f6b tempest-ProjectReaderTests-22232040 None] Acquiring lock "cinder-quobyte-af8720ef-6df8-4b03-b439-911667aa09db" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:10 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-44ac1e90-f153-4f28-b194-c5c623995f6b tempest-ProjectReaderTests-22232040 None] Lock "cinder-quobyte-af8720ef-6df8-4b03-b439-911667aa09db" acquired by "delete_volume" :: waited 0.021s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:10 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eab4ea2-24d1-46e9-85b1-5e0ce7e81d9e]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-44ac1e90-f153-4f28-b194-c5c623995f6b tempest-ProjectReaderTests-22232040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-af8720ef-6df8-4b03-b439-911667aa09db {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:10 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-166e6d59-cbb7-4a69-94f8-852c5bcf2836 tempest-CinderUnicodeTest-746990990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:57:10 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-166e6d59-cbb7-4a69-94f8-852c5bcf2836 tempest-CinderUnicodeTest-746990990 None] Flow 'volume_create_manager' (bc06a91d-9465-416f-a5b6-943db43bfc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:57:10 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-166e6d59-cbb7-4a69-94f8-852c5bcf2836 tempest-CinderUnicodeTest-746990990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b45c5d56-fcbb-431a-ad9a-9a280bd84871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:10 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-af8720ef-6df8-4b03-b439-911667aa09db Jul 08 01:57:10 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:10 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-166e6d59-cbb7-4a69-94f8-852c5bcf2836 tempest-CinderUnicodeTest-746990990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b45c5d56-fcbb-431a-ad9a-9a280bd84871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01fcde58-d255-4baa-966d-c523e746cbca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cda4139e98cc43b5aa7db822b160d21a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:57:10Z,use_quota=True,user_id='302e0f40174b4d06ba31f1f6a4f390b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:10 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-166e6d59-cbb7-4a69-94f8-852c5bcf2836 tempest-CinderUnicodeTest-746990990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96747319-cc21-4f84-acb0-8eff53b152eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:10 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-166e6d59-cbb7-4a69-94f8-852c5bcf2836 tempest-CinderUnicodeTest-746990990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96747319-cc21-4f84-acb0-8eff53b152eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:10 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-166e6d59-cbb7-4a69-94f8-852c5bcf2836 tempest-CinderUnicodeTest-746990990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9228d08c-19e2-4524-aff9-76bfae96b503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:10 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-166e6d59-cbb7-4a69-94f8-852c5bcf2836 tempest-CinderUnicodeTest-746990990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9228d08c-19e2-4524-aff9-76bfae96b503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01fcde58-d255-4baa-966d-c523e746cbca', 'volume_name': 'volume-01fcde58-d255-4baa-966d-c523e746cbca', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:10 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-166e6d59-cbb7-4a69-94f8-852c5bcf2836 tempest-CinderUnicodeTest-746990990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dec3072-2a15-4f0f-bbc6-893c0302a4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:10 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-166e6d59-cbb7-4a69-94f8-852c5bcf2836 tempest-CinderUnicodeTest-746990990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dec3072-2a15-4f0f-bbc6-893c0302a4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:10 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-166e6d59-cbb7-4a69-94f8-852c5bcf2836 tempest-CinderUnicodeTest-746990990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc991578-8cb0-495c-ae4f-a81f3346a1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:10 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-166e6d59-cbb7-4a69-94f8-852c5bcf2836 tempest-CinderUnicodeTest-746990990 None] Volume 01fcde58-d255-4baa-966d-c523e746cbca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01fcde58-d255-4baa-966d-c523e746cbca', 'volume_size': 1} Jul 08 01:57:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-166e6d59-cbb7-4a69-94f8-852c5bcf2836 tempest-CinderUnicodeTest-746990990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:10 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cd76d7b0-28ea-4b4b-be38-78e21446d38a tempest-ProjectMemberTests-73797185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858" returned: 0 in 1.115s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cd76d7b0-28ea-4b4b-be38-78e21446d38a tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858.066cb218-95b5-4b7c-a54a-39910dffa7e9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:10 devstack sudo[105367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858.066cb218-95b5-4b7c-a54a-39910dffa7e9 Jul 08 01:57:10 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:10 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9accee0b-fd74-4dbe-aa90-a73a2b5a04f3 tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c 1073741824" returned: 0 in 1.060s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9accee0b-fd74-4dbe-aa90-a73a2b5a04f3 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:10 devstack sudo[105369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c Jul 08 01:57:10 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:11 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-44ac1e90-f153-4f28-b194-c5c623995f6b tempest-ProjectReaderTests-22232040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-af8720ef-6df8-4b03-b439-911667aa09db" returned: 0 in 0.963s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-44ac1e90-f153-4f28-b194-c5c623995f6b tempest-ProjectReaderTests-22232040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-af8720ef-6df8-4b03-b439-911667aa09db {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:11 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-af8720ef-6df8-4b03-b439-911667aa09db Jul 08 01:57:11 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:11 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9accee0b-fd74-4dbe-aa90-a73a2b5a04f3 tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c" returned: 0 in 0.700s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:11 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-9accee0b-fd74-4dbe-aa90-a73a2b5a04f3 tempest-ProjectReaderTests-756482943 None] <== create_volume: return (1814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:57:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-9accee0b-fd74-4dbe-aa90-a73a2b5a04f3 tempest-ProjectReaderTests-756482943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.817s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-166e6d59-cbb7-4a69-94f8-852c5bcf2836 tempest-CinderUnicodeTest-746990990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.126s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:11 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-166e6d59-cbb7-4a69-94f8-852c5bcf2836 tempest-CinderUnicodeTest-746990990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01fcde58-d255-4baa-966d-c523e746cbca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cda4139e98cc43b5aa7db822b160d21a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:57:10Z,use_quota=True,user_id='302e0f40174b4d06ba31f1f6a4f390b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:57:11 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-166e6d59-cbb7-4a69-94f8-852c5bcf2836 tempest-CinderUnicodeTest-746990990 None] Creating volume 01fcde58-d255-4baa-966d-c523e746cbca {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:57:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-166e6d59-cbb7-4a69-94f8-852c5bcf2836 tempest-CinderUnicodeTest-746990990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-166e6d59-cbb7-4a69-94f8-852c5bcf2836 tempest-CinderUnicodeTest-746990990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:11 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-166e6d59-cbb7-4a69-94f8-852c5bcf2836 tempest-CinderUnicodeTest-746990990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:57:11 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:11 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-166e6d59-cbb7-4a69-94f8-852c5bcf2836 tempest-CinderUnicodeTest-746990990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:57:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-166e6d59-cbb7-4a69-94f8-852c5bcf2836 tempest-CinderUnicodeTest-746990990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:11 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-166e6d59-cbb7-4a69-94f8-852c5bcf2836 tempest-CinderUnicodeTest-746990990 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:57:11 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-166e6d59-cbb7-4a69-94f8-852c5bcf2836 tempest-CinderUnicodeTest-746990990 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:57:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-166e6d59-cbb7-4a69-94f8-852c5bcf2836 tempest-CinderUnicodeTest-746990990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-01fcde58-d255-4baa-966d-c523e746cbca 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cd76d7b0-28ea-4b4b-be38-78e21446d38a tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858.066cb218-95b5-4b7c-a54a-39910dffa7e9" returned: 0 in 0.924s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cd76d7b0-28ea-4b4b-be38-78e21446d38a tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858.066cb218-95b5-4b7c-a54a-39910dffa7e9 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:11 devstack sudo[105380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-01fcde58-d255-4baa-966d-c523e746cbca 1073741824 Jul 08 01:57:11 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:11 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9accee0b-fd74-4dbe-aa90-a73a2b5a04f3 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db76ad9b-2b0d-40bf-9781-93956e0df312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15d24229-202e-4b49-92b6-aaf840a1e81c', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:11 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9accee0b-fd74-4dbe-aa90-a73a2b5a04f3 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af8ac4a0-24bd-46f1-aea4-f87e85985a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:11 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858.066cb218-95b5-4b7c-a54a-39910dffa7e9 Jul 08 01:57:11 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:11 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-9accee0b-fd74-4dbe-aa90-a73a2b5a04f3 tempest-ProjectReaderTests-756482943 None] Volume volume-15d24229-202e-4b49-92b6-aaf840a1e81c (15d24229-202e-4b49-92b6-aaf840a1e81c): created successfully Jul 08 01:57:11 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9accee0b-fd74-4dbe-aa90-a73a2b5a04f3 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af8ac4a0-24bd-46f1-aea4-f87e85985a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:11 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-9accee0b-fd74-4dbe-aa90-a73a2b5a04f3 tempest-ProjectReaderTests-756482943 None] Flow 'volume_create_manager' (6eea31ff-3160-4c8d-afdb-87f47cff005f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:57:11 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-9accee0b-fd74-4dbe-aa90-a73a2b5a04f3 tempest-ProjectReaderTests-756482943 None] Created volume successfully. Jul 08 01:57:11 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-44ac1e90-f153-4f28-b194-c5c623995f6b tempest-ProjectReaderTests-22232040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-af8720ef-6df8-4b03-b439-911667aa09db" returned: 0 in 0.722s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:11 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-44ac1e90-f153-4f28-b194-c5c623995f6b tempest-ProjectReaderTests-22232040 None] Lock "cinder-quobyte-af8720ef-6df8-4b03-b439-911667aa09db" released by "delete_volume" :: held 1.742s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:11 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-44ac1e90-f153-4f28-b194-c5c623995f6b tempest-ProjectReaderTests-22232040 None] Created reservations ['933d2ed6-99a4-4167-a739-156796c7c8eb', 'd7e64df9-0b4a-4212-9370-b65df06f3d75', '3d61f947-9c6e-49fb-b5b1-7e29d57f53bb', 'afb02d04-685b-4b4c-8314-686628e81a54'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:57:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-44ac1e90-f153-4f28-b194-c5c623995f6b tempest-ProjectReaderTests-22232040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-44ac1e90-f153-4f28-b194-c5c623995f6b tempest-ProjectReaderTests-22232040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:12 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-44ac1e90-f153-4f28-b194-c5c623995f6b tempest-ProjectReaderTests-22232040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:57:12 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-44ac1e90-f153-4f28-b194-c5c623995f6b tempest-ProjectReaderTests-22232040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:57:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-44ac1e90-f153-4f28-b194-c5c623995f6b tempest-ProjectReaderTests-22232040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-44ac1e90-f153-4f28-b194-c5c623995f6b tempest-ProjectReaderTests-22232040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:12 devstack sudo[105385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:57:12 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:12 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cd76d7b0-28ea-4b4b-be38-78e21446d38a tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858.066cb218-95b5-4b7c-a54a-39910dffa7e9" returned: 0 in 0.869s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:12 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-cd76d7b0-28ea-4b4b-be38-78e21446d38a tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-066cb218-95b5-4b7c-a54a-39910dffa7e9" released by "_delete_snapshot" :: held 4.404s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:12 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-cd76d7b0-28ea-4b4b-be38-78e21446d38a tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-4db7ca25-3a23-403d-970b-35300a7b7858" released by "delete_snapshot" :: held 4.438s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:12 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-cd76d7b0-28ea-4b4b-be38-78e21446d38a tempest-ProjectMemberTests-73797185 None] Created reservations ['528fb845-25cd-44b2-8bb7-70ba177c5b51', '951ae16b-8950-4323-856c-ea3dfcccf2cc', '19059e29-4c45-480e-a0ed-113ab5109354', '94ac088c-8e5f-4aec-ad5d-bc817665a706'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:57:12 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-166e6d59-cbb7-4a69-94f8-852c5bcf2836 tempest-CinderUnicodeTest-746990990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-01fcde58-d255-4baa-966d-c523e746cbca 1073741824" returned: 0 in 1.178s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-166e6d59-cbb7-4a69-94f8-852c5bcf2836 tempest-CinderUnicodeTest-746990990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-01fcde58-d255-4baa-966d-c523e746cbca {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:12 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-cd76d7b0-28ea-4b4b-be38-78e21446d38a tempest-ProjectMemberTests-73797185 None] Delete snapshot completed successfully. Jul 08 01:57:12 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-cd76d7b0-28ea-4b4b-be38-78e21446d38a tempest-ProjectMemberTests-73797185 None] Lock "cinder-066cb218-95b5-4b7c-a54a-39910dffa7e9-delete_snapshot" released by "delete_snapshot" :: held 4.815s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:12 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-01fcde58-d255-4baa-966d-c523e746cbca Jul 08 01:57:12 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:12 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-44ac1e90-f153-4f28-b194-c5c623995f6b tempest-ProjectReaderTests-22232040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.932s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:12 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-44ac1e90-f153-4f28-b194-c5c623995f6b tempest-ProjectReaderTests-22232040 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:57:12 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-44ac1e90-f153-4f28-b194-c5c623995f6b tempest-ProjectReaderTests-22232040 None] Deleted volume successfully. Jul 08 01:57:12 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-44ac1e90-f153-4f28-b194-c5c623995f6b tempest-ProjectReaderTests-22232040 None] Lock "cinder-af8720ef-6df8-4b03-b439-911667aa09db-delete_volume" released by "delete_volume" :: held 2.962s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-955d93d7-c1c4-4b09-8582-26d2cbac89ab tempest-ProjectReaderTests-756482943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:13 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-5755fe47-956f-43ce-9665-0b88b6e1bf51 tempest-ProjectReaderTests-22232040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:57:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5755fe47-956f-43ce-9665-0b88b6e1bf51 tempest-ProjectReaderTests-22232040 None] Flow 'volume_create_manager' (0f4c00b1-dcb3-4a2d-81f5-02391535b902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:57:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5755fe47-956f-43ce-9665-0b88b6e1bf51 tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e62a5365-671f-4dd5-b54f-4772a3e4dac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5755fe47-956f-43ce-9665-0b88b6e1bf51 tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e62a5365-671f-4dd5-b54f-4772a3e4dac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1536613641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7be36527-ab34-453f-822f-37bd0b89ce1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7111ef9ce00343a993a9ff8b36a1ff80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:57:13Z,use_quota=True,user_id='1658f8ce7bdd4ab79bb222d1e0bd10d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5755fe47-956f-43ce-9665-0b88b6e1bf51 tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e0b784-1f22-4258-82df-6d146a53994a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5755fe47-956f-43ce-9665-0b88b6e1bf51 tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e0b784-1f22-4258-82df-6d146a53994a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5755fe47-956f-43ce-9665-0b88b6e1bf51 tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81abaf18-8b84-4cda-89ec-3271295a8a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5755fe47-956f-43ce-9665-0b88b6e1bf51 tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81abaf18-8b84-4cda-89ec-3271295a8a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7be36527-ab34-453f-822f-37bd0b89ce1f', 'volume_name': 'volume-7be36527-ab34-453f-822f-37bd0b89ce1f', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5755fe47-956f-43ce-9665-0b88b6e1bf51 tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b70250f-3bba-49eb-9e53-e22772489f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5755fe47-956f-43ce-9665-0b88b6e1bf51 tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b70250f-3bba-49eb-9e53-e22772489f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5755fe47-956f-43ce-9665-0b88b6e1bf51 tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b6c3111-d44a-4c7c-ad72-f8b1bf1bb4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:13 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-5755fe47-956f-43ce-9665-0b88b6e1bf51 tempest-ProjectReaderTests-22232040 None] Volume 7be36527-ab34-453f-822f-37bd0b89ce1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7be36527-ab34-453f-822f-37bd0b89ce1f', 'volume_size': 1} Jul 08 01:57:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5755fe47-956f-43ce-9665-0b88b6e1bf51 tempest-ProjectReaderTests-22232040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:13 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e5a4ed9e-af3d-422f-9970-61411e8d8be4 tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-4db7ca25-3a23-403d-970b-35300a7b7858-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:13 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e5a4ed9e-af3d-422f-9970-61411e8d8be4 tempest-ProjectMemberTests-73797185 None] Lock "cinder-4db7ca25-3a23-403d-970b-35300a7b7858-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:13 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e5a4ed9e-af3d-422f-9970-61411e8d8be4 tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-quobyte-4db7ca25-3a23-403d-970b-35300a7b7858" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:13 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e5a4ed9e-af3d-422f-9970-61411e8d8be4 tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-4db7ca25-3a23-403d-970b-35300a7b7858" acquired by "delete_volume" :: waited 0.021s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:13 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ab35f0-7e7a-4f1e-b262-9dffbfc7b07f]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e5a4ed9e-af3d-422f-9970-61411e8d8be4 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:13 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858 Jul 08 01:57:13 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:13 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-166e6d59-cbb7-4a69-94f8-852c5bcf2836 tempest-CinderUnicodeTest-746990990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-01fcde58-d255-4baa-966d-c523e746cbca" returned: 0 in 0.904s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:13 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-166e6d59-cbb7-4a69-94f8-852c5bcf2836 tempest-CinderUnicodeTest-746990990 None] <== create_volume: return (2152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:57:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-166e6d59-cbb7-4a69-94f8-852c5bcf2836 tempest-CinderUnicodeTest-746990990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.157s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-955d93d7-c1c4-4b09-8582-26d2cbac89ab tempest-ProjectReaderTests-756482943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.561s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-166e6d59-cbb7-4a69-94f8-852c5bcf2836 tempest-CinderUnicodeTest-746990990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc991578-8cb0-495c-ae4f-a81f3346a1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01fcde58-d255-4baa-966d-c523e746cbca', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-166e6d59-cbb7-4a69-94f8-852c5bcf2836 tempest-CinderUnicodeTest-746990990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bee42f4-097e-4948-bc16-31c9ca80ec21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:13 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-955d93d7-c1c4-4b09-8582-26d2cbac89ab tempest-ProjectReaderTests-756482943 None] Creating offline snapshot d81b86f7-0a7e-464a-b61c-31d622a1a742 of volume 15d24229-202e-4b49-92b6-aaf840a1e81c {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:57:13 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-166e6d59-cbb7-4a69-94f8-852c5bcf2836 tempest-CinderUnicodeTest-746990990 None] Volume volume-01fcde58-d255-4baa-966d-c523e746cbca (01fcde58-d255-4baa-966d-c523e746cbca): created successfully Jul 08 01:57:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-166e6d59-cbb7-4a69-94f8-852c5bcf2836 tempest-CinderUnicodeTest-746990990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bee42f4-097e-4948-bc16-31c9ca80ec21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:13 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-166e6d59-cbb7-4a69-94f8-852c5bcf2836 tempest-CinderUnicodeTest-746990990 None] Flow 'volume_create_manager' (bc06a91d-9465-416f-a5b6-943db43bfc27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:57:13 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba56cbc-b67b-435e-910a-b08118224bde]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-955d93d7-c1c4-4b09-8582-26d2cbac89ab tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:13 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-166e6d59-cbb7-4a69-94f8-852c5bcf2836 tempest-CinderUnicodeTest-746990990 None] Created volume successfully. Jul 08 01:57:13 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c Jul 08 01:57:13 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:14 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e5a4ed9e-af3d-422f-9970-61411e8d8be4 tempest-ProjectMemberTests-73797185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858" returned: 0 in 0.822s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e5a4ed9e-af3d-422f-9970-61411e8d8be4 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:14 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858 Jul 08 01:57:14 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:14 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-955d93d7-c1c4-4b09-8582-26d2cbac89ab tempest-ProjectReaderTests-756482943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c" returned: 0 in 0.864s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-955d93d7-c1c4-4b09-8582-26d2cbac89ab tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c.d81b86f7-0a7e-464a-b61c-31d622a1a742 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:14 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c.d81b86f7-0a7e-464a-b61c-31d622a1a742 1G Jul 08 01:57:14 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:15 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-25503997-924b-40c3-bcb8-21e0fe8c32ad tempest-CinderUnicodeTest-746990990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:57:15 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-25503997-924b-40c3-bcb8-21e0fe8c32ad tempest-CinderUnicodeTest-746990990 None] Flow 'volume_create_manager' (7d614a0f-3f6a-4324-89ea-1033b88acd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:57:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-25503997-924b-40c3-bcb8-21e0fe8c32ad tempest-CinderUnicodeTest-746990990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (341e4e69-1006-4d46-ac99-980c84763c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e5a4ed9e-af3d-422f-9970-61411e8d8be4 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-4db7ca25-3a23-403d-970b-35300a7b7858" returned: 0 in 0.844s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:15 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e5a4ed9e-af3d-422f-9970-61411e8d8be4 tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-4db7ca25-3a23-403d-970b-35300a7b7858" released by "delete_volume" :: held 1.737s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-25503997-924b-40c3-bcb8-21e0fe8c32ad tempest-CinderUnicodeTest-746990990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (341e4e69-1006-4d46-ac99-980c84763c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:57:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-551514103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeaa4979-de69-405f-8dc4-5ac0dd72a617,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cda4139e98cc43b5aa7db822b160d21a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:57:15Z,use_quota=True,user_id='302e0f40174b4d06ba31f1f6a4f390b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-25503997-924b-40c3-bcb8-21e0fe8c32ad tempest-CinderUnicodeTest-746990990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61af1492-fc17-426d-9be4-72a574293629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-25503997-924b-40c3-bcb8-21e0fe8c32ad tempest-CinderUnicodeTest-746990990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61af1492-fc17-426d-9be4-72a574293629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-25503997-924b-40c3-bcb8-21e0fe8c32ad tempest-CinderUnicodeTest-746990990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d050a73-e9db-49a0-885a-c0bf70ccb947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-25503997-924b-40c3-bcb8-21e0fe8c32ad tempest-CinderUnicodeTest-746990990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d050a73-e9db-49a0-885a-c0bf70ccb947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eeaa4979-de69-405f-8dc4-5ac0dd72a617', 'volume_name': 'volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-25503997-924b-40c3-bcb8-21e0fe8c32ad tempest-CinderUnicodeTest-746990990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81975a72-d0f3-48bd-b69f-dd2c36149449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-25503997-924b-40c3-bcb8-21e0fe8c32ad tempest-CinderUnicodeTest-746990990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81975a72-d0f3-48bd-b69f-dd2c36149449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-25503997-924b-40c3-bcb8-21e0fe8c32ad tempest-CinderUnicodeTest-746990990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7c544e8-5a2c-44df-bdf2-8bda80481244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:15 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-25503997-924b-40c3-bcb8-21e0fe8c32ad tempest-CinderUnicodeTest-746990990 None] Volume eeaa4979-de69-405f-8dc4-5ac0dd72a617: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617', 'volume_size': 1} Jul 08 01:57:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-25503997-924b-40c3-bcb8-21e0fe8c32ad tempest-CinderUnicodeTest-746990990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:15 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-e5a4ed9e-af3d-422f-9970-61411e8d8be4 tempest-ProjectMemberTests-73797185 None] Created reservations ['3cbcaa19-cc74-4156-99a5-3b36cb8b045c', 'de1b9131-3afd-498a-8f43-f71274e467b6', '123456da-a553-480b-adcb-3af733e331df', 'cbb39a20-fb4a-4c01-9609-b5b0e53f8edb'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:57:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e5a4ed9e-af3d-422f-9970-61411e8d8be4 tempest-ProjectMemberTests-73797185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e5a4ed9e-af3d-422f-9970-61411e8d8be4 tempest-ProjectMemberTests-73797185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:15 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e5a4ed9e-af3d-422f-9970-61411e8d8be4 tempest-ProjectMemberTests-73797185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:57:15 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-e5a4ed9e-af3d-422f-9970-61411e8d8be4 tempest-ProjectMemberTests-73797185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:57:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e5a4ed9e-af3d-422f-9970-61411e8d8be4 tempest-ProjectMemberTests-73797185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e5a4ed9e-af3d-422f-9970-61411e8d8be4 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:15 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:57:15 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:15 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-955d93d7-c1c4-4b09-8582-26d2cbac89ab tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c.d81b86f7-0a7e-464a-b61c-31d622a1a742 1G" returned: 0 in 1.042s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-955d93d7-c1c4-4b09-8582-26d2cbac89ab tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15d24229-202e-4b49-92b6-aaf840a1e81c -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c.d81b86f7-0a7e-464a-b61c-31d622a1a742 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:15 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15d24229-202e-4b49-92b6-aaf840a1e81c -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c.d81b86f7-0a7e-464a-b61c-31d622a1a742 Jul 08 01:57:15 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:16 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e5a4ed9e-af3d-422f-9970-61411e8d8be4 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.891s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:16 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-e5a4ed9e-af3d-422f-9970-61411e8d8be4 tempest-ProjectMemberTests-73797185 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:57:16 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-e5a4ed9e-af3d-422f-9970-61411e8d8be4 tempest-ProjectMemberTests-73797185 None] Deleted volume successfully. Jul 08 01:57:16 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-e5a4ed9e-af3d-422f-9970-61411e8d8be4 tempest-ProjectMemberTests-73797185 None] Lock "cinder-4db7ca25-3a23-403d-970b-35300a7b7858-delete_volume" released by "delete_volume" :: held 2.919s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:16 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-37113411-3dba-4139-bab7-029effb9b9c1 tempest-ProjectMemberTests-73797185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:57:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-37113411-3dba-4139-bab7-029effb9b9c1 tempest-ProjectMemberTests-73797185 None] Flow 'volume_create_manager' (eb6c7827-0f4a-44ac-b599-b688dbe8113a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:57:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-37113411-3dba-4139-bab7-029effb9b9c1 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (418146dd-a279-44eb-8a5a-d8f835f62953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-37113411-3dba-4139-bab7-029effb9b9c1 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (418146dd-a279-44eb-8a5a-d8f835f62953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1260137372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=451259f3-0a92-4910-963a-e62e93b3a261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410ede866c9145df8444c3a398ace8b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:57:16Z,use_quota=True,user_id='5f5ae65b4a584ede952a5bfc00c9a49d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-37113411-3dba-4139-bab7-029effb9b9c1 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2881f7f9-38c8-4ec6-bd45-0ce3d94af84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-37113411-3dba-4139-bab7-029effb9b9c1 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2881f7f9-38c8-4ec6-bd45-0ce3d94af84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-37113411-3dba-4139-bab7-029effb9b9c1 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f323d908-3755-4150-897e-1d4f412f6958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-37113411-3dba-4139-bab7-029effb9b9c1 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f323d908-3755-4150-897e-1d4f412f6958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '451259f3-0a92-4910-963a-e62e93b3a261', 'volume_name': 'volume-451259f3-0a92-4910-963a-e62e93b3a261', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-37113411-3dba-4139-bab7-029effb9b9c1 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d62f0eb-6d51-4bdd-8e9d-fd7c35bf9c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-37113411-3dba-4139-bab7-029effb9b9c1 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d62f0eb-6d51-4bdd-8e9d-fd7c35bf9c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:16 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-37113411-3dba-4139-bab7-029effb9b9c1 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (254247a8-7243-4a18-a6f9-acfe6028bc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:16 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-37113411-3dba-4139-bab7-029effb9b9c1 tempest-ProjectMemberTests-73797185 None] Volume 451259f3-0a92-4910-963a-e62e93b3a261: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-451259f3-0a92-4910-963a-e62e93b3a261', 'volume_size': 1} Jul 08 01:57:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-37113411-3dba-4139-bab7-029effb9b9c1 tempest-ProjectMemberTests-73797185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:16 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-955d93d7-c1c4-4b09-8582-26d2cbac89ab tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15d24229-202e-4b49-92b6-aaf840a1e81c -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c.d81b86f7-0a7e-464a-b61c-31d622a1a742" returned: 0 in 0.940s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:16 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-955d93d7-c1c4-4b09-8582-26d2cbac89ab tempest-ProjectReaderTests-756482943 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c.d81b86f7-0a7e-464a-b61c-31d622a1a742 is being set with open permissions: ugo+rw Jul 08 01:57:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-955d93d7-c1c4-4b09-8582-26d2cbac89ab tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c.d81b86f7-0a7e-464a-b61c-31d622a1a742 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:16 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c.d81b86f7-0a7e-464a-b61c-31d622a1a742 Jul 08 01:57:16 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:17 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-955d93d7-c1c4-4b09-8582-26d2cbac89ab tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c.d81b86f7-0a7e-464a-b61c-31d622a1a742" returned: 0 in 0.700s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-955d93d7-c1c4-4b09-8582-26d2cbac89ab tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:17 devstack sudo[105426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c.info Jul 08 01:57:17 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:17 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-955d93d7-c1c4-4b09-8582-26d2cbac89ab tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c.info" returned: 0 in 0.663s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:17 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-955d93d7-c1c4-4b09-8582-26d2cbac89ab tempest-ProjectReaderTests-756482943 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c.info is being set with open permissions: ugo+rw Jul 08 01:57:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-955d93d7-c1c4-4b09-8582-26d2cbac89ab tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:18 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c.info Jul 08 01:57:18 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:18 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-955d93d7-c1c4-4b09-8582-26d2cbac89ab tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c.info" returned: 0 in 0.684s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-955d93d7-c1c4-4b09-8582-26d2cbac89ab tempest-ProjectReaderTests-756482943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.018s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5755fe47-956f-43ce-9665-0b88b6e1bf51 tempest-ProjectReaderTests-22232040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.432s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:18 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5755fe47-956f-43ce-9665-0b88b6e1bf51 tempest-ProjectReaderTests-22232040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1536613641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7be36527-ab34-453f-822f-37bd0b89ce1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7111ef9ce00343a993a9ff8b36a1ff80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:57:13Z,use_quota=True,user_id='1658f8ce7bdd4ab79bb222d1e0bd10d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:57:18 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-5755fe47-956f-43ce-9665-0b88b6e1bf51 tempest-ProjectReaderTests-22232040 None] Creating volume 7be36527-ab34-453f-822f-37bd0b89ce1f {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:57:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5755fe47-956f-43ce-9665-0b88b6e1bf51 tempest-ProjectReaderTests-22232040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5755fe47-956f-43ce-9665-0b88b6e1bf51 tempest-ProjectReaderTests-22232040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:18 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5755fe47-956f-43ce-9665-0b88b6e1bf51 tempest-ProjectReaderTests-22232040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:57:18 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5755fe47-956f-43ce-9665-0b88b6e1bf51 tempest-ProjectReaderTests-22232040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:57:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5755fe47-956f-43ce-9665-0b88b6e1bf51 tempest-ProjectReaderTests-22232040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:18 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5755fe47-956f-43ce-9665-0b88b6e1bf51 tempest-ProjectReaderTests-22232040 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:57:18 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-5755fe47-956f-43ce-9665-0b88b6e1bf51 tempest-ProjectReaderTests-22232040 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:57:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5755fe47-956f-43ce-9665-0b88b6e1bf51 tempest-ProjectReaderTests-22232040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7be36527-ab34-453f-822f-37bd0b89ce1f 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:18 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7be36527-ab34-453f-822f-37bd0b89ce1f 1073741824 Jul 08 01:57:18 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:18 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-955d93d7-c1c4-4b09-8582-26d2cbac89ab tempest-ProjectReaderTests-756482943 None] Create snapshot completed successfully Jul 08 01:57:19 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6a4cce0b-8b76-4c51-998a-ee83e4b0b3af tempest-ProjectReaderTests-756482943 None] Acquiring lock "cinder-d81b86f7-0a7e-464a-b61c-31d622a1a742-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:19 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6a4cce0b-8b76-4c51-998a-ee83e4b0b3af tempest-ProjectReaderTests-756482943 None] Lock "cinder-d81b86f7-0a7e-464a-b61c-31d622a1a742-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:19 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6a4cce0b-8b76-4c51-998a-ee83e4b0b3af tempest-ProjectReaderTests-756482943 None] Acquiring lock "cinder-quobyte-15d24229-202e-4b49-92b6-aaf840a1e81c" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:19 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6a4cce0b-8b76-4c51-998a-ee83e4b0b3af tempest-ProjectReaderTests-756482943 None] Lock "cinder-quobyte-15d24229-202e-4b49-92b6-aaf840a1e81c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:19 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6a4cce0b-8b76-4c51-998a-ee83e4b0b3af tempest-ProjectReaderTests-756482943 None] Acquiring lock "cinder-quobyte-d81b86f7-0a7e-464a-b61c-31d622a1a742" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:19 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6a4cce0b-8b76-4c51-998a-ee83e4b0b3af tempest-ProjectReaderTests-756482943 None] Lock "cinder-quobyte-d81b86f7-0a7e-464a-b61c-31d622a1a742" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:19 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-6a4cce0b-8b76-4c51-998a-ee83e4b0b3af tempest-ProjectReaderTests-756482943 None] Deleting offline snapshot d81b86f7-0a7e-464a-b61c-31d622a1a742 of volume 15d24229-202e-4b49-92b6-aaf840a1e81c {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:57:19 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-6a4cce0b-8b76-4c51-998a-ee83e4b0b3af tempest-ProjectReaderTests-756482943 None] snapshot_file for this snap is: volume-15d24229-202e-4b49-92b6-aaf840a1e81c.d81b86f7-0a7e-464a-b61c-31d622a1a742 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:57:19 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15e7af1-9140-416c-8f56-729cd99b746a]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6a4cce0b-8b76-4c51-998a-ee83e4b0b3af tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c.d81b86f7-0a7e-464a-b61c-31d622a1a742 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:19 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c.d81b86f7-0a7e-464a-b61c-31d622a1a742 Jul 08 01:57:19 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:19 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5755fe47-956f-43ce-9665-0b88b6e1bf51 tempest-ProjectReaderTests-22232040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7be36527-ab34-453f-822f-37bd0b89ce1f 1073741824" returned: 0 in 0.966s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5755fe47-956f-43ce-9665-0b88b6e1bf51 tempest-ProjectReaderTests-22232040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7be36527-ab34-453f-822f-37bd0b89ce1f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:19 devstack sudo[105439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7be36527-ab34-453f-822f-37bd0b89ce1f Jul 08 01:57:19 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:20 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6a4cce0b-8b76-4c51-998a-ee83e4b0b3af tempest-ProjectReaderTests-756482943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c.d81b86f7-0a7e-464a-b61c-31d622a1a742" returned: 0 in 0.817s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:20 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-6a4cce0b-8b76-4c51-998a-ee83e4b0b3af tempest-ProjectReaderTests-756482943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15d24229-202e-4b49-92b6-aaf840a1e81c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:57:20 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[52741a22-745f-4b61-9569-bae7ef57ae51]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6a4cce0b-8b76-4c51-998a-ee83e4b0b3af tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:20 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c Jul 08 01:57:20 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:20 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5755fe47-956f-43ce-9665-0b88b6e1bf51 tempest-ProjectReaderTests-22232040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7be36527-ab34-453f-822f-37bd0b89ce1f" returned: 0 in 0.712s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:20 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5755fe47-956f-43ce-9665-0b88b6e1bf51 tempest-ProjectReaderTests-22232040 None] <== create_volume: return (1722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:57:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5755fe47-956f-43ce-9665-0b88b6e1bf51 tempest-ProjectReaderTests-22232040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.726s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-25503997-924b-40c3-bcb8-21e0fe8c32ad tempest-CinderUnicodeTest-746990990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.163s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:20 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-25503997-924b-40c3-bcb8-21e0fe8c32ad tempest-CinderUnicodeTest-746990990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:57:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-551514103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeaa4979-de69-405f-8dc4-5ac0dd72a617,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cda4139e98cc43b5aa7db822b160d21a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:57:15Z,use_quota=True,user_id='302e0f40174b4d06ba31f1f6a4f390b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:57:20 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-25503997-924b-40c3-bcb8-21e0fe8c32ad tempest-CinderUnicodeTest-746990990 None] Creating volume eeaa4979-de69-405f-8dc4-5ac0dd72a617 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:57:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-25503997-924b-40c3-bcb8-21e0fe8c32ad tempest-CinderUnicodeTest-746990990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-25503997-924b-40c3-bcb8-21e0fe8c32ad tempest-CinderUnicodeTest-746990990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:20 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-25503997-924b-40c3-bcb8-21e0fe8c32ad tempest-CinderUnicodeTest-746990990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:57:20 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-25503997-924b-40c3-bcb8-21e0fe8c32ad tempest-CinderUnicodeTest-746990990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:57:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-25503997-924b-40c3-bcb8-21e0fe8c32ad tempest-CinderUnicodeTest-746990990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:20 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-25503997-924b-40c3-bcb8-21e0fe8c32ad tempest-CinderUnicodeTest-746990990 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:57:20 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-25503997-924b-40c3-bcb8-21e0fe8c32ad tempest-CinderUnicodeTest-746990990 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:57:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-25503997-924b-40c3-bcb8-21e0fe8c32ad tempest-CinderUnicodeTest-746990990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:20 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617 1073741824 Jul 08 01:57:20 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5755fe47-956f-43ce-9665-0b88b6e1bf51 tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b6c3111-d44a-4c7c-ad72-f8b1bf1bb4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7be36527-ab34-453f-822f-37bd0b89ce1f', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:20 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:20 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5755fe47-956f-43ce-9665-0b88b6e1bf51 tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a466f3b2-1bfb-40c5-94ff-be696b5d016d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:20 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:UPDATE=200,cinder:SELECT=136,cinder:INSERT=51,cinder:DELETE=21 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:57:20 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-5755fe47-956f-43ce-9665-0b88b6e1bf51 tempest-ProjectReaderTests-22232040 None] Volume volume-7be36527-ab34-453f-822f-37bd0b89ce1f (7be36527-ab34-453f-822f-37bd0b89ce1f): created successfully Jul 08 01:57:20 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5755fe47-956f-43ce-9665-0b88b6e1bf51 tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a466f3b2-1bfb-40c5-94ff-be696b5d016d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:20 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-5755fe47-956f-43ce-9665-0b88b6e1bf51 tempest-ProjectReaderTests-22232040 None] Flow 'volume_create_manager' (0f4c00b1-dcb3-4a2d-81f5-02391535b902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:57:20 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-5755fe47-956f-43ce-9665-0b88b6e1bf51 tempest-ProjectReaderTests-22232040 None] Created volume successfully. Jul 08 01:57:21 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6a4cce0b-8b76-4c51-998a-ee83e4b0b3af tempest-ProjectReaderTests-756482943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c" returned: 0 in 0.863s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6a4cce0b-8b76-4c51-998a-ee83e4b0b3af tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c.d81b86f7-0a7e-464a-b61c-31d622a1a742 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:21 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c.d81b86f7-0a7e-464a-b61c-31d622a1a742 Jul 08 01:57:21 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:21 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-25503997-924b-40c3-bcb8-21e0fe8c32ad tempest-CinderUnicodeTest-746990990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617 1073741824" returned: 0 in 0.941s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-25503997-924b-40c3-bcb8-21e0fe8c32ad tempest-CinderUnicodeTest-746990990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:21 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617 Jul 08 01:57:21 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:21 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6fa3a908-9804-431c-8a83-b48c22a90bf1 tempest-ProjectReaderTests-22232040 None] Acquiring lock "cinder-7be36527-ab34-453f-822f-37bd0b89ce1f-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:21 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6fa3a908-9804-431c-8a83-b48c22a90bf1 tempest-ProjectReaderTests-22232040 None] Lock "cinder-7be36527-ab34-453f-822f-37bd0b89ce1f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:21 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6fa3a908-9804-431c-8a83-b48c22a90bf1 tempest-ProjectReaderTests-22232040 None] Acquiring lock "cinder-quobyte-7be36527-ab34-453f-822f-37bd0b89ce1f" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:21 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6fa3a908-9804-431c-8a83-b48c22a90bf1 tempest-ProjectReaderTests-22232040 None] Lock "cinder-quobyte-7be36527-ab34-453f-822f-37bd0b89ce1f" acquired by "delete_volume" :: waited 0.015s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:21 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c63c042-9a83-4c6a-acb8-398bb35ae63f]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6fa3a908-9804-431c-8a83-b48c22a90bf1 tempest-ProjectReaderTests-22232040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7be36527-ab34-453f-822f-37bd0b89ce1f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:22 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6a4cce0b-8b76-4c51-998a-ee83e4b0b3af tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c.d81b86f7-0a7e-464a-b61c-31d622a1a742" returned: 0 in 0.912s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6a4cce0b-8b76-4c51-998a-ee83e4b0b3af tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c.d81b86f7-0a7e-464a-b61c-31d622a1a742 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:22 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c.d81b86f7-0a7e-464a-b61c-31d622a1a742 Jul 08 01:57:22 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:22 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7be36527-ab34-453f-822f-37bd0b89ce1f Jul 08 01:57:22 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:22 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-25503997-924b-40c3-bcb8-21e0fe8c32ad tempest-CinderUnicodeTest-746990990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617" returned: 0 in 0.766s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:22 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-25503997-924b-40c3-bcb8-21e0fe8c32ad tempest-CinderUnicodeTest-746990990 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:57:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-25503997-924b-40c3-bcb8-21e0fe8c32ad tempest-CinderUnicodeTest-746990990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.772s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-37113411-3dba-4139-bab7-029effb9b9c1 tempest-ProjectMemberTests-73797185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.698s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:22 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-37113411-3dba-4139-bab7-029effb9b9c1 tempest-ProjectMemberTests-73797185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1260137372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=451259f3-0a92-4910-963a-e62e93b3a261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410ede866c9145df8444c3a398ace8b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:57:16Z,use_quota=True,user_id='5f5ae65b4a584ede952a5bfc00c9a49d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:57:22 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-37113411-3dba-4139-bab7-029effb9b9c1 tempest-ProjectMemberTests-73797185 None] Creating volume 451259f3-0a92-4910-963a-e62e93b3a261 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:57:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-37113411-3dba-4139-bab7-029effb9b9c1 tempest-ProjectMemberTests-73797185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-37113411-3dba-4139-bab7-029effb9b9c1 tempest-ProjectMemberTests-73797185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:22 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-37113411-3dba-4139-bab7-029effb9b9c1 tempest-ProjectMemberTests-73797185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:57:22 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-37113411-3dba-4139-bab7-029effb9b9c1 tempest-ProjectMemberTests-73797185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:57:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-37113411-3dba-4139-bab7-029effb9b9c1 tempest-ProjectMemberTests-73797185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:22 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-37113411-3dba-4139-bab7-029effb9b9c1 tempest-ProjectMemberTests-73797185 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:57:22 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-37113411-3dba-4139-bab7-029effb9b9c1 tempest-ProjectMemberTests-73797185 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:57:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-37113411-3dba-4139-bab7-029effb9b9c1 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:22 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261 1073741824 Jul 08 01:57:22 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-25503997-924b-40c3-bcb8-21e0fe8c32ad tempest-CinderUnicodeTest-746990990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7c544e8-5a2c-44df-bdf2-8bda80481244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-25503997-924b-40c3-bcb8-21e0fe8c32ad tempest-CinderUnicodeTest-746990990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2979f670-e49a-424d-a200-6cd45c15cef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:22 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:DELETE=16,cinder:SELECT=167,cinder:UPDATE=228,cinder:INSERT=54 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:57:22 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-25503997-924b-40c3-bcb8-21e0fe8c32ad tempest-CinderUnicodeTest-746990990 None] Volume volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617 (eeaa4979-de69-405f-8dc4-5ac0dd72a617): created successfully Jul 08 01:57:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-25503997-924b-40c3-bcb8-21e0fe8c32ad tempest-CinderUnicodeTest-746990990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2979f670-e49a-424d-a200-6cd45c15cef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:22 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-25503997-924b-40c3-bcb8-21e0fe8c32ad tempest-CinderUnicodeTest-746990990 None] Flow 'volume_create_manager' (7d614a0f-3f6a-4324-89ea-1033b88acd03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:57:22 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-25503997-924b-40c3-bcb8-21e0fe8c32ad tempest-CinderUnicodeTest-746990990 None] Created volume successfully. Jul 08 01:57:22 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6a4cce0b-8b76-4c51-998a-ee83e4b0b3af tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c.d81b86f7-0a7e-464a-b61c-31d622a1a742" returned: 0 in 0.887s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:22 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6a4cce0b-8b76-4c51-998a-ee83e4b0b3af tempest-ProjectReaderTests-756482943 None] Lock "cinder-quobyte-d81b86f7-0a7e-464a-b61c-31d622a1a742" released by "_delete_snapshot" :: held 3.596s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:22 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:22 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6a4cce0b-8b76-4c51-998a-ee83e4b0b3af tempest-ProjectReaderTests-756482943 None] Lock "cinder-quobyte-15d24229-202e-4b49-92b6-aaf840a1e81c" released by "delete_snapshot" :: held 3.637s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6fa3a908-9804-431c-8a83-b48c22a90bf1 tempest-ProjectReaderTests-22232040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7be36527-ab34-453f-822f-37bd0b89ce1f" returned: 0 in 1.046s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6fa3a908-9804-431c-8a83-b48c22a90bf1 tempest-ProjectReaderTests-22232040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7be36527-ab34-453f-822f-37bd0b89ce1f {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-172d6776-0ed3-4c0c-ae12-d0d200926cb5 tempest-CinderUnicodeTest-746990990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:23 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7be36527-ab34-453f-822f-37bd0b89ce1f Jul 08 01:57:23 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:23 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-6a4cce0b-8b76-4c51-998a-ee83e4b0b3af tempest-ProjectReaderTests-756482943 None] Created reservations ['8a513c44-531d-4d54-b562-af34b64664b7', '0f19c304-fe0f-427c-916a-6485614f6a2a', '07a1d152-1315-4258-bdf7-83bd2aa847fb', 'a5963ba1-24b7-487f-a1f4-5404eaf83313'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:57:23 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-6a4cce0b-8b76-4c51-998a-ee83e4b0b3af tempest-ProjectReaderTests-756482943 None] Delete snapshot completed successfully. Jul 08 01:57:23 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6a4cce0b-8b76-4c51-998a-ee83e4b0b3af tempest-ProjectReaderTests-756482943 None] Lock "cinder-d81b86f7-0a7e-464a-b61c-31d622a1a742-delete_snapshot" released by "delete_snapshot" :: held 3.855s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:23 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-37113411-3dba-4139-bab7-029effb9b9c1 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261 1073741824" returned: 0 in 1.119s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-37113411-3dba-4139-bab7-029effb9b9c1 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:23 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261 Jul 08 01:57:23 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:23 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ef0c78dc-5219-45ba-a533-e08979b5c00c tempest-ProjectReaderTests-756482943 None] Acquiring lock "cinder-15d24229-202e-4b49-92b6-aaf840a1e81c-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:23 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ef0c78dc-5219-45ba-a533-e08979b5c00c tempest-ProjectReaderTests-756482943 None] Lock "cinder-15d24229-202e-4b49-92b6-aaf840a1e81c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:23 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ef0c78dc-5219-45ba-a533-e08979b5c00c tempest-ProjectReaderTests-756482943 None] Acquiring lock "cinder-quobyte-15d24229-202e-4b49-92b6-aaf840a1e81c" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:23 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ef0c78dc-5219-45ba-a533-e08979b5c00c tempest-ProjectReaderTests-756482943 None] Lock "cinder-quobyte-15d24229-202e-4b49-92b6-aaf840a1e81c" acquired by "delete_volume" :: waited 0.025s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:23 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8de3f4-cf0a-4cf5-bf62-69de915245c5]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ef0c78dc-5219-45ba-a533-e08979b5c00c tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:23 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6fa3a908-9804-431c-8a83-b48c22a90bf1 tempest-ProjectReaderTests-22232040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-7be36527-ab34-453f-822f-37bd0b89ce1f" returned: 0 in 0.852s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:23 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c Jul 08 01:57:23 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:23 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6fa3a908-9804-431c-8a83-b48c22a90bf1 tempest-ProjectReaderTests-22232040 None] Lock "cinder-quobyte-7be36527-ab34-453f-822f-37bd0b89ce1f" released by "delete_volume" :: held 1.937s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:23 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-6fa3a908-9804-431c-8a83-b48c22a90bf1 tempest-ProjectReaderTests-22232040 None] Created reservations ['42d5a64e-1b13-4716-adaa-6a945418e8a9', '9713f3cf-1b2a-47a0-95de-6ea81315df3f', '8efe8ec2-8e5a-4116-b0f6-015a2206fde9', 'e34fe2fe-b402-47e1-8ee5-81a41e69788c'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:57:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6fa3a908-9804-431c-8a83-b48c22a90bf1 tempest-ProjectReaderTests-22232040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6fa3a908-9804-431c-8a83-b48c22a90bf1 tempest-ProjectReaderTests-22232040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:23 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-6fa3a908-9804-431c-8a83-b48c22a90bf1 tempest-ProjectReaderTests-22232040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:57:23 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-6fa3a908-9804-431c-8a83-b48c22a90bf1 tempest-ProjectReaderTests-22232040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:57:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6fa3a908-9804-431c-8a83-b48c22a90bf1 tempest-ProjectReaderTests-22232040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6fa3a908-9804-431c-8a83-b48c22a90bf1 tempest-ProjectReaderTests-22232040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:24 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:57:24 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:24 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-37113411-3dba-4139-bab7-029effb9b9c1 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261" returned: 0 in 0.777s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:24 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-37113411-3dba-4139-bab7-029effb9b9c1 tempest-ProjectMemberTests-73797185 None] <== create_volume: return (1940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:57:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-37113411-3dba-4139-bab7-029effb9b9c1 tempest-ProjectMemberTests-73797185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.943s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-172d6776-0ed3-4c0c-ae12-d0d200926cb5 tempest-CinderUnicodeTest-746990990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.140s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:24 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-172d6776-0ed3-4c0c-ae12-d0d200926cb5 tempest-CinderUnicodeTest-746990990 None] Creating offline snapshot 1dc8dfb1-c595-47f0-97cf-e37bfd139bf4 of volume eeaa4979-de69-405f-8dc4-5ac0dd72a617 {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:57:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-37113411-3dba-4139-bab7-029effb9b9c1 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (254247a8-7243-4a18-a6f9-acfe6028bc81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-451259f3-0a92-4910-963a-e62e93b3a261', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-37113411-3dba-4139-bab7-029effb9b9c1 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9caa5599-3dfa-428d-a101-276d037c2556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:24 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[6921d16f-b347-48b6-a8f1-03bec8b27b7f]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-172d6776-0ed3-4c0c-ae12-d0d200926cb5 tempest-CinderUnicodeTest-746990990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:24 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-37113411-3dba-4139-bab7-029effb9b9c1 tempest-ProjectMemberTests-73797185 None] Volume volume-451259f3-0a92-4910-963a-e62e93b3a261 (451259f3-0a92-4910-963a-e62e93b3a261): created successfully Jul 08 01:57:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-37113411-3dba-4139-bab7-029effb9b9c1 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9caa5599-3dfa-428d-a101-276d037c2556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-37113411-3dba-4139-bab7-029effb9b9c1 tempest-ProjectMemberTests-73797185 None] Flow 'volume_create_manager' (eb6c7827-0f4a-44ac-b599-b688dbe8113a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:57:24 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-37113411-3dba-4139-bab7-029effb9b9c1 tempest-ProjectMemberTests-73797185 None] Created volume successfully. Jul 08 01:57:24 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617 Jul 08 01:57:24 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:24 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-7651794e-19d4-44f5-ab1e-2bfdca855adb tempest-ProjectReaderTests-22232040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:57:24 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7651794e-19d4-44f5-ab1e-2bfdca855adb tempest-ProjectReaderTests-22232040 None] Flow 'volume_create_manager' (17e68624-8ebf-4d1d-9fd2-495dc618915c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:57:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7651794e-19d4-44f5-ab1e-2bfdca855adb tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa9dee75-86fb-454b-abed-44c1ec74ba26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ef0c78dc-5219-45ba-a533-e08979b5c00c tempest-ProjectReaderTests-756482943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c" returned: 0 in 1.038s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ef0c78dc-5219-45ba-a533-e08979b5c00c tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7651794e-19d4-44f5-ab1e-2bfdca855adb tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa9dee75-86fb-454b-abed-44c1ec74ba26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1310037765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9712962-5551-49b7-b7b8-fb7da4a8f91e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7111ef9ce00343a993a9ff8b36a1ff80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:57:25Z,use_quota=True,user_id='1658f8ce7bdd4ab79bb222d1e0bd10d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7651794e-19d4-44f5-ab1e-2bfdca855adb tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e563547-4543-40d1-b6d4-c1737e68c1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:24 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c Jul 08 01:57:24 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7651794e-19d4-44f5-ab1e-2bfdca855adb tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e563547-4543-40d1-b6d4-c1737e68c1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7651794e-19d4-44f5-ab1e-2bfdca855adb tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7517e4a-88ab-4462-ae76-36eb2c09bbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7651794e-19d4-44f5-ab1e-2bfdca855adb tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7517e4a-88ab-4462-ae76-36eb2c09bbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9712962-5551-49b7-b7b8-fb7da4a8f91e', 'volume_name': 'volume-d9712962-5551-49b7-b7b8-fb7da4a8f91e', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7651794e-19d4-44f5-ab1e-2bfdca855adb tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db50226-376d-4e63-9dcf-478488611416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7651794e-19d4-44f5-ab1e-2bfdca855adb tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db50226-376d-4e63-9dcf-478488611416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:24 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7651794e-19d4-44f5-ab1e-2bfdca855adb tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db71d1fa-527c-46ef-bad7-16919748a512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:24 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-7651794e-19d4-44f5-ab1e-2bfdca855adb tempest-ProjectReaderTests-22232040 None] Volume d9712962-5551-49b7-b7b8-fb7da4a8f91e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9712962-5551-49b7-b7b8-fb7da4a8f91e', 'volume_size': 1} Jul 08 01:57:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-7651794e-19d4-44f5-ab1e-2bfdca855adb tempest-ProjectReaderTests-22232040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:25 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6fa3a908-9804-431c-8a83-b48c22a90bf1 tempest-ProjectReaderTests-22232040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.029s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:25 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-6fa3a908-9804-431c-8a83-b48c22a90bf1 tempest-ProjectReaderTests-22232040 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:57:25 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-6fa3a908-9804-431c-8a83-b48c22a90bf1 tempest-ProjectReaderTests-22232040 None] Deleted volume successfully. Jul 08 01:57:25 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6fa3a908-9804-431c-8a83-b48c22a90bf1 tempest-ProjectReaderTests-22232040 None] Lock "cinder-7be36527-ab34-453f-822f-37bd0b89ce1f-delete_volume" released by "delete_volume" :: held 3.240s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:25 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-172d6776-0ed3-4c0c-ae12-d0d200926cb5 tempest-CinderUnicodeTest-746990990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617" returned: 0 in 1.069s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-172d6776-0ed3-4c0c-ae12-d0d200926cb5 tempest-CinderUnicodeTest-746990990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617.1dc8dfb1-c595-47f0-97cf-e37bfd139bf4 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:25 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617.1dc8dfb1-c595-47f0-97cf-e37bfd139bf4 1G Jul 08 01:57:25 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-9ea730fc-cee8-4192-b39d-5fa23c0dee19 tempest-ProjectMemberTests-73797185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:25 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ef0c78dc-5219-45ba-a533-e08979b5c00c tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-15d24229-202e-4b49-92b6-aaf840a1e81c" returned: 0 in 0.873s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:25 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ef0c78dc-5219-45ba-a533-e08979b5c00c tempest-ProjectReaderTests-756482943 None] Lock "cinder-quobyte-15d24229-202e-4b49-92b6-aaf840a1e81c" released by "delete_volume" :: held 1.972s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:25 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-ef0c78dc-5219-45ba-a533-e08979b5c00c tempest-ProjectReaderTests-756482943 None] Created reservations ['0c874a7c-58dc-41e3-8418-bb182bcf5ea6', '076af698-4c7c-42f7-a2db-e15c12271d14', '94598047-8e2c-45de-9cf1-1fe36fd4565d', '8c688d5f-c4d0-4887-9451-d7d2ba1804e2'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:57:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ef0c78dc-5219-45ba-a533-e08979b5c00c tempest-ProjectReaderTests-756482943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ef0c78dc-5219-45ba-a533-e08979b5c00c tempest-ProjectReaderTests-756482943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:25 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-ef0c78dc-5219-45ba-a533-e08979b5c00c tempest-ProjectReaderTests-756482943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:57:25 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-ef0c78dc-5219-45ba-a533-e08979b5c00c tempest-ProjectReaderTests-756482943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:57:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ef0c78dc-5219-45ba-a533-e08979b5c00c tempest-ProjectReaderTests-756482943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ef0c78dc-5219-45ba-a533-e08979b5c00c tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:25 devstack sudo[105502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:57:25 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:26 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-172d6776-0ed3-4c0c-ae12-d0d200926cb5 tempest-CinderUnicodeTest-746990990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617.1dc8dfb1-c595-47f0-97cf-e37bfd139bf4 1G" returned: 0 in 0.946s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-172d6776-0ed3-4c0c-ae12-d0d200926cb5 tempest-CinderUnicodeTest-746990990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617.1dc8dfb1-c595-47f0-97cf-e37bfd139bf4 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:26 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617.1dc8dfb1-c595-47f0-97cf-e37bfd139bf4 Jul 08 01:57:26 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:26 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-78894b24-abd8-4369-b671-522907183a07 tempest-ProjectReaderTests-756482943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:57:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-78894b24-abd8-4369-b671-522907183a07 tempest-ProjectReaderTests-756482943 None] Flow 'volume_create_manager' (5da547a0-12a7-4ea6-9a45-12f58bf3d632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:57:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-78894b24-abd8-4369-b671-522907183a07 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a130e800-dabb-4064-8329-08eb3daa9dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:26 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-78894b24-abd8-4369-b671-522907183a07 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a130e800-dabb-4064-8329-08eb3daa9dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2116012067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68031424-16de-4d72-af05-157f3f9e416b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cedff66a12b04885a54b318907f70246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:57:26Z,use_quota=True,user_id='42422d5e57294adbb2ba38426c0322eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-78894b24-abd8-4369-b671-522907183a07 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11c39970-dbf4-4943-a09f-ecc497dc172b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-78894b24-abd8-4369-b671-522907183a07 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11c39970-dbf4-4943-a09f-ecc497dc172b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-78894b24-abd8-4369-b671-522907183a07 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79c4e64c-e4a7-44d2-b9c9-6836977a1b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-78894b24-abd8-4369-b671-522907183a07 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79c4e64c-e4a7-44d2-b9c9-6836977a1b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68031424-16de-4d72-af05-157f3f9e416b', 'volume_name': 'volume-68031424-16de-4d72-af05-157f3f9e416b', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-78894b24-abd8-4369-b671-522907183a07 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1273b9a2-f0be-414f-81e0-cff3c52ced6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-78894b24-abd8-4369-b671-522907183a07 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1273b9a2-f0be-414f-81e0-cff3c52ced6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:26 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-78894b24-abd8-4369-b671-522907183a07 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b669bcc4-d130-4d6e-9b3e-0bd1b98b9ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:26 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-78894b24-abd8-4369-b671-522907183a07 tempest-ProjectReaderTests-756482943 None] Volume 68031424-16de-4d72-af05-157f3f9e416b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68031424-16de-4d72-af05-157f3f9e416b', 'volume_size': 1} Jul 08 01:57:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-78894b24-abd8-4369-b671-522907183a07 tempest-ProjectReaderTests-756482943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ef0c78dc-5219-45ba-a533-e08979b5c00c tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.814s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:26 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-ef0c78dc-5219-45ba-a533-e08979b5c00c tempest-ProjectReaderTests-756482943 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:57:26 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-ef0c78dc-5219-45ba-a533-e08979b5c00c tempest-ProjectReaderTests-756482943 None] Deleted volume successfully. Jul 08 01:57:26 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-ef0c78dc-5219-45ba-a533-e08979b5c00c tempest-ProjectReaderTests-756482943 None] Lock "cinder-15d24229-202e-4b49-92b6-aaf840a1e81c-delete_volume" released by "delete_volume" :: held 3.034s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:27 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-172d6776-0ed3-4c0c-ae12-d0d200926cb5 tempest-CinderUnicodeTest-746990990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617.1dc8dfb1-c595-47f0-97cf-e37bfd139bf4" returned: 0 in 0.810s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:27 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-172d6776-0ed3-4c0c-ae12-d0d200926cb5 tempest-CinderUnicodeTest-746990990 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617.1dc8dfb1-c595-47f0-97cf-e37bfd139bf4 is being set with open permissions: ugo+rw Jul 08 01:57:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-172d6776-0ed3-4c0c-ae12-d0d200926cb5 tempest-CinderUnicodeTest-746990990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617.1dc8dfb1-c595-47f0-97cf-e37bfd139bf4 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:27 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617.1dc8dfb1-c595-47f0-97cf-e37bfd139bf4 Jul 08 01:57:27 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:27 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-172d6776-0ed3-4c0c-ae12-d0d200926cb5 tempest-CinderUnicodeTest-746990990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617.1dc8dfb1-c595-47f0-97cf-e37bfd139bf4" returned: 0 in 0.733s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-172d6776-0ed3-4c0c-ae12-d0d200926cb5 tempest-CinderUnicodeTest-746990990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:27 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617.info Jul 08 01:57:27 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:28 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-172d6776-0ed3-4c0c-ae12-d0d200926cb5 tempest-CinderUnicodeTest-746990990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617.info" returned: 0 in 0.683s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:28 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-172d6776-0ed3-4c0c-ae12-d0d200926cb5 tempest-CinderUnicodeTest-746990990 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617.info is being set with open permissions: ugo+rw Jul 08 01:57:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-172d6776-0ed3-4c0c-ae12-d0d200926cb5 tempest-CinderUnicodeTest-746990990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:28 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617.info Jul 08 01:57:28 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:29 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-172d6776-0ed3-4c0c-ae12-d0d200926cb5 tempest-CinderUnicodeTest-746990990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617.info" returned: 0 in 0.704s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-172d6776-0ed3-4c0c-ae12-d0d200926cb5 tempest-CinderUnicodeTest-746990990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.051s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-7651794e-19d4-44f5-ab1e-2bfdca855adb tempest-ProjectReaderTests-22232040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.358s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:29 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-7651794e-19d4-44f5-ab1e-2bfdca855adb tempest-ProjectReaderTests-22232040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1310037765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9712962-5551-49b7-b7b8-fb7da4a8f91e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7111ef9ce00343a993a9ff8b36a1ff80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:57:25Z,use_quota=True,user_id='1658f8ce7bdd4ab79bb222d1e0bd10d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:57:29 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-7651794e-19d4-44f5-ab1e-2bfdca855adb tempest-ProjectReaderTests-22232040 None] Creating volume d9712962-5551-49b7-b7b8-fb7da4a8f91e {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:57:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-7651794e-19d4-44f5-ab1e-2bfdca855adb tempest-ProjectReaderTests-22232040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-7651794e-19d4-44f5-ab1e-2bfdca855adb tempest-ProjectReaderTests-22232040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:29 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-7651794e-19d4-44f5-ab1e-2bfdca855adb tempest-ProjectReaderTests-22232040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:57:29 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-7651794e-19d4-44f5-ab1e-2bfdca855adb tempest-ProjectReaderTests-22232040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:57:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-7651794e-19d4-44f5-ab1e-2bfdca855adb tempest-ProjectReaderTests-22232040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:29 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-7651794e-19d4-44f5-ab1e-2bfdca855adb tempest-ProjectReaderTests-22232040 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:57:29 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-7651794e-19d4-44f5-ab1e-2bfdca855adb tempest-ProjectReaderTests-22232040 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:57:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7651794e-19d4-44f5-ab1e-2bfdca855adb tempest-ProjectReaderTests-22232040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d9712962-5551-49b7-b7b8-fb7da4a8f91e 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:29 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d9712962-5551-49b7-b7b8-fb7da4a8f91e 1073741824 Jul 08 01:57:29 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:29 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-172d6776-0ed3-4c0c-ae12-d0d200926cb5 tempest-CinderUnicodeTest-746990990 None] Create snapshot completed successfully Jul 08 01:57:30 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7651794e-19d4-44f5-ab1e-2bfdca855adb tempest-ProjectReaderTests-22232040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d9712962-5551-49b7-b7b8-fb7da4a8f91e 1073741824" returned: 0 in 0.857s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7651794e-19d4-44f5-ab1e-2bfdca855adb tempest-ProjectReaderTests-22232040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d9712962-5551-49b7-b7b8-fb7da4a8f91e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:30 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d9712962-5551-49b7-b7b8-fb7da4a8f91e Jul 08 01:57:30 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:30 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-462af0ab-d116-4f16-ac50-42ae4f64e314 tempest-CinderUnicodeTest-746990990 None] Acquiring lock "cinder-1dc8dfb1-c595-47f0-97cf-e37bfd139bf4-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:30 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-462af0ab-d116-4f16-ac50-42ae4f64e314 tempest-CinderUnicodeTest-746990990 None] Lock "cinder-1dc8dfb1-c595-47f0-97cf-e37bfd139bf4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:30 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-462af0ab-d116-4f16-ac50-42ae4f64e314 tempest-CinderUnicodeTest-746990990 None] Acquiring lock "cinder-quobyte-eeaa4979-de69-405f-8dc4-5ac0dd72a617" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:30 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-462af0ab-d116-4f16-ac50-42ae4f64e314 tempest-CinderUnicodeTest-746990990 None] Lock "cinder-quobyte-eeaa4979-de69-405f-8dc4-5ac0dd72a617" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:30 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-462af0ab-d116-4f16-ac50-42ae4f64e314 tempest-CinderUnicodeTest-746990990 None] Acquiring lock "cinder-quobyte-1dc8dfb1-c595-47f0-97cf-e37bfd139bf4" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:30 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-462af0ab-d116-4f16-ac50-42ae4f64e314 tempest-CinderUnicodeTest-746990990 None] Lock "cinder-quobyte-1dc8dfb1-c595-47f0-97cf-e37bfd139bf4" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:30 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-462af0ab-d116-4f16-ac50-42ae4f64e314 tempest-CinderUnicodeTest-746990990 None] Deleting offline snapshot 1dc8dfb1-c595-47f0-97cf-e37bfd139bf4 of volume eeaa4979-de69-405f-8dc4-5ac0dd72a617 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:57:30 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-462af0ab-d116-4f16-ac50-42ae4f64e314 tempest-CinderUnicodeTest-746990990 None] snapshot_file for this snap is: volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617.1dc8dfb1-c595-47f0-97cf-e37bfd139bf4 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:57:30 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[5728952e-fa3f-4b90-abbc-7c8ea01c8026]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-462af0ab-d116-4f16-ac50-42ae4f64e314 tempest-CinderUnicodeTest-746990990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617.1dc8dfb1-c595-47f0-97cf-e37bfd139bf4 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:30 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617.1dc8dfb1-c595-47f0-97cf-e37bfd139bf4 Jul 08 01:57:30 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:30 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7651794e-19d4-44f5-ab1e-2bfdca855adb tempest-ProjectReaderTests-22232040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d9712962-5551-49b7-b7b8-fb7da4a8f91e" returned: 0 in 0.746s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:30 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-7651794e-19d4-44f5-ab1e-2bfdca855adb tempest-ProjectReaderTests-22232040 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:57:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-7651794e-19d4-44f5-ab1e-2bfdca855adb tempest-ProjectReaderTests-22232040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-9ea730fc-cee8-4192-b39d-5fa23c0dee19 tempest-ProjectMemberTests-73797185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.556s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:30 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7651794e-19d4-44f5-ab1e-2bfdca855adb tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db71d1fa-527c-46ef-bad7-16919748a512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9712962-5551-49b7-b7b8-fb7da4a8f91e', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:30 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7651794e-19d4-44f5-ab1e-2bfdca855adb tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cefb2791-0ca1-4990-a847-faa68bb8b6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:30 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-9ea730fc-cee8-4192-b39d-5fa23c0dee19 tempest-ProjectMemberTests-73797185 None] Creating offline snapshot 9b5a5c05-4263-4311-b16b-3ab375f86589 of volume 451259f3-0a92-4910-963a-e62e93b3a261 {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:57:30 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-7651794e-19d4-44f5-ab1e-2bfdca855adb tempest-ProjectReaderTests-22232040 None] Volume volume-d9712962-5551-49b7-b7b8-fb7da4a8f91e (d9712962-5551-49b7-b7b8-fb7da4a8f91e): created successfully Jul 08 01:57:30 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7651794e-19d4-44f5-ab1e-2bfdca855adb tempest-ProjectReaderTests-22232040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cefb2791-0ca1-4990-a847-faa68bb8b6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:30 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-7651794e-19d4-44f5-ab1e-2bfdca855adb tempest-ProjectReaderTests-22232040 None] Flow 'volume_create_manager' (17e68624-8ebf-4d1d-9fd2-495dc618915c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:57:30 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[80750fd1-0361-4b82-b100-9594a57d926e]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9ea730fc-cee8-4192-b39d-5fa23c0dee19 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:30 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-7651794e-19d4-44f5-ab1e-2bfdca855adb tempest-ProjectReaderTests-22232040 None] Created volume successfully. Jul 08 01:57:31 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261 Jul 08 01:57:31 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:31 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-462af0ab-d116-4f16-ac50-42ae4f64e314 tempest-CinderUnicodeTest-746990990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617.1dc8dfb1-c595-47f0-97cf-e37bfd139bf4" returned: 0 in 0.859s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:31 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-462af0ab-d116-4f16-ac50-42ae4f64e314 tempest-CinderUnicodeTest-746990990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:57:31 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[4415e499-afcb-4091-bc1a-bcd3da10b842]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-462af0ab-d116-4f16-ac50-42ae4f64e314 tempest-CinderUnicodeTest-746990990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:31 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617 Jul 08 01:57:31 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:31 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9ea730fc-cee8-4192-b39d-5fa23c0dee19 tempest-ProjectMemberTests-73797185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261" returned: 0 in 0.869s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9ea730fc-cee8-4192-b39d-5fa23c0dee19 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261.9b5a5c05-4263-4311-b16b-3ab375f86589 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:31 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261.9b5a5c05-4263-4311-b16b-3ab375f86589 1G Jul 08 01:57:31 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:32 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-462af0ab-d116-4f16-ac50-42ae4f64e314 tempest-CinderUnicodeTest-746990990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617" returned: 0 in 0.887s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-462af0ab-d116-4f16-ac50-42ae4f64e314 tempest-CinderUnicodeTest-746990990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617.1dc8dfb1-c595-47f0-97cf-e37bfd139bf4 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:32 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-29b7b9cb-5141-41e9-ad58-d229de0d951e tempest-ProjectReaderTests-22232040 None] Acquiring lock "cinder-d9712962-5551-49b7-b7b8-fb7da4a8f91e-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:32 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617.1dc8dfb1-c595-47f0-97cf-e37bfd139bf4 Jul 08 01:57:32 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:32 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-29b7b9cb-5141-41e9-ad58-d229de0d951e tempest-ProjectReaderTests-22232040 None] Lock "cinder-d9712962-5551-49b7-b7b8-fb7da4a8f91e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:32 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-29b7b9cb-5141-41e9-ad58-d229de0d951e tempest-ProjectReaderTests-22232040 None] Acquiring lock "cinder-quobyte-d9712962-5551-49b7-b7b8-fb7da4a8f91e" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:32 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-29b7b9cb-5141-41e9-ad58-d229de0d951e tempest-ProjectReaderTests-22232040 None] Lock "cinder-quobyte-d9712962-5551-49b7-b7b8-fb7da4a8f91e" acquired by "delete_volume" :: waited 0.030s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:32 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d60273-a729-469d-ac3d-a4eec34b9e23]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-29b7b9cb-5141-41e9-ad58-d229de0d951e tempest-ProjectReaderTests-22232040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d9712962-5551-49b7-b7b8-fb7da4a8f91e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:32 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d9712962-5551-49b7-b7b8-fb7da4a8f91e Jul 08 01:57:32 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:32 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9ea730fc-cee8-4192-b39d-5fa23c0dee19 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261.9b5a5c05-4263-4311-b16b-3ab375f86589 1G" returned: 0 in 0.928s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9ea730fc-cee8-4192-b39d-5fa23c0dee19 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-451259f3-0a92-4910-963a-e62e93b3a261 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261.9b5a5c05-4263-4311-b16b-3ab375f86589 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:32 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-451259f3-0a92-4910-963a-e62e93b3a261 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261.9b5a5c05-4263-4311-b16b-3ab375f86589 Jul 08 01:57:32 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:33 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-462af0ab-d116-4f16-ac50-42ae4f64e314 tempest-CinderUnicodeTest-746990990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617.1dc8dfb1-c595-47f0-97cf-e37bfd139bf4" returned: 0 in 0.888s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-462af0ab-d116-4f16-ac50-42ae4f64e314 tempest-CinderUnicodeTest-746990990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617.1dc8dfb1-c595-47f0-97cf-e37bfd139bf4 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:33 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617.1dc8dfb1-c595-47f0-97cf-e37bfd139bf4 Jul 08 01:57:33 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:33 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-29b7b9cb-5141-41e9-ad58-d229de0d951e tempest-ProjectReaderTests-22232040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d9712962-5551-49b7-b7b8-fb7da4a8f91e" returned: 0 in 1.026s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-29b7b9cb-5141-41e9-ad58-d229de0d951e tempest-ProjectReaderTests-22232040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d9712962-5551-49b7-b7b8-fb7da4a8f91e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:33 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d9712962-5551-49b7-b7b8-fb7da4a8f91e Jul 08 01:57:33 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:33 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9ea730fc-cee8-4192-b39d-5fa23c0dee19 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-451259f3-0a92-4910-963a-e62e93b3a261 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261.9b5a5c05-4263-4311-b16b-3ab375f86589" returned: 0 in 0.828s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:33 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-9ea730fc-cee8-4192-b39d-5fa23c0dee19 tempest-ProjectMemberTests-73797185 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261.9b5a5c05-4263-4311-b16b-3ab375f86589 is being set with open permissions: ugo+rw Jul 08 01:57:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9ea730fc-cee8-4192-b39d-5fa23c0dee19 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261.9b5a5c05-4263-4311-b16b-3ab375f86589 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:33 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261.9b5a5c05-4263-4311-b16b-3ab375f86589 Jul 08 01:57:33 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:33 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-462af0ab-d116-4f16-ac50-42ae4f64e314 tempest-CinderUnicodeTest-746990990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617.1dc8dfb1-c595-47f0-97cf-e37bfd139bf4" returned: 0 in 0.722s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:33 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-462af0ab-d116-4f16-ac50-42ae4f64e314 tempest-CinderUnicodeTest-746990990 None] Lock "cinder-quobyte-1dc8dfb1-c595-47f0-97cf-e37bfd139bf4" released by "_delete_snapshot" :: held 3.508s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:33 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-462af0ab-d116-4f16-ac50-42ae4f64e314 tempest-CinderUnicodeTest-746990990 None] Lock "cinder-quobyte-eeaa4979-de69-405f-8dc4-5ac0dd72a617" released by "delete_snapshot" :: held 3.542s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:33 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-462af0ab-d116-4f16-ac50-42ae4f64e314 tempest-CinderUnicodeTest-746990990 None] Created reservations ['faf12314-2b90-4c80-8154-bb06db82a120', '7a8cd031-dd5b-4b40-b416-a85fdc10811c', '0ca94b55-44d7-4b32-b913-eea893b270d9', 'c66c3ae9-f137-495c-9900-e2dcd05061c8'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:57:34 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-462af0ab-d116-4f16-ac50-42ae4f64e314 tempest-CinderUnicodeTest-746990990 None] Delete snapshot completed successfully. Jul 08 01:57:34 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-462af0ab-d116-4f16-ac50-42ae4f64e314 tempest-CinderUnicodeTest-746990990 None] Lock "cinder-1dc8dfb1-c595-47f0-97cf-e37bfd139bf4-delete_snapshot" released by "delete_snapshot" :: held 3.761s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:34 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-29b7b9cb-5141-41e9-ad58-d229de0d951e tempest-ProjectReaderTests-22232040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-d9712962-5551-49b7-b7b8-fb7da4a8f91e" returned: 0 in 0.740s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:34 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-29b7b9cb-5141-41e9-ad58-d229de0d951e tempest-ProjectReaderTests-22232040 None] Lock "cinder-quobyte-d9712962-5551-49b7-b7b8-fb7da4a8f91e" released by "delete_volume" :: held 1.828s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:34 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-29b7b9cb-5141-41e9-ad58-d229de0d951e tempest-ProjectReaderTests-22232040 None] Created reservations ['3b28de54-88f9-46c6-ac25-2b194d6f22af', '036ba8d7-4793-4709-9977-65412eca3c5c', 'e972a834-4823-4ec0-a43b-a945683e201b', '935a00c3-e0c5-40ea-8be2-d3b90d3d3968'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:57:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-29b7b9cb-5141-41e9-ad58-d229de0d951e tempest-ProjectReaderTests-22232040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-29b7b9cb-5141-41e9-ad58-d229de0d951e tempest-ProjectReaderTests-22232040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:34 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-29b7b9cb-5141-41e9-ad58-d229de0d951e tempest-ProjectReaderTests-22232040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:57:34 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-29b7b9cb-5141-41e9-ad58-d229de0d951e tempest-ProjectReaderTests-22232040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:57:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-29b7b9cb-5141-41e9-ad58-d229de0d951e tempest-ProjectReaderTests-22232040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-29b7b9cb-5141-41e9-ad58-d229de0d951e tempest-ProjectReaderTests-22232040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:34 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:57:34 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:34 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9ea730fc-cee8-4192-b39d-5fa23c0dee19 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261.9b5a5c05-4263-4311-b16b-3ab375f86589" returned: 0 in 0.826s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9ea730fc-cee8-4192-b39d-5fa23c0dee19 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:34 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261.info Jul 08 01:57:34 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:34 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b834caf4-17c6-4fe6-b8fe-5776cab08be0 tempest-CinderUnicodeTest-746990990 None] Acquiring lock "cinder-eeaa4979-de69-405f-8dc4-5ac0dd72a617-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:34 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b834caf4-17c6-4fe6-b8fe-5776cab08be0 tempest-CinderUnicodeTest-746990990 None] Lock "cinder-eeaa4979-de69-405f-8dc4-5ac0dd72a617-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:34 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b834caf4-17c6-4fe6-b8fe-5776cab08be0 tempest-CinderUnicodeTest-746990990 None] Acquiring lock "cinder-quobyte-eeaa4979-de69-405f-8dc4-5ac0dd72a617" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:34 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b834caf4-17c6-4fe6-b8fe-5776cab08be0 tempest-CinderUnicodeTest-746990990 None] Lock "cinder-quobyte-eeaa4979-de69-405f-8dc4-5ac0dd72a617" acquired by "delete_volume" :: waited 0.037s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:34 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e10c2d-82ea-4549-95f6-859b0ae1362e]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b834caf4-17c6-4fe6-b8fe-5776cab08be0 tempest-CinderUnicodeTest-746990990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:35 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617 Jul 08 01:57:35 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:35 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-29b7b9cb-5141-41e9-ad58-d229de0d951e tempest-ProjectReaderTests-22232040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.929s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:35 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-29b7b9cb-5141-41e9-ad58-d229de0d951e tempest-ProjectReaderTests-22232040 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:57:35 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-29b7b9cb-5141-41e9-ad58-d229de0d951e tempest-ProjectReaderTests-22232040 None] Deleted volume successfully. Jul 08 01:57:35 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-29b7b9cb-5141-41e9-ad58-d229de0d951e tempest-ProjectReaderTests-22232040 None] Lock "cinder-d9712962-5551-49b7-b7b8-fb7da4a8f91e-delete_volume" released by "delete_volume" :: held 3.066s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:35 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9ea730fc-cee8-4192-b39d-5fa23c0dee19 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261.info" returned: 0 in 0.937s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:35 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-9ea730fc-cee8-4192-b39d-5fa23c0dee19 tempest-ProjectMemberTests-73797185 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261.info is being set with open permissions: ugo+rw Jul 08 01:57:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9ea730fc-cee8-4192-b39d-5fa23c0dee19 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:35 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261.info Jul 08 01:57:35 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:36 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b834caf4-17c6-4fe6-b8fe-5776cab08be0 tempest-CinderUnicodeTest-746990990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617" returned: 0 in 1.265s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b834caf4-17c6-4fe6-b8fe-5776cab08be0 tempest-CinderUnicodeTest-746990990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:36 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617 Jul 08 01:57:36 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:36 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-9ea730fc-cee8-4192-b39d-5fa23c0dee19 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261.info" returned: 0 in 0.879s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-9ea730fc-cee8-4192-b39d-5fa23c0dee19 tempest-ProjectMemberTests-73797185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.416s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-78894b24-abd8-4369-b671-522907183a07 tempest-ProjectReaderTests-756482943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.676s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-78894b24-abd8-4369-b671-522907183a07 tempest-ProjectReaderTests-756482943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2116012067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68031424-16de-4d72-af05-157f3f9e416b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cedff66a12b04885a54b318907f70246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:57:26Z,use_quota=True,user_id='42422d5e57294adbb2ba38426c0322eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:57:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-78894b24-abd8-4369-b671-522907183a07 tempest-ProjectReaderTests-756482943 None] Creating volume 68031424-16de-4d72-af05-157f3f9e416b {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:57:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-78894b24-abd8-4369-b671-522907183a07 tempest-ProjectReaderTests-756482943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-78894b24-abd8-4369-b671-522907183a07 tempest-ProjectReaderTests-756482943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-78894b24-abd8-4369-b671-522907183a07 tempest-ProjectReaderTests-756482943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:57:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-78894b24-abd8-4369-b671-522907183a07 tempest-ProjectReaderTests-756482943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:57:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-78894b24-abd8-4369-b671-522907183a07 tempest-ProjectReaderTests-756482943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:36 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-78894b24-abd8-4369-b671-522907183a07 tempest-ProjectReaderTests-756482943 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:57:36 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-78894b24-abd8-4369-b671-522907183a07 tempest-ProjectReaderTests-756482943 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:57:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-78894b24-abd8-4369-b671-522907183a07 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:36 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b 1073741824 Jul 08 01:57:36 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:36 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-9ea730fc-cee8-4192-b39d-5fa23c0dee19 tempest-ProjectMemberTests-73797185 None] Create snapshot completed successfully Jul 08 01:57:36 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-36fec3cc-d045-4c18-a1c7-b8358ec5757f tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-9b5a5c05-4263-4311-b16b-3ab375f86589-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:36 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-36fec3cc-d045-4c18-a1c7-b8358ec5757f tempest-ProjectMemberTests-73797185 None] Lock "cinder-9b5a5c05-4263-4311-b16b-3ab375f86589-delete_snapshot" acquired by "delete_snapshot" :: waited 0.077s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:36 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-36fec3cc-d045-4c18-a1c7-b8358ec5757f tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-quobyte-451259f3-0a92-4910-963a-e62e93b3a261" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:37 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-36fec3cc-d045-4c18-a1c7-b8358ec5757f tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-451259f3-0a92-4910-963a-e62e93b3a261" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:37 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-36fec3cc-d045-4c18-a1c7-b8358ec5757f tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-quobyte-9b5a5c05-4263-4311-b16b-3ab375f86589" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:37 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-36fec3cc-d045-4c18-a1c7-b8358ec5757f tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-9b5a5c05-4263-4311-b16b-3ab375f86589" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:37 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-36fec3cc-d045-4c18-a1c7-b8358ec5757f tempest-ProjectMemberTests-73797185 None] Deleting offline snapshot 9b5a5c05-4263-4311-b16b-3ab375f86589 of volume 451259f3-0a92-4910-963a-e62e93b3a261 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:57:37 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-36fec3cc-d045-4c18-a1c7-b8358ec5757f tempest-ProjectMemberTests-73797185 None] snapshot_file for this snap is: volume-451259f3-0a92-4910-963a-e62e93b3a261.9b5a5c05-4263-4311-b16b-3ab375f86589 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:57:37 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:37 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ed4da3-e850-4672-acf9-f97fba3d4208]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-36fec3cc-d045-4c18-a1c7-b8358ec5757f tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261.9b5a5c05-4263-4311-b16b-3ab375f86589 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b834caf4-17c6-4fe6-b8fe-5776cab08be0 tempest-CinderUnicodeTest-746990990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-eeaa4979-de69-405f-8dc4-5ac0dd72a617" returned: 0 in 0.994s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:37 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b834caf4-17c6-4fe6-b8fe-5776cab08be0 tempest-CinderUnicodeTest-746990990 None] Lock "cinder-quobyte-eeaa4979-de69-405f-8dc4-5ac0dd72a617" released by "delete_volume" :: held 2.351s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:37 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-b834caf4-17c6-4fe6-b8fe-5776cab08be0 tempest-CinderUnicodeTest-746990990 None] Created reservations ['77b48f8b-8e21-4e25-be15-3e3910f2b1a2', 'e96ed70c-79f0-4387-9731-7c309692590c', 'e26846ec-67c6-49a1-b24c-2c13a1fa47c9', '5f6d081e-242e-4e70-ae7b-bc1e97251ec0'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:57:37 devstack sudo[105606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261.9b5a5c05-4263-4311-b16b-3ab375f86589 Jul 08 01:57:37 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b834caf4-17c6-4fe6-b8fe-5776cab08be0 tempest-CinderUnicodeTest-746990990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b834caf4-17c6-4fe6-b8fe-5776cab08be0 tempest-CinderUnicodeTest-746990990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:37 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b834caf4-17c6-4fe6-b8fe-5776cab08be0 tempest-CinderUnicodeTest-746990990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:57:37 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b834caf4-17c6-4fe6-b8fe-5776cab08be0 tempest-CinderUnicodeTest-746990990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:57:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b834caf4-17c6-4fe6-b8fe-5776cab08be0 tempest-CinderUnicodeTest-746990990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b834caf4-17c6-4fe6-b8fe-5776cab08be0 tempest-CinderUnicodeTest-746990990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:37 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:57:37 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:37 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-78894b24-abd8-4369-b671-522907183a07 tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b 1073741824" returned: 0 in 1.204s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-78894b24-abd8-4369-b671-522907183a07 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:37 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b Jul 08 01:57:37 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:38 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-36fec3cc-d045-4c18-a1c7-b8358ec5757f tempest-ProjectMemberTests-73797185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261.9b5a5c05-4263-4311-b16b-3ab375f86589" returned: 0 in 0.973s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:38 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-36fec3cc-d045-4c18-a1c7-b8358ec5757f tempest-ProjectMemberTests-73797185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-451259f3-0a92-4910-963a-e62e93b3a261(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:57:38 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b834caf4-17c6-4fe6-b8fe-5776cab08be0 tempest-CinderUnicodeTest-746990990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.791s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:38 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-b834caf4-17c6-4fe6-b8fe-5776cab08be0 tempest-CinderUnicodeTest-746990990 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:57:38 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-b834caf4-17c6-4fe6-b8fe-5776cab08be0 tempest-CinderUnicodeTest-746990990 None] Deleted volume successfully. Jul 08 01:57:38 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46b20a1-67b0-475f-ac88-46788f15d51a]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-36fec3cc-d045-4c18-a1c7-b8358ec5757f tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:38 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-b834caf4-17c6-4fe6-b8fe-5776cab08be0 tempest-CinderUnicodeTest-746990990 None] Lock "cinder-eeaa4979-de69-405f-8dc4-5ac0dd72a617-delete_volume" released by "delete_volume" :: held 3.500s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:38 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-7ddd05fc-dd44-4c0d-8c00-7a1ba2bbdc9f tempest-CinderUnicodeTest-746990990 None] Acquiring lock "cinder-01fcde58-d255-4baa-966d-c523e746cbca-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:38 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-7ddd05fc-dd44-4c0d-8c00-7a1ba2bbdc9f tempest-CinderUnicodeTest-746990990 None] Lock "cinder-01fcde58-d255-4baa-966d-c523e746cbca-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:38 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-7ddd05fc-dd44-4c0d-8c00-7a1ba2bbdc9f tempest-CinderUnicodeTest-746990990 None] Acquiring lock "cinder-quobyte-01fcde58-d255-4baa-966d-c523e746cbca" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:38 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-7ddd05fc-dd44-4c0d-8c00-7a1ba2bbdc9f tempest-CinderUnicodeTest-746990990 None] Lock "cinder-quobyte-01fcde58-d255-4baa-966d-c523e746cbca" acquired by "delete_volume" :: waited 0.018s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:38 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:38 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261 Jul 08 01:57:38 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-78894b24-abd8-4369-b671-522907183a07 tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b" returned: 0 in 0.781s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:38 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-78894b24-abd8-4369-b671-522907183a07 tempest-ProjectReaderTests-756482943 None] <== create_volume: return (2037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:57:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-78894b24-abd8-4369-b671-522907183a07 tempest-ProjectReaderTests-756482943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.042s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:38 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6a11d6-f33a-4a16-a2db-1b5cc1b78a52]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7ddd05fc-dd44-4c0d-8c00-7a1ba2bbdc9f tempest-CinderUnicodeTest-746990990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-01fcde58-d255-4baa-966d-c523e746cbca {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-78894b24-abd8-4369-b671-522907183a07 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b669bcc4-d130-4d6e-9b3e-0bd1b98b9ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68031424-16de-4d72-af05-157f3f9e416b', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-78894b24-abd8-4369-b671-522907183a07 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a85242d2-fc12-41d7-a52c-158dc4e9da9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:38 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-78894b24-abd8-4369-b671-522907183a07 tempest-ProjectReaderTests-756482943 None] Volume volume-68031424-16de-4d72-af05-157f3f9e416b (68031424-16de-4d72-af05-157f3f9e416b): created successfully Jul 08 01:57:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-78894b24-abd8-4369-b671-522907183a07 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a85242d2-fc12-41d7-a52c-158dc4e9da9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:38 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-78894b24-abd8-4369-b671-522907183a07 tempest-ProjectReaderTests-756482943 None] Flow 'volume_create_manager' (5da547a0-12a7-4ea6-9a45-12f58bf3d632) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:57:38 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-78894b24-abd8-4369-b671-522907183a07 tempest-ProjectReaderTests-756482943 None] Created volume successfully. Jul 08 01:57:38 devstack sudo[105621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-01fcde58-d255-4baa-966d-c523e746cbca Jul 08 01:57:38 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:39 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-36fec3cc-d045-4c18-a1c7-b8358ec5757f tempest-ProjectMemberTests-73797185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261" returned: 0 in 0.902s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-36fec3cc-d045-4c18-a1c7-b8358ec5757f tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261.9b5a5c05-4263-4311-b16b-3ab375f86589 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:39 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261.9b5a5c05-4263-4311-b16b-3ab375f86589 Jul 08 01:57:39 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:39 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7ddd05fc-dd44-4c0d-8c00-7a1ba2bbdc9f tempest-CinderUnicodeTest-746990990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-01fcde58-d255-4baa-966d-c523e746cbca" returned: 0 in 0.877s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7ddd05fc-dd44-4c0d-8c00-7a1ba2bbdc9f tempest-CinderUnicodeTest-746990990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-01fcde58-d255-4baa-966d-c523e746cbca {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:39 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-01fcde58-d255-4baa-966d-c523e746cbca Jul 08 01:57:39 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-63f1e644-5b59-4d3a-a761-dccb4a30d580 tempest-ProjectReaderTests-756482943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-63f1e644-5b59-4d3a-a761-dccb4a30d580 tempest-ProjectReaderTests-756482943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:39 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-63f1e644-5b59-4d3a-a761-dccb4a30d580 tempest-ProjectReaderTests-756482943 None] Creating offline snapshot 8cae7244-340a-4498-95ba-6ebafcee7c1d of volume 68031424-16de-4d72-af05-157f3f9e416b {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:57:39 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d871113-4005-44c2-9992-b10ed9b3af85]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-63f1e644-5b59-4d3a-a761-dccb4a30d580 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:39 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b Jul 08 01:57:39 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:39 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-36fec3cc-d045-4c18-a1c7-b8358ec5757f tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261.9b5a5c05-4263-4311-b16b-3ab375f86589" returned: 0 in 0.835s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-36fec3cc-d045-4c18-a1c7-b8358ec5757f tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261.9b5a5c05-4263-4311-b16b-3ab375f86589 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:39 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261.9b5a5c05-4263-4311-b16b-3ab375f86589 Jul 08 01:57:39 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:39 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7ddd05fc-dd44-4c0d-8c00-7a1ba2bbdc9f tempest-CinderUnicodeTest-746990990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-01fcde58-d255-4baa-966d-c523e746cbca" returned: 0 in 0.760s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:39 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-7ddd05fc-dd44-4c0d-8c00-7a1ba2bbdc9f tempest-CinderUnicodeTest-746990990 None] Lock "cinder-quobyte-01fcde58-d255-4baa-966d-c523e746cbca" released by "delete_volume" :: held 1.687s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:40 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-7ddd05fc-dd44-4c0d-8c00-7a1ba2bbdc9f tempest-CinderUnicodeTest-746990990 None] Created reservations ['bee58954-4aa2-4cd7-9678-0a9e859c1c20', 'fe414243-1ac4-4950-8bfd-b58aecb963d0', '3b1c1281-5e7e-48d1-b5ef-ec4e4c12782c', '298d5cbc-3f0a-4563-8a11-7bb53c652388'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:57:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-7ddd05fc-dd44-4c0d-8c00-7a1ba2bbdc9f tempest-CinderUnicodeTest-746990990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-7ddd05fc-dd44-4c0d-8c00-7a1ba2bbdc9f tempest-CinderUnicodeTest-746990990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:40 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-7ddd05fc-dd44-4c0d-8c00-7a1ba2bbdc9f tempest-CinderUnicodeTest-746990990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:57:40 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-7ddd05fc-dd44-4c0d-8c00-7a1ba2bbdc9f tempest-CinderUnicodeTest-746990990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:57:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-7ddd05fc-dd44-4c0d-8c00-7a1ba2bbdc9f tempest-CinderUnicodeTest-746990990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7ddd05fc-dd44-4c0d-8c00-7a1ba2bbdc9f tempest-CinderUnicodeTest-746990990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:40 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:57:40 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:40 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-63f1e644-5b59-4d3a-a761-dccb4a30d580 tempest-ProjectReaderTests-756482943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b" returned: 0 in 0.919s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-63f1e644-5b59-4d3a-a761-dccb4a30d580 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b.8cae7244-340a-4498-95ba-6ebafcee7c1d 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:40 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b.8cae7244-340a-4498-95ba-6ebafcee7c1d 1G Jul 08 01:57:40 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:40 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-36fec3cc-d045-4c18-a1c7-b8358ec5757f tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261.9b5a5c05-4263-4311-b16b-3ab375f86589" returned: 0 in 0.751s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:40 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-36fec3cc-d045-4c18-a1c7-b8358ec5757f tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-9b5a5c05-4263-4311-b16b-3ab375f86589" released by "_delete_snapshot" :: held 3.666s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:40 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-36fec3cc-d045-4c18-a1c7-b8358ec5757f tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-451259f3-0a92-4910-963a-e62e93b3a261" released by "delete_snapshot" :: held 3.715s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:40 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-36fec3cc-d045-4c18-a1c7-b8358ec5757f tempest-ProjectMemberTests-73797185 None] Created reservations ['b3485b59-a170-4223-8189-6f05db41ab45', 'eab17277-0364-4ab7-92ba-cd8d9b6ec897', '53918030-e6b9-4c47-b0f5-b2fa716215c6', '4091d3dd-8679-48a4-9cbe-9ea541ce5547'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:57:40 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-36fec3cc-d045-4c18-a1c7-b8358ec5757f tempest-ProjectMemberTests-73797185 None] Delete snapshot completed successfully. Jul 08 01:57:40 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-36fec3cc-d045-4c18-a1c7-b8358ec5757f tempest-ProjectMemberTests-73797185 None] Lock "cinder-9b5a5c05-4263-4311-b16b-3ab375f86589-delete_snapshot" released by "delete_snapshot" :: held 3.955s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:40 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-7ddd05fc-dd44-4c0d-8c00-7a1ba2bbdc9f tempest-CinderUnicodeTest-746990990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.850s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:41 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-7ddd05fc-dd44-4c0d-8c00-7a1ba2bbdc9f tempest-CinderUnicodeTest-746990990 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:57:41 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-7ddd05fc-dd44-4c0d-8c00-7a1ba2bbdc9f tempest-CinderUnicodeTest-746990990 None] Deleted volume successfully. Jul 08 01:57:41 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-7ddd05fc-dd44-4c0d-8c00-7a1ba2bbdc9f tempest-CinderUnicodeTest-746990990 None] Lock "cinder-01fcde58-d255-4baa-966d-c523e746cbca-delete_volume" released by "delete_volume" :: held 2.802s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:41 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c17be2a2-e2f8-4b6f-b209-d75ed8e93d7d tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-451259f3-0a92-4910-963a-e62e93b3a261-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:41 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c17be2a2-e2f8-4b6f-b209-d75ed8e93d7d tempest-ProjectMemberTests-73797185 None] Lock "cinder-451259f3-0a92-4910-963a-e62e93b3a261-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:41 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c17be2a2-e2f8-4b6f-b209-d75ed8e93d7d tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-quobyte-451259f3-0a92-4910-963a-e62e93b3a261" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:41 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c17be2a2-e2f8-4b6f-b209-d75ed8e93d7d tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-451259f3-0a92-4910-963a-e62e93b3a261" acquired by "delete_volume" :: waited 0.022s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:41 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[972df47e-80db-4e3c-be14-d1d68206f7ff]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c17be2a2-e2f8-4b6f-b209-d75ed8e93d7d tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:41 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261 Jul 08 01:57:41 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:41 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-63f1e644-5b59-4d3a-a761-dccb4a30d580 tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b.8cae7244-340a-4498-95ba-6ebafcee7c1d 1G" returned: 0 in 1.117s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-63f1e644-5b59-4d3a-a761-dccb4a30d580 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68031424-16de-4d72-af05-157f3f9e416b -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b.8cae7244-340a-4498-95ba-6ebafcee7c1d {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:41 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68031424-16de-4d72-af05-157f3f9e416b -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b.8cae7244-340a-4498-95ba-6ebafcee7c1d Jul 08 01:57:41 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:42 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c17be2a2-e2f8-4b6f-b209-d75ed8e93d7d tempest-ProjectMemberTests-73797185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261" returned: 0 in 1.037s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c17be2a2-e2f8-4b6f-b209-d75ed8e93d7d tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:42 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261 Jul 08 01:57:42 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:42 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-63f1e644-5b59-4d3a-a761-dccb4a30d580 tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68031424-16de-4d72-af05-157f3f9e416b -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b.8cae7244-340a-4498-95ba-6ebafcee7c1d" returned: 0 in 0.975s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:42 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-63f1e644-5b59-4d3a-a761-dccb4a30d580 tempest-ProjectReaderTests-756482943 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b.8cae7244-340a-4498-95ba-6ebafcee7c1d is being set with open permissions: ugo+rw Jul 08 01:57:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-63f1e644-5b59-4d3a-a761-dccb4a30d580 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b.8cae7244-340a-4498-95ba-6ebafcee7c1d {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:42 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b.8cae7244-340a-4498-95ba-6ebafcee7c1d Jul 08 01:57:42 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:43 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c17be2a2-e2f8-4b6f-b209-d75ed8e93d7d tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-451259f3-0a92-4910-963a-e62e93b3a261" returned: 0 in 0.756s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:43 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c17be2a2-e2f8-4b6f-b209-d75ed8e93d7d tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-451259f3-0a92-4910-963a-e62e93b3a261" released by "delete_volume" :: held 1.862s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:43 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-c17be2a2-e2f8-4b6f-b209-d75ed8e93d7d tempest-ProjectMemberTests-73797185 None] Created reservations ['af07f64e-4bd5-45b3-bf97-c4b89a3e4c24', '5ff5fcd7-b364-47a5-b3cc-765cabca14ba', '90c3eed3-c49d-480d-a29a-3ba1b20dd27d', 'c7004d21-20e6-4dd4-b83d-59eb372c8c94'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:57:43 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-63f1e644-5b59-4d3a-a761-dccb4a30d580 tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b.8cae7244-340a-4498-95ba-6ebafcee7c1d" returned: 0 in 0.758s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c17be2a2-e2f8-4b6f-b209-d75ed8e93d7d tempest-ProjectMemberTests-73797185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c17be2a2-e2f8-4b6f-b209-d75ed8e93d7d tempest-ProjectMemberTests-73797185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:43 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c17be2a2-e2f8-4b6f-b209-d75ed8e93d7d tempest-ProjectMemberTests-73797185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:57:43 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c17be2a2-e2f8-4b6f-b209-d75ed8e93d7d tempest-ProjectMemberTests-73797185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:57:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c17be2a2-e2f8-4b6f-b209-d75ed8e93d7d tempest-ProjectMemberTests-73797185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c17be2a2-e2f8-4b6f-b209-d75ed8e93d7d tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-63f1e644-5b59-4d3a-a761-dccb4a30d580 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:43 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:57:43 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:43 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b.info Jul 08 01:57:43 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:44 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b99c630-cbb6-4222-9b71-d1736e9fdf3f tempest-ProjectMemberTests-73797185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:57:44 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:44 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3b99c630-cbb6-4222-9b71-d1736e9fdf3f tempest-ProjectMemberTests-73797185 None] Flow 'volume_create_manager' (701723a8-c5d4-44ac-94f1-74291a20dfd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:57:44 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3b99c630-cbb6-4222-9b71-d1736e9fdf3f tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (169b3d3c-0f86-4851-b7c2-7a1cfdc27e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-63f1e644-5b59-4d3a-a761-dccb4a30d580 tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b.info" returned: 0 in 0.819s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:44 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-63f1e644-5b59-4d3a-a761-dccb4a30d580 tempest-ProjectReaderTests-756482943 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b.info is being set with open permissions: ugo+rw Jul 08 01:57:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-63f1e644-5b59-4d3a-a761-dccb4a30d580 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:44 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c17be2a2-e2f8-4b6f-b209-d75ed8e93d7d tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.861s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:44 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-c17be2a2-e2f8-4b6f-b209-d75ed8e93d7d tempest-ProjectMemberTests-73797185 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:57:44 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3b99c630-cbb6-4222-9b71-d1736e9fdf3f tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (169b3d3c-0f86-4851-b7c2-7a1cfdc27e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-929129768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6506319b-7cc2-40fd-8511-75d7713c2c29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410ede866c9145df8444c3a398ace8b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:57:44Z,use_quota=True,user_id='5f5ae65b4a584ede952a5bfc00c9a49d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:44 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b.info Jul 08 01:57:44 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:44 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3b99c630-cbb6-4222-9b71-d1736e9fdf3f tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a818b085-a768-42a1-8cda-79507f5dc3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:44 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3b99c630-cbb6-4222-9b71-d1736e9fdf3f tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a818b085-a768-42a1-8cda-79507f5dc3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:44 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3b99c630-cbb6-4222-9b71-d1736e9fdf3f tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (782b38e7-ed6b-4824-a9de-ea5d18a6d483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:44 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3b99c630-cbb6-4222-9b71-d1736e9fdf3f tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (782b38e7-ed6b-4824-a9de-ea5d18a6d483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6506319b-7cc2-40fd-8511-75d7713c2c29', 'volume_name': 'volume-6506319b-7cc2-40fd-8511-75d7713c2c29', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:44 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3b99c630-cbb6-4222-9b71-d1736e9fdf3f tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad47153c-f1dd-4c73-83ff-c3d951da544b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:44 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3b99c630-cbb6-4222-9b71-d1736e9fdf3f tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad47153c-f1dd-4c73-83ff-c3d951da544b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:44 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3b99c630-cbb6-4222-9b71-d1736e9fdf3f tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea78de3-8d37-443d-b5d8-319967925e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:44 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-3b99c630-cbb6-4222-9b71-d1736e9fdf3f tempest-ProjectMemberTests-73797185 None] Volume 6506319b-7cc2-40fd-8511-75d7713c2c29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6506319b-7cc2-40fd-8511-75d7713c2c29', 'volume_size': 1} Jul 08 01:57:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3b99c630-cbb6-4222-9b71-d1736e9fdf3f tempest-ProjectMemberTests-73797185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:44 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-c17be2a2-e2f8-4b6f-b209-d75ed8e93d7d tempest-ProjectMemberTests-73797185 None] Deleted volume successfully. Jul 08 01:57:44 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c17be2a2-e2f8-4b6f-b209-d75ed8e93d7d tempest-ProjectMemberTests-73797185 None] Lock "cinder-451259f3-0a92-4910-963a-e62e93b3a261-delete_volume" released by "delete_volume" :: held 3.047s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:45 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-63f1e644-5b59-4d3a-a761-dccb4a30d580 tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b.info" returned: 0 in 0.734s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-63f1e644-5b59-4d3a-a761-dccb4a30d580 tempest-ProjectReaderTests-756482943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.450s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3b99c630-cbb6-4222-9b71-d1736e9fdf3f tempest-ProjectMemberTests-73797185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.682s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:45 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3b99c630-cbb6-4222-9b71-d1736e9fdf3f tempest-ProjectMemberTests-73797185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-929129768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6506319b-7cc2-40fd-8511-75d7713c2c29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410ede866c9145df8444c3a398ace8b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:57:44Z,use_quota=True,user_id='5f5ae65b4a584ede952a5bfc00c9a49d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:57:45 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-3b99c630-cbb6-4222-9b71-d1736e9fdf3f tempest-ProjectMemberTests-73797185 None] Creating volume 6506319b-7cc2-40fd-8511-75d7713c2c29 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:57:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3b99c630-cbb6-4222-9b71-d1736e9fdf3f tempest-ProjectMemberTests-73797185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3b99c630-cbb6-4222-9b71-d1736e9fdf3f tempest-ProjectMemberTests-73797185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:45 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3b99c630-cbb6-4222-9b71-d1736e9fdf3f tempest-ProjectMemberTests-73797185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:57:45 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3b99c630-cbb6-4222-9b71-d1736e9fdf3f tempest-ProjectMemberTests-73797185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:57:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3b99c630-cbb6-4222-9b71-d1736e9fdf3f tempest-ProjectMemberTests-73797185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:45 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3b99c630-cbb6-4222-9b71-d1736e9fdf3f tempest-ProjectMemberTests-73797185 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:57:45 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-3b99c630-cbb6-4222-9b71-d1736e9fdf3f tempest-ProjectMemberTests-73797185 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:57:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3b99c630-cbb6-4222-9b71-d1736e9fdf3f tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:45 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29 1073741824 Jul 08 01:57:45 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:45 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-63f1e644-5b59-4d3a-a761-dccb4a30d580 tempest-ProjectReaderTests-756482943 None] Create snapshot completed successfully Jul 08 01:57:45 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-05e4c07e-c897-4b9e-b23e-9d6a4289c9c4 tempest-ProjectReaderTests-756482943 None] Acquiring lock "cinder-8cae7244-340a-4498-95ba-6ebafcee7c1d-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:45 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-05e4c07e-c897-4b9e-b23e-9d6a4289c9c4 tempest-ProjectReaderTests-756482943 None] Lock "cinder-8cae7244-340a-4498-95ba-6ebafcee7c1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:45 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-05e4c07e-c897-4b9e-b23e-9d6a4289c9c4 tempest-ProjectReaderTests-756482943 None] Acquiring lock "cinder-quobyte-68031424-16de-4d72-af05-157f3f9e416b" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:45 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-05e4c07e-c897-4b9e-b23e-9d6a4289c9c4 tempest-ProjectReaderTests-756482943 None] Lock "cinder-quobyte-68031424-16de-4d72-af05-157f3f9e416b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:45 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-05e4c07e-c897-4b9e-b23e-9d6a4289c9c4 tempest-ProjectReaderTests-756482943 None] Acquiring lock "cinder-quobyte-8cae7244-340a-4498-95ba-6ebafcee7c1d" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:46 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-05e4c07e-c897-4b9e-b23e-9d6a4289c9c4 tempest-ProjectReaderTests-756482943 None] Lock "cinder-quobyte-8cae7244-340a-4498-95ba-6ebafcee7c1d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:46 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-05e4c07e-c897-4b9e-b23e-9d6a4289c9c4 tempest-ProjectReaderTests-756482943 None] Deleting offline snapshot 8cae7244-340a-4498-95ba-6ebafcee7c1d of volume 68031424-16de-4d72-af05-157f3f9e416b {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:57:46 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-05e4c07e-c897-4b9e-b23e-9d6a4289c9c4 tempest-ProjectReaderTests-756482943 None] snapshot_file for this snap is: volume-68031424-16de-4d72-af05-157f3f9e416b.8cae7244-340a-4498-95ba-6ebafcee7c1d {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:57:46 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3056f6c-02c8-4827-804f-8aaaaf308e52]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-05e4c07e-c897-4b9e-b23e-9d6a4289c9c4 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b.8cae7244-340a-4498-95ba-6ebafcee7c1d {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:46 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3b99c630-cbb6-4222-9b71-d1736e9fdf3f tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29 1073741824" returned: 0 in 1.034s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3b99c630-cbb6-4222-9b71-d1736e9fdf3f tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:46 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29 Jul 08 01:57:46 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:46 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b.8cae7244-340a-4498-95ba-6ebafcee7c1d Jul 08 01:57:46 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:46 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3b99c630-cbb6-4222-9b71-d1736e9fdf3f tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29" returned: 0 in 0.705s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:46 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-3b99c630-cbb6-4222-9b71-d1736e9fdf3f tempest-ProjectMemberTests-73797185 None] <== create_volume: return (1790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:57:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-3b99c630-cbb6-4222-9b71-d1736e9fdf3f tempest-ProjectMemberTests-73797185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3b99c630-cbb6-4222-9b71-d1736e9fdf3f tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea78de3-8d37-443d-b5d8-319967925e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6506319b-7cc2-40fd-8511-75d7713c2c29', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3b99c630-cbb6-4222-9b71-d1736e9fdf3f tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e270ccc0-b7fa-4dcd-bae7-6e93619ad95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:46 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-3b99c630-cbb6-4222-9b71-d1736e9fdf3f tempest-ProjectMemberTests-73797185 None] Volume volume-6506319b-7cc2-40fd-8511-75d7713c2c29 (6506319b-7cc2-40fd-8511-75d7713c2c29): created successfully Jul 08 01:57:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3b99c630-cbb6-4222-9b71-d1736e9fdf3f tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e270ccc0-b7fa-4dcd-bae7-6e93619ad95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:46 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-3b99c630-cbb6-4222-9b71-d1736e9fdf3f tempest-ProjectMemberTests-73797185 None] Flow 'volume_create_manager' (701723a8-c5d4-44ac-94f1-74291a20dfd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:57:46 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-3b99c630-cbb6-4222-9b71-d1736e9fdf3f tempest-ProjectMemberTests-73797185 None] Created volume successfully. Jul 08 01:57:46 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-05e4c07e-c897-4b9e-b23e-9d6a4289c9c4 tempest-ProjectReaderTests-756482943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b.8cae7244-340a-4498-95ba-6ebafcee7c1d" returned: 0 in 0.921s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:46 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-05e4c07e-c897-4b9e-b23e-9d6a4289c9c4 tempest-ProjectReaderTests-756482943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68031424-16de-4d72-af05-157f3f9e416b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:57:47 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f07eb9-b801-473c-985f-487cac7cf6b3]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-05e4c07e-c897-4b9e-b23e-9d6a4289c9c4 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:47 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b Jul 08 01:57:47 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e958f1b2-327a-4031-94d3-5969967aff97 tempest-ProjectMemberTests-73797185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e958f1b2-327a-4031-94d3-5969967aff97 tempest-ProjectMemberTests-73797185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:47 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-e958f1b2-327a-4031-94d3-5969967aff97 tempest-ProjectMemberTests-73797185 None] Creating offline snapshot 37d07ae6-de10-45d2-b69e-75e24947dc8c of volume 6506319b-7cc2-40fd-8511-75d7713c2c29 {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:57:47 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8ffae5-8e60-4dd3-b7ab-f8b7f5d8a0a0]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e958f1b2-327a-4031-94d3-5969967aff97 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:47 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29 Jul 08 01:57:47 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:47 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-05e4c07e-c897-4b9e-b23e-9d6a4289c9c4 tempest-ProjectReaderTests-756482943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b" returned: 0 in 0.816s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-05e4c07e-c897-4b9e-b23e-9d6a4289c9c4 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b.8cae7244-340a-4498-95ba-6ebafcee7c1d {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:47 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b.8cae7244-340a-4498-95ba-6ebafcee7c1d Jul 08 01:57:47 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:48 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e958f1b2-327a-4031-94d3-5969967aff97 tempest-ProjectMemberTests-73797185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29" returned: 0 in 0.898s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e958f1b2-327a-4031-94d3-5969967aff97 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29.37d07ae6-de10-45d2-b69e-75e24947dc8c 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:48 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29.37d07ae6-de10-45d2-b69e-75e24947dc8c 1G Jul 08 01:57:48 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:48 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-05e4c07e-c897-4b9e-b23e-9d6a4289c9c4 tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b.8cae7244-340a-4498-95ba-6ebafcee7c1d" returned: 0 in 0.814s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-05e4c07e-c897-4b9e-b23e-9d6a4289c9c4 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b.8cae7244-340a-4498-95ba-6ebafcee7c1d {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:48 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b.8cae7244-340a-4498-95ba-6ebafcee7c1d Jul 08 01:57:48 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:49 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-05e4c07e-c897-4b9e-b23e-9d6a4289c9c4 tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b.8cae7244-340a-4498-95ba-6ebafcee7c1d" returned: 0 in 0.712s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:49 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e958f1b2-327a-4031-94d3-5969967aff97 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29.37d07ae6-de10-45d2-b69e-75e24947dc8c 1G" returned: 0 in 0.879s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e958f1b2-327a-4031-94d3-5969967aff97 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6506319b-7cc2-40fd-8511-75d7713c2c29 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29.37d07ae6-de10-45d2-b69e-75e24947dc8c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:49 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-05e4c07e-c897-4b9e-b23e-9d6a4289c9c4 tempest-ProjectReaderTests-756482943 None] Lock "cinder-quobyte-8cae7244-340a-4498-95ba-6ebafcee7c1d" released by "_delete_snapshot" :: held 3.388s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:49 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-05e4c07e-c897-4b9e-b23e-9d6a4289c9c4 tempest-ProjectReaderTests-756482943 None] Lock "cinder-quobyte-68031424-16de-4d72-af05-157f3f9e416b" released by "delete_snapshot" :: held 3.417s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:49 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6506319b-7cc2-40fd-8511-75d7713c2c29 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29.37d07ae6-de10-45d2-b69e-75e24947dc8c Jul 08 01:57:49 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:49 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-05e4c07e-c897-4b9e-b23e-9d6a4289c9c4 tempest-ProjectReaderTests-756482943 None] Created reservations ['961b4af3-5adb-4f92-8e1b-5b0e75286fea', 'd81ae993-5e1d-45af-97de-ccea25380f1a', 'f0de41a9-6d8c-4d39-8ce2-50fb3fe933b3', '175380ea-108a-4788-9bef-aab65378130f'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:57:49 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-05e4c07e-c897-4b9e-b23e-9d6a4289c9c4 tempest-ProjectReaderTests-756482943 None] Delete snapshot completed successfully. Jul 08 01:57:49 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-05e4c07e-c897-4b9e-b23e-9d6a4289c9c4 tempest-ProjectReaderTests-756482943 None] Lock "cinder-8cae7244-340a-4498-95ba-6ebafcee7c1d-delete_snapshot" released by "delete_snapshot" :: held 3.572s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:50 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e958f1b2-327a-4031-94d3-5969967aff97 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6506319b-7cc2-40fd-8511-75d7713c2c29 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29.37d07ae6-de10-45d2-b69e-75e24947dc8c" returned: 0 in 0.748s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:50 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-e958f1b2-327a-4031-94d3-5969967aff97 tempest-ProjectMemberTests-73797185 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29.37d07ae6-de10-45d2-b69e-75e24947dc8c is being set with open permissions: ugo+rw Jul 08 01:57:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e958f1b2-327a-4031-94d3-5969967aff97 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29.37d07ae6-de10-45d2-b69e-75e24947dc8c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:50 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29.37d07ae6-de10-45d2-b69e-75e24947dc8c Jul 08 01:57:50 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:50 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-435208da-ce2b-49a5-bddc-12663f17a116 tempest-ProjectReaderTests-756482943 None] Acquiring lock "cinder-68031424-16de-4d72-af05-157f3f9e416b-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:50 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-435208da-ce2b-49a5-bddc-12663f17a116 tempest-ProjectReaderTests-756482943 None] Lock "cinder-68031424-16de-4d72-af05-157f3f9e416b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:50 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-435208da-ce2b-49a5-bddc-12663f17a116 tempest-ProjectReaderTests-756482943 None] Acquiring lock "cinder-quobyte-68031424-16de-4d72-af05-157f3f9e416b" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:50 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-435208da-ce2b-49a5-bddc-12663f17a116 tempest-ProjectReaderTests-756482943 None] Lock "cinder-quobyte-68031424-16de-4d72-af05-157f3f9e416b" acquired by "delete_volume" :: waited 0.019s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:50 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ad65d8-8ab4-4c0c-8744-367579c1349e]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-435208da-ce2b-49a5-bddc-12663f17a116 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:50 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b Jul 08 01:57:50 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:50 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e958f1b2-327a-4031-94d3-5969967aff97 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29.37d07ae6-de10-45d2-b69e-75e24947dc8c" returned: 0 in 0.738s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:50 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e958f1b2-327a-4031-94d3-5969967aff97 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:50 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29.info Jul 08 01:57:50 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:51 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-435208da-ce2b-49a5-bddc-12663f17a116 tempest-ProjectReaderTests-756482943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b" returned: 0 in 0.897s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-435208da-ce2b-49a5-bddc-12663f17a116 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:51 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b Jul 08 01:57:51 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:51 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e958f1b2-327a-4031-94d3-5969967aff97 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29.info" returned: 0 in 0.746s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:51 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-e958f1b2-327a-4031-94d3-5969967aff97 tempest-ProjectMemberTests-73797185 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29.info is being set with open permissions: ugo+rw Jul 08 01:57:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e958f1b2-327a-4031-94d3-5969967aff97 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:51 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29.info Jul 08 01:57:51 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:52 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-435208da-ce2b-49a5-bddc-12663f17a116 tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-68031424-16de-4d72-af05-157f3f9e416b" returned: 0 in 0.776s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:52 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-435208da-ce2b-49a5-bddc-12663f17a116 tempest-ProjectReaderTests-756482943 None] Lock "cinder-quobyte-68031424-16de-4d72-af05-157f3f9e416b" released by "delete_volume" :: held 1.746s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:52 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-435208da-ce2b-49a5-bddc-12663f17a116 tempest-ProjectReaderTests-756482943 None] Created reservations ['65f278d5-e728-4302-9ab9-7139cdc8a200', 'dd4ff2a2-7a85-484d-8826-cb03b092ab60', '0a039cab-bdba-43c9-a298-5822990bf76c', 'a9da3d9f-b2b5-4b54-831c-faf35ccb3220'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:57:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-435208da-ce2b-49a5-bddc-12663f17a116 tempest-ProjectReaderTests-756482943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-435208da-ce2b-49a5-bddc-12663f17a116 tempest-ProjectReaderTests-756482943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-435208da-ce2b-49a5-bddc-12663f17a116 tempest-ProjectReaderTests-756482943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:57:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-435208da-ce2b-49a5-bddc-12663f17a116 tempest-ProjectReaderTests-756482943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:57:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-435208da-ce2b-49a5-bddc-12663f17a116 tempest-ProjectReaderTests-756482943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-435208da-ce2b-49a5-bddc-12663f17a116 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:52 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:57:52 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:52 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e958f1b2-327a-4031-94d3-5969967aff97 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29.info" returned: 0 in 0.705s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e958f1b2-327a-4031-94d3-5969967aff97 tempest-ProjectMemberTests-73797185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.823s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:52 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-e958f1b2-327a-4031-94d3-5969967aff97 tempest-ProjectMemberTests-73797185 None] Create snapshot completed successfully Jul 08 01:57:52 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-10b84fda-c58e-44d0-9024-095e464662c8 tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-37d07ae6-de10-45d2-b69e-75e24947dc8c-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:52 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-10b84fda-c58e-44d0-9024-095e464662c8 tempest-ProjectMemberTests-73797185 None] Lock "cinder-37d07ae6-de10-45d2-b69e-75e24947dc8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:52 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-10b84fda-c58e-44d0-9024-095e464662c8 tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-quobyte-6506319b-7cc2-40fd-8511-75d7713c2c29" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:52 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-10b84fda-c58e-44d0-9024-095e464662c8 tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-6506319b-7cc2-40fd-8511-75d7713c2c29" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:52 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-10b84fda-c58e-44d0-9024-095e464662c8 tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-quobyte-37d07ae6-de10-45d2-b69e-75e24947dc8c" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:52 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-10b84fda-c58e-44d0-9024-095e464662c8 tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-37d07ae6-de10-45d2-b69e-75e24947dc8c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-10b84fda-c58e-44d0-9024-095e464662c8 tempest-ProjectMemberTests-73797185 None] Deleting offline snapshot 37d07ae6-de10-45d2-b69e-75e24947dc8c of volume 6506319b-7cc2-40fd-8511-75d7713c2c29 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:57:52 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-10b84fda-c58e-44d0-9024-095e464662c8 tempest-ProjectMemberTests-73797185 None] snapshot_file for this snap is: volume-6506319b-7cc2-40fd-8511-75d7713c2c29.37d07ae6-de10-45d2-b69e-75e24947dc8c {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:57:53 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e82c8d-2020-40b7-931e-0a14a6f253fe]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-10b84fda-c58e-44d0-9024-095e464662c8 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29.37d07ae6-de10-45d2-b69e-75e24947dc8c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:53 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-435208da-ce2b-49a5-bddc-12663f17a116 tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.848s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:53 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-435208da-ce2b-49a5-bddc-12663f17a116 tempest-ProjectReaderTests-756482943 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:57:53 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-435208da-ce2b-49a5-bddc-12663f17a116 tempest-ProjectReaderTests-756482943 None] Deleted volume successfully. Jul 08 01:57:53 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-435208da-ce2b-49a5-bddc-12663f17a116 tempest-ProjectReaderTests-756482943 None] Lock "cinder-68031424-16de-4d72-af05-157f3f9e416b-delete_volume" released by "delete_volume" :: held 2.877s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:53 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2383e08-2f40-4606-a53f-3fba0bb11433 tempest-ProjectReaderTests-756482943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:57:53 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f2383e08-2f40-4606-a53f-3fba0bb11433 tempest-ProjectReaderTests-756482943 None] Flow 'volume_create_manager' (6f8bfd9d-d05a-4490-965c-83b302511885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:57:53 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f2383e08-2f40-4606-a53f-3fba0bb11433 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d015198-2cc2-4296-b4c2-d02563152a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:53 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29.37d07ae6-de10-45d2-b69e-75e24947dc8c Jul 08 01:57:53 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:53 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f2383e08-2f40-4606-a53f-3fba0bb11433 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d015198-2cc2-4296-b4c2-d02563152a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2039429274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bc0ace2-04a7-40c5-a521-c4db71b0ea2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cedff66a12b04885a54b318907f70246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:57:53Z,use_quota=True,user_id='42422d5e57294adbb2ba38426c0322eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:53 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f2383e08-2f40-4606-a53f-3fba0bb11433 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad2e4f36-7f61-4198-9a16-717683045af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:53 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f2383e08-2f40-4606-a53f-3fba0bb11433 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad2e4f36-7f61-4198-9a16-717683045af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:53 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f2383e08-2f40-4606-a53f-3fba0bb11433 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3020ee56-f62a-46f1-b9cc-751133a9c474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:53 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f2383e08-2f40-4606-a53f-3fba0bb11433 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3020ee56-f62a-46f1-b9cc-751133a9c474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bc0ace2-04a7-40c5-a521-c4db71b0ea2c', 'volume_name': 'volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:53 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f2383e08-2f40-4606-a53f-3fba0bb11433 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (213113e6-6d36-4bb9-a0e2-2de76ea2359e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:53 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f2383e08-2f40-4606-a53f-3fba0bb11433 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (213113e6-6d36-4bb9-a0e2-2de76ea2359e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:53 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f2383e08-2f40-4606-a53f-3fba0bb11433 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bc6a162-2089-48d1-a80e-4fc18c562c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:53 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-f2383e08-2f40-4606-a53f-3fba0bb11433 tempest-ProjectReaderTests-756482943 None] Volume 2bc0ace2-04a7-40c5-a521-c4db71b0ea2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c', 'volume_size': 1} Jul 08 01:57:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f2383e08-2f40-4606-a53f-3fba0bb11433 tempest-ProjectReaderTests-756482943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f2383e08-2f40-4606-a53f-3fba0bb11433 tempest-ProjectReaderTests-756482943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:53 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f2383e08-2f40-4606-a53f-3fba0bb11433 tempest-ProjectReaderTests-756482943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2039429274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bc0ace2-04a7-40c5-a521-c4db71b0ea2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cedff66a12b04885a54b318907f70246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:57:53Z,use_quota=True,user_id='42422d5e57294adbb2ba38426c0322eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:57:53 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-f2383e08-2f40-4606-a53f-3fba0bb11433 tempest-ProjectReaderTests-756482943 None] Creating volume 2bc0ace2-04a7-40c5-a521-c4db71b0ea2c {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:57:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f2383e08-2f40-4606-a53f-3fba0bb11433 tempest-ProjectReaderTests-756482943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f2383e08-2f40-4606-a53f-3fba0bb11433 tempest-ProjectReaderTests-756482943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:53 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f2383e08-2f40-4606-a53f-3fba0bb11433 tempest-ProjectReaderTests-756482943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:57:53 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f2383e08-2f40-4606-a53f-3fba0bb11433 tempest-ProjectReaderTests-756482943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:57:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f2383e08-2f40-4606-a53f-3fba0bb11433 tempest-ProjectReaderTests-756482943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:53 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f2383e08-2f40-4606-a53f-3fba0bb11433 tempest-ProjectReaderTests-756482943 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:57:53 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-f2383e08-2f40-4606-a53f-3fba0bb11433 tempest-ProjectReaderTests-756482943 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:57:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f2383e08-2f40-4606-a53f-3fba0bb11433 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:53 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c 1073741824 Jul 08 01:57:53 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:53 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-10b84fda-c58e-44d0-9024-095e464662c8 tempest-ProjectMemberTests-73797185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29.37d07ae6-de10-45d2-b69e-75e24947dc8c" returned: 0 in 0.879s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:53 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-10b84fda-c58e-44d0-9024-095e464662c8 tempest-ProjectMemberTests-73797185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6506319b-7cc2-40fd-8511-75d7713c2c29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:57:53 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91801a1-8c66-4322-8f25-0a58f697d058]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-10b84fda-c58e-44d0-9024-095e464662c8 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:54 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29 Jul 08 01:57:54 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:54 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f2383e08-2f40-4606-a53f-3fba0bb11433 tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c 1073741824" returned: 0 in 0.945s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f2383e08-2f40-4606-a53f-3fba0bb11433 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:54 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c Jul 08 01:57:54 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:54 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-10b84fda-c58e-44d0-9024-095e464662c8 tempest-ProjectMemberTests-73797185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29" returned: 0 in 0.929s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-10b84fda-c58e-44d0-9024-095e464662c8 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29.37d07ae6-de10-45d2-b69e-75e24947dc8c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:54 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29.37d07ae6-de10-45d2-b69e-75e24947dc8c Jul 08 01:57:54 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:54 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-f2383e08-2f40-4606-a53f-3fba0bb11433 tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c" returned: 0 in 0.700s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:54 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-f2383e08-2f40-4606-a53f-3fba0bb11433 tempest-ProjectReaderTests-756482943 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:57:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-f2383e08-2f40-4606-a53f-3fba0bb11433 tempest-ProjectReaderTests-756482943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.697s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f2383e08-2f40-4606-a53f-3fba0bb11433 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bc6a162-2089-48d1-a80e-4fc18c562c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f2383e08-2f40-4606-a53f-3fba0bb11433 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcc63821-5f70-4f2b-9be0-ed3b6682ace7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:54 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-f2383e08-2f40-4606-a53f-3fba0bb11433 tempest-ProjectReaderTests-756482943 None] Volume volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c (2bc0ace2-04a7-40c5-a521-c4db71b0ea2c): created successfully Jul 08 01:57:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f2383e08-2f40-4606-a53f-3fba0bb11433 tempest-ProjectReaderTests-756482943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcc63821-5f70-4f2b-9be0-ed3b6682ace7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:54 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-f2383e08-2f40-4606-a53f-3fba0bb11433 tempest-ProjectReaderTests-756482943 None] Flow 'volume_create_manager' (6f8bfd9d-d05a-4490-965c-83b302511885) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:57:54 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-f2383e08-2f40-4606-a53f-3fba0bb11433 tempest-ProjectReaderTests-756482943 None] Created volume successfully. Jul 08 01:57:55 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:57:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:57:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:57:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:55 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:57:55 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-be75bb20-ecee-4cce-9361-c7ce8ea93d18 tempest-ProjectReaderTests-756482943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-be75bb20-ecee-4cce-9361-c7ce8ea93d18 tempest-ProjectReaderTests-756482943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-be75bb20-ecee-4cce-9361-c7ce8ea93d18 tempest-ProjectReaderTests-756482943 None] Creating offline snapshot f7a10c41-fcd3-430d-83e3-c26e8b28fc19 of volume 2bc0ace2-04a7-40c5-a521-c4db71b0ea2c {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:57:55 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[03aca838-0ff4-4689-aa69-9bfac35029b1]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-be75bb20-ecee-4cce-9361-c7ce8ea93d18 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:55 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c Jul 08 01:57:55 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:55 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-10b84fda-c58e-44d0-9024-095e464662c8 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29.37d07ae6-de10-45d2-b69e-75e24947dc8c" returned: 0 in 0.818s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-10b84fda-c58e-44d0-9024-095e464662c8 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29.37d07ae6-de10-45d2-b69e-75e24947dc8c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:55 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29.37d07ae6-de10-45d2-b69e-75e24947dc8c Jul 08 01:57:55 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:56 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.816s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:56 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:57:56 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager._thread_info {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:57:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread count: 29 {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:57:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread info: [<_MainThread(MainThread, started 127058402500736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:57:56 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-be75bb20-ecee-4cce-9361-c7ce8ea93d18 tempest-ProjectReaderTests-756482943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c" returned: 0 in 0.885s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-be75bb20-ecee-4cce-9361-c7ce8ea93d18 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c.f7a10c41-fcd3-430d-83e3-c26e8b28fc19 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:56 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c.f7a10c41-fcd3-430d-83e3-c26e8b28fc19 1G Jul 08 01:57:56 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:56 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-10b84fda-c58e-44d0-9024-095e464662c8 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29.37d07ae6-de10-45d2-b69e-75e24947dc8c" returned: 0 in 0.800s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:56 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-10b84fda-c58e-44d0-9024-095e464662c8 tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-37d07ae6-de10-45d2-b69e-75e24947dc8c" released by "_delete_snapshot" :: held 3.541s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:56 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-10b84fda-c58e-44d0-9024-095e464662c8 tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-6506319b-7cc2-40fd-8511-75d7713c2c29" released by "delete_snapshot" :: held 3.573s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:56 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-10b84fda-c58e-44d0-9024-095e464662c8 tempest-ProjectMemberTests-73797185 None] Created reservations ['5b16a33f-5895-4c07-a926-01ed2820c72a', 'eae8c2e1-6c83-4f26-a77a-6c2f8ddaefce', 'd3707cf7-52d8-4152-9d4a-81e9910fa238', 'ae560b60-2289-459f-8fdc-bc9913ef31e1'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:57:56 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-10b84fda-c58e-44d0-9024-095e464662c8 tempest-ProjectMemberTests-73797185 None] Delete snapshot completed successfully. Jul 08 01:57:56 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-10b84fda-c58e-44d0-9024-095e464662c8 tempest-ProjectMemberTests-73797185 None] Lock "cinder-37d07ae6-de10-45d2-b69e-75e24947dc8c-delete_snapshot" released by "delete_snapshot" :: held 3.731s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:57 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-dec336fb-8ecd-4fe2-ab9a-e2dc786d79d0 tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-6506319b-7cc2-40fd-8511-75d7713c2c29-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:57 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-dec336fb-8ecd-4fe2-ab9a-e2dc786d79d0 tempest-ProjectMemberTests-73797185 None] Lock "cinder-6506319b-7cc2-40fd-8511-75d7713c2c29-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:57 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-dec336fb-8ecd-4fe2-ab9a-e2dc786d79d0 tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-quobyte-6506319b-7cc2-40fd-8511-75d7713c2c29" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:57 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-be75bb20-ecee-4cce-9361-c7ce8ea93d18 tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c.f7a10c41-fcd3-430d-83e3-c26e8b28fc19 1G" returned: 0 in 1.004s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-be75bb20-ecee-4cce-9361-c7ce8ea93d18 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c.f7a10c41-fcd3-430d-83e3-c26e8b28fc19 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:57 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-dec336fb-8ecd-4fe2-ab9a-e2dc786d79d0 tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-6506319b-7cc2-40fd-8511-75d7713c2c29" acquired by "delete_volume" :: waited 0.035s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:57 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c.f7a10c41-fcd3-430d-83e3-c26e8b28fc19 Jul 08 01:57:57 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:57 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f56a5c8-1d36-4096-b281-ab98297e17e9]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-dec336fb-8ecd-4fe2-ab9a-e2dc786d79d0 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:57 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29 Jul 08 01:57:57 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:58 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-be75bb20-ecee-4cce-9361-c7ce8ea93d18 tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c.f7a10c41-fcd3-430d-83e3-c26e8b28fc19" returned: 0 in 0.725s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:58 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-be75bb20-ecee-4cce-9361-c7ce8ea93d18 tempest-ProjectReaderTests-756482943 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c.f7a10c41-fcd3-430d-83e3-c26e8b28fc19 is being set with open permissions: ugo+rw Jul 08 01:57:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-be75bb20-ecee-4cce-9361-c7ce8ea93d18 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c.f7a10c41-fcd3-430d-83e3-c26e8b28fc19 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:58 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c.f7a10c41-fcd3-430d-83e3-c26e8b28fc19 Jul 08 01:57:58 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:58 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-dec336fb-8ecd-4fe2-ab9a-e2dc786d79d0 tempest-ProjectMemberTests-73797185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29" returned: 0 in 0.914s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-dec336fb-8ecd-4fe2-ab9a-e2dc786d79d0 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:58 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29 Jul 08 01:57:58 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:58 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-be75bb20-ecee-4cce-9361-c7ce8ea93d18 tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c.f7a10c41-fcd3-430d-83e3-c26e8b28fc19" returned: 0 in 0.686s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-be75bb20-ecee-4cce-9361-c7ce8ea93d18 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:58 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c.info Jul 08 01:57:58 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:59 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-dec336fb-8ecd-4fe2-ab9a-e2dc786d79d0 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-6506319b-7cc2-40fd-8511-75d7713c2c29" returned: 0 in 0.739s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:59 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-dec336fb-8ecd-4fe2-ab9a-e2dc786d79d0 tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-6506319b-7cc2-40fd-8511-75d7713c2c29" released by "delete_volume" :: held 1.732s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:59 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-dec336fb-8ecd-4fe2-ab9a-e2dc786d79d0 tempest-ProjectMemberTests-73797185 None] Created reservations ['1ad9a6cd-ad21-47f2-b188-dbec28b2cf32', 'f13444c2-45b4-4445-8cc6-f30356e5b055', '3abb5176-9e63-4d48-a921-0ca239101b4c', '500a63a2-40fe-40b9-9cfd-4b0792c1b55e'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:57:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-dec336fb-8ecd-4fe2-ab9a-e2dc786d79d0 tempest-ProjectMemberTests-73797185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-dec336fb-8ecd-4fe2-ab9a-e2dc786d79d0 tempest-ProjectMemberTests-73797185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:59 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-dec336fb-8ecd-4fe2-ab9a-e2dc786d79d0 tempest-ProjectMemberTests-73797185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:57:59 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-dec336fb-8ecd-4fe2-ab9a-e2dc786d79d0 tempest-ProjectMemberTests-73797185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:57:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-dec336fb-8ecd-4fe2-ab9a-e2dc786d79d0 tempest-ProjectMemberTests-73797185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-dec336fb-8ecd-4fe2-ab9a-e2dc786d79d0 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:59 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:57:59 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:59 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-be75bb20-ecee-4cce-9361-c7ce8ea93d18 tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c.info" returned: 0 in 0.777s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:59 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-be75bb20-ecee-4cce-9361-c7ce8ea93d18 tempest-ProjectReaderTests-756482943 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c.info is being set with open permissions: ugo+rw Jul 08 01:57:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-be75bb20-ecee-4cce-9361-c7ce8ea93d18 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:59 devstack sudo[105850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c.info Jul 08 01:57:59 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:59 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-dec336fb-8ecd-4fe2-ab9a-e2dc786d79d0 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.710s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:59 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-dec336fb-8ecd-4fe2-ab9a-e2dc786d79d0 tempest-ProjectMemberTests-73797185 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:57:59 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-dec336fb-8ecd-4fe2-ab9a-e2dc786d79d0 tempest-ProjectMemberTests-73797185 None] Deleted volume successfully. Jul 08 01:57:59 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-dec336fb-8ecd-4fe2-ab9a-e2dc786d79d0 tempest-ProjectMemberTests-73797185 None] Lock "cinder-6506319b-7cc2-40fd-8511-75d7713c2c29-delete_volume" released by "delete_volume" :: held 2.712s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:00 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-abab74fd-5a61-49e6-b9ec-5a303afc0442 tempest-ProjectMemberTests-73797185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:58:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-abab74fd-5a61-49e6-b9ec-5a303afc0442 tempest-ProjectMemberTests-73797185 None] Flow 'volume_create_manager' (6a9e6096-8be3-4d85-a3d6-8a649e599d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:58:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-abab74fd-5a61-49e6-b9ec-5a303afc0442 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cd5fc9b-e9e6-4029-9f73-579bded86071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-abab74fd-5a61-49e6-b9ec-5a303afc0442 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cd5fc9b-e9e6-4029-9f73-579bded86071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1297660482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3240186d-4b7a-4a26-bb1f-b26e8e4a27b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410ede866c9145df8444c3a398ace8b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:58:00Z,use_quota=True,user_id='5f5ae65b4a584ede952a5bfc00c9a49d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-abab74fd-5a61-49e6-b9ec-5a303afc0442 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (118256fe-39e6-477f-842d-0346e4c44aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-abab74fd-5a61-49e6-b9ec-5a303afc0442 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (118256fe-39e6-477f-842d-0346e4c44aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-abab74fd-5a61-49e6-b9ec-5a303afc0442 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d4d3b91-3af2-4f66-b734-88268d44e375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-abab74fd-5a61-49e6-b9ec-5a303afc0442 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d4d3b91-3af2-4f66-b734-88268d44e375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3240186d-4b7a-4a26-bb1f-b26e8e4a27b3', 'volume_name': 'volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-abab74fd-5a61-49e6-b9ec-5a303afc0442 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92b29455-4363-42da-b694-b2a41fd5ade9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-abab74fd-5a61-49e6-b9ec-5a303afc0442 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92b29455-4363-42da-b694-b2a41fd5ade9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-abab74fd-5a61-49e6-b9ec-5a303afc0442 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37201342-2a13-43de-ab21-5c5521406591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:00 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-abab74fd-5a61-49e6-b9ec-5a303afc0442 tempest-ProjectMemberTests-73797185 None] Volume 3240186d-4b7a-4a26-bb1f-b26e8e4a27b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3', 'volume_size': 1} Jul 08 01:58:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-abab74fd-5a61-49e6-b9ec-5a303afc0442 tempest-ProjectMemberTests-73797185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:00 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-be75bb20-ecee-4cce-9361-c7ce8ea93d18 tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c.info" returned: 0 in 0.829s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-be75bb20-ecee-4cce-9361-c7ce8ea93d18 tempest-ProjectReaderTests-756482943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.018s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-abab74fd-5a61-49e6-b9ec-5a303afc0442 tempest-ProjectMemberTests-73797185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.222s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-abab74fd-5a61-49e6-b9ec-5a303afc0442 tempest-ProjectMemberTests-73797185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1297660482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3240186d-4b7a-4a26-bb1f-b26e8e4a27b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410ede866c9145df8444c3a398ace8b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:58:00Z,use_quota=True,user_id='5f5ae65b4a584ede952a5bfc00c9a49d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:58:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-abab74fd-5a61-49e6-b9ec-5a303afc0442 tempest-ProjectMemberTests-73797185 None] Creating volume 3240186d-4b7a-4a26-bb1f-b26e8e4a27b3 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:58:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-abab74fd-5a61-49e6-b9ec-5a303afc0442 tempest-ProjectMemberTests-73797185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-abab74fd-5a61-49e6-b9ec-5a303afc0442 tempest-ProjectMemberTests-73797185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-abab74fd-5a61-49e6-b9ec-5a303afc0442 tempest-ProjectMemberTests-73797185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:58:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-abab74fd-5a61-49e6-b9ec-5a303afc0442 tempest-ProjectMemberTests-73797185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:58:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-abab74fd-5a61-49e6-b9ec-5a303afc0442 tempest-ProjectMemberTests-73797185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-abab74fd-5a61-49e6-b9ec-5a303afc0442 tempest-ProjectMemberTests-73797185 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:58:00 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-abab74fd-5a61-49e6-b9ec-5a303afc0442 tempest-ProjectMemberTests-73797185 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:58:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-abab74fd-5a61-49e6-b9ec-5a303afc0442 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:00 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3 1073741824 Jul 08 01:58:00 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:00 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-be75bb20-ecee-4cce-9361-c7ce8ea93d18 tempest-ProjectReaderTests-756482943 None] Create snapshot completed successfully Jul 08 01:58:00 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3febb820-82fd-4dfa-8699-d4c5657b45e1 tempest-ProjectReaderTests-756482943 None] Acquiring lock "cinder-f7a10c41-fcd3-430d-83e3-c26e8b28fc19-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:00 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3febb820-82fd-4dfa-8699-d4c5657b45e1 tempest-ProjectReaderTests-756482943 None] Lock "cinder-f7a10c41-fcd3-430d-83e3-c26e8b28fc19-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:00 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3febb820-82fd-4dfa-8699-d4c5657b45e1 tempest-ProjectReaderTests-756482943 None] Acquiring lock "cinder-quobyte-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:00 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3febb820-82fd-4dfa-8699-d4c5657b45e1 tempest-ProjectReaderTests-756482943 None] Lock "cinder-quobyte-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:00 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3febb820-82fd-4dfa-8699-d4c5657b45e1 tempest-ProjectReaderTests-756482943 None] Acquiring lock "cinder-quobyte-f7a10c41-fcd3-430d-83e3-c26e8b28fc19" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:00 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3febb820-82fd-4dfa-8699-d4c5657b45e1 tempest-ProjectReaderTests-756482943 None] Lock "cinder-quobyte-f7a10c41-fcd3-430d-83e3-c26e8b28fc19" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-3febb820-82fd-4dfa-8699-d4c5657b45e1 tempest-ProjectReaderTests-756482943 None] Deleting offline snapshot f7a10c41-fcd3-430d-83e3-c26e8b28fc19 of volume 2bc0ace2-04a7-40c5-a521-c4db71b0ea2c {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:58:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-3febb820-82fd-4dfa-8699-d4c5657b45e1 tempest-ProjectReaderTests-756482943 None] snapshot_file for this snap is: volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c.f7a10c41-fcd3-430d-83e3-c26e8b28fc19 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:58:00 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[20243de9-f436-43c9-b539-e71672969037]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:58:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3febb820-82fd-4dfa-8699-d4c5657b45e1 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c.f7a10c41-fcd3-430d-83e3-c26e8b28fc19 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:00 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c.f7a10c41-fcd3-430d-83e3-c26e8b28fc19 Jul 08 01:58:00 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:01 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-abab74fd-5a61-49e6-b9ec-5a303afc0442 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3 1073741824" returned: 0 in 1.000s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-abab74fd-5a61-49e6-b9ec-5a303afc0442 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:01 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3 Jul 08 01:58:01 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:01 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3febb820-82fd-4dfa-8699-d4c5657b45e1 tempest-ProjectReaderTests-756482943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c.f7a10c41-fcd3-430d-83e3-c26e8b28fc19" returned: 0 in 0.918s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:01 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-3febb820-82fd-4dfa-8699-d4c5657b45e1 tempest-ProjectReaderTests-756482943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:58:01 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda0f229-51e6-48ac-b2a3-4a48cdd4e131]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:58:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3febb820-82fd-4dfa-8699-d4c5657b45e1 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:01 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c Jul 08 01:58:01 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:02 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-abab74fd-5a61-49e6-b9ec-5a303afc0442 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3" returned: 0 in 0.763s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:02 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-abab74fd-5a61-49e6-b9ec-5a303afc0442 tempest-ProjectMemberTests-73797185 None] <== create_volume: return (1812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:58:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-abab74fd-5a61-49e6-b9ec-5a303afc0442 tempest-ProjectMemberTests-73797185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.816s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:02 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-abab74fd-5a61-49e6-b9ec-5a303afc0442 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37201342-2a13-43de-ab21-5c5521406591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:02 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-abab74fd-5a61-49e6-b9ec-5a303afc0442 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c24b896-2d33-40a9-ba82-b553b6a33935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:02 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-abab74fd-5a61-49e6-b9ec-5a303afc0442 tempest-ProjectMemberTests-73797185 None] Volume volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3 (3240186d-4b7a-4a26-bb1f-b26e8e4a27b3): created successfully Jul 08 01:58:02 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-abab74fd-5a61-49e6-b9ec-5a303afc0442 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c24b896-2d33-40a9-ba82-b553b6a33935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:02 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-abab74fd-5a61-49e6-b9ec-5a303afc0442 tempest-ProjectMemberTests-73797185 None] Flow 'volume_create_manager' (6a9e6096-8be3-4d85-a3d6-8a649e599d48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:58:02 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-abab74fd-5a61-49e6-b9ec-5a303afc0442 tempest-ProjectMemberTests-73797185 None] Created volume successfully. Jul 08 01:58:02 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3febb820-82fd-4dfa-8699-d4c5657b45e1 tempest-ProjectReaderTests-756482943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c" returned: 0 in 0.862s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3febb820-82fd-4dfa-8699-d4c5657b45e1 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c.f7a10c41-fcd3-430d-83e3-c26e8b28fc19 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:02 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c.f7a10c41-fcd3-430d-83e3-c26e8b28fc19 Jul 08 01:58:02 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:03 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3febb820-82fd-4dfa-8699-d4c5657b45e1 tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c.f7a10c41-fcd3-430d-83e3-c26e8b28fc19" returned: 0 in 0.802s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3febb820-82fd-4dfa-8699-d4c5657b45e1 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c.f7a10c41-fcd3-430d-83e3-c26e8b28fc19 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:03 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c.f7a10c41-fcd3-430d-83e3-c26e8b28fc19 Jul 08 01:58:03 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-bddce613-f106-47ac-be6b-a041814fdc9a tempest-ProjectMemberTests-73797185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-bddce613-f106-47ac-be6b-a041814fdc9a tempest-ProjectMemberTests-73797185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:03 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-bddce613-f106-47ac-be6b-a041814fdc9a tempest-ProjectMemberTests-73797185 None] Creating offline snapshot 5fae3bfe-33a2-4c19-ad7e-b62233295d40 of volume 3240186d-4b7a-4a26-bb1f-b26e8e4a27b3 {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:58:03 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca50e6e-9307-4a48-9566-d46b8e39ce6c]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:58:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-bddce613-f106-47ac-be6b-a041814fdc9a tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:03 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3 Jul 08 01:58:03 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:04 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-3febb820-82fd-4dfa-8699-d4c5657b45e1 tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c.f7a10c41-fcd3-430d-83e3-c26e8b28fc19" returned: 0 in 0.727s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:04 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3febb820-82fd-4dfa-8699-d4c5657b45e1 tempest-ProjectReaderTests-756482943 None] Lock "cinder-quobyte-f7a10c41-fcd3-430d-83e3-c26e8b28fc19" released by "_delete_snapshot" :: held 3.420s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:04 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3febb820-82fd-4dfa-8699-d4c5657b45e1 tempest-ProjectReaderTests-756482943 None] Lock "cinder-quobyte-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c" released by "delete_snapshot" :: held 3.449s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:04 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-3febb820-82fd-4dfa-8699-d4c5657b45e1 tempest-ProjectReaderTests-756482943 None] Created reservations ['4cadf2ea-4b0a-4cf5-81de-1ba856d1e1bf', '94793710-f381-4cd9-8546-9e1e7af5edfd', '5096d41c-5e72-49cb-9e77-54465190a25a', 'a7314678-4ecc-4949-91bd-b48cc8362ca2'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:58:04 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-3febb820-82fd-4dfa-8699-d4c5657b45e1 tempest-ProjectReaderTests-756482943 None] Delete snapshot completed successfully. Jul 08 01:58:04 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-3febb820-82fd-4dfa-8699-d4c5657b45e1 tempest-ProjectReaderTests-756482943 None] Lock "cinder-f7a10c41-fcd3-430d-83e3-c26e8b28fc19-delete_snapshot" released by "delete_snapshot" :: held 3.624s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:04 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-bddce613-f106-47ac-be6b-a041814fdc9a tempest-ProjectMemberTests-73797185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3" returned: 0 in 0.851s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-bddce613-f106-47ac-be6b-a041814fdc9a tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3.5fae3bfe-33a2-4c19-ad7e-b62233295d40 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:04 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3.5fae3bfe-33a2-4c19-ad7e-b62233295d40 1G Jul 08 01:58:04 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:04 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-863c7aa4-0c2c-4902-9dc7-00f32c76bb66 tempest-ProjectReaderTests-756482943 None] Acquiring lock "cinder-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:04 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-863c7aa4-0c2c-4902-9dc7-00f32c76bb66 tempest-ProjectReaderTests-756482943 None] Lock "cinder-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:04 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-863c7aa4-0c2c-4902-9dc7-00f32c76bb66 tempest-ProjectReaderTests-756482943 None] Acquiring lock "cinder-quobyte-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:05 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-863c7aa4-0c2c-4902-9dc7-00f32c76bb66 tempest-ProjectReaderTests-756482943 None] Lock "cinder-quobyte-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c" acquired by "delete_volume" :: waited 0.017s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:05 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fbedb7-e3e6-4227-b44e-2f24c2fe6743]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:58:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-863c7aa4-0c2c-4902-9dc7-00f32c76bb66 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:05 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c Jul 08 01:58:05 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:05 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-bddce613-f106-47ac-be6b-a041814fdc9a tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3.5fae3bfe-33a2-4c19-ad7e-b62233295d40 1G" returned: 0 in 0.922s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-bddce613-f106-47ac-be6b-a041814fdc9a tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3.5fae3bfe-33a2-4c19-ad7e-b62233295d40 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:05 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3.5fae3bfe-33a2-4c19-ad7e-b62233295d40 Jul 08 01:58:05 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:05 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-863c7aa4-0c2c-4902-9dc7-00f32c76bb66 tempest-ProjectReaderTests-756482943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c" returned: 0 in 0.876s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-863c7aa4-0c2c-4902-9dc7-00f32c76bb66 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:05 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c Jul 08 01:58:05 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:05 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-bddce613-f106-47ac-be6b-a041814fdc9a tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3.5fae3bfe-33a2-4c19-ad7e-b62233295d40" returned: 0 in 0.725s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:05 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-bddce613-f106-47ac-be6b-a041814fdc9a tempest-ProjectMemberTests-73797185 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3.5fae3bfe-33a2-4c19-ad7e-b62233295d40 is being set with open permissions: ugo+rw Jul 08 01:58:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-bddce613-f106-47ac-be6b-a041814fdc9a tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3.5fae3bfe-33a2-4c19-ad7e-b62233295d40 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:05 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3.5fae3bfe-33a2-4c19-ad7e-b62233295d40 Jul 08 01:58:05 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:06 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-863c7aa4-0c2c-4902-9dc7-00f32c76bb66 tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c" returned: 0 in 0.681s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:06 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-863c7aa4-0c2c-4902-9dc7-00f32c76bb66 tempest-ProjectReaderTests-756482943 None] Lock "cinder-quobyte-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c" released by "delete_volume" :: held 1.624s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:06 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-863c7aa4-0c2c-4902-9dc7-00f32c76bb66 tempest-ProjectReaderTests-756482943 None] Created reservations ['5a5ab816-d092-47c7-9c45-c466668f0c1a', 'fde53aeb-7a0e-4d63-b081-d106408c5c95', '59bd152f-9ab5-4fe6-8d6e-4602d966ec6d', '08e31f84-09bd-40fe-822e-5a17f1de18eb'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:58:06 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-bddce613-f106-47ac-be6b-a041814fdc9a tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3.5fae3bfe-33a2-4c19-ad7e-b62233295d40" returned: 0 in 0.771s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-bddce613-f106-47ac-be6b-a041814fdc9a tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:06 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3.info Jul 08 01:58:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-863c7aa4-0c2c-4902-9dc7-00f32c76bb66 tempest-ProjectReaderTests-756482943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:06 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-863c7aa4-0c2c-4902-9dc7-00f32c76bb66 tempest-ProjectReaderTests-756482943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:06 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-863c7aa4-0c2c-4902-9dc7-00f32c76bb66 tempest-ProjectReaderTests-756482943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:58:06 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-863c7aa4-0c2c-4902-9dc7-00f32c76bb66 tempest-ProjectReaderTests-756482943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:58:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-863c7aa4-0c2c-4902-9dc7-00f32c76bb66 tempest-ProjectReaderTests-756482943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-863c7aa4-0c2c-4902-9dc7-00f32c76bb66 tempest-ProjectReaderTests-756482943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:06 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:58:06 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:07 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-bddce613-f106-47ac-be6b-a041814fdc9a tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3.info" returned: 0 in 0.744s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:07 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-bddce613-f106-47ac-be6b-a041814fdc9a tempest-ProjectMemberTests-73797185 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3.info is being set with open permissions: ugo+rw Jul 08 01:58:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-bddce613-f106-47ac-be6b-a041814fdc9a tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:07 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3.info Jul 08 01:58:07 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:07 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-863c7aa4-0c2c-4902-9dc7-00f32c76bb66 tempest-ProjectReaderTests-756482943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.754s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:07 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-863c7aa4-0c2c-4902-9dc7-00f32c76bb66 tempest-ProjectReaderTests-756482943 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:58:07 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-863c7aa4-0c2c-4902-9dc7-00f32c76bb66 tempest-ProjectReaderTests-756482943 None] Deleted volume successfully. Jul 08 01:58:07 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-863c7aa4-0c2c-4902-9dc7-00f32c76bb66 tempest-ProjectReaderTests-756482943 None] Lock "cinder-2bc0ace2-04a7-40c5-a521-c4db71b0ea2c-delete_volume" released by "delete_volume" :: held 2.660s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:08 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-bddce613-f106-47ac-be6b-a041814fdc9a tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3.info" returned: 0 in 0.751s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-bddce613-f106-47ac-be6b-a041814fdc9a tempest-ProjectMemberTests-73797185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.860s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:08 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-bddce613-f106-47ac-be6b-a041814fdc9a tempest-ProjectMemberTests-73797185 None] Create snapshot completed successfully Jul 08 01:58:08 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-90a0f4aa-abba-46b0-954d-52468591df11 tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-5fae3bfe-33a2-4c19-ad7e-b62233295d40-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:08 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-90a0f4aa-abba-46b0-954d-52468591df11 tempest-ProjectMemberTests-73797185 None] Lock "cinder-5fae3bfe-33a2-4c19-ad7e-b62233295d40-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:08 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-90a0f4aa-abba-46b0-954d-52468591df11 tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-quobyte-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:08 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-90a0f4aa-abba-46b0-954d-52468591df11 tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:08 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-90a0f4aa-abba-46b0-954d-52468591df11 tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-quobyte-5fae3bfe-33a2-4c19-ad7e-b62233295d40" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:08 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-90a0f4aa-abba-46b0-954d-52468591df11 tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-5fae3bfe-33a2-4c19-ad7e-b62233295d40" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:08 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-90a0f4aa-abba-46b0-954d-52468591df11 tempest-ProjectMemberTests-73797185 None] Deleting offline snapshot 5fae3bfe-33a2-4c19-ad7e-b62233295d40 of volume 3240186d-4b7a-4a26-bb1f-b26e8e4a27b3 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:58:08 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-90a0f4aa-abba-46b0-954d-52468591df11 tempest-ProjectMemberTests-73797185 None] snapshot_file for this snap is: volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3.5fae3bfe-33a2-4c19-ad7e-b62233295d40 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:58:08 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e6aecc-73e2-4c4a-aba3-578599fc5984]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:58:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-90a0f4aa-abba-46b0-954d-52468591df11 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3.5fae3bfe-33a2-4c19-ad7e-b62233295d40 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:08 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3.5fae3bfe-33a2-4c19-ad7e-b62233295d40 Jul 08 01:58:08 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:09 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-90a0f4aa-abba-46b0-954d-52468591df11 tempest-ProjectMemberTests-73797185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3.5fae3bfe-33a2-4c19-ad7e-b62233295d40" returned: 0 in 0.929s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:09 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-90a0f4aa-abba-46b0-954d-52468591df11 tempest-ProjectMemberTests-73797185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:58:09 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03895a6-8b2d-4ca1-80d4-5efaa642ac18]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:58:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-90a0f4aa-abba-46b0-954d-52468591df11 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:09 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3 Jul 08 01:58:09 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:10 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-90a0f4aa-abba-46b0-954d-52468591df11 tempest-ProjectMemberTests-73797185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3" returned: 0 in 0.924s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-90a0f4aa-abba-46b0-954d-52468591df11 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3.5fae3bfe-33a2-4c19-ad7e-b62233295d40 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:10 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3.5fae3bfe-33a2-4c19-ad7e-b62233295d40 Jul 08 01:58:10 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:11 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-90a0f4aa-abba-46b0-954d-52468591df11 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3.5fae3bfe-33a2-4c19-ad7e-b62233295d40" returned: 0 in 0.899s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-90a0f4aa-abba-46b0-954d-52468591df11 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3.5fae3bfe-33a2-4c19-ad7e-b62233295d40 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:11 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3.5fae3bfe-33a2-4c19-ad7e-b62233295d40 Jul 08 01:58:11 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:12 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:12 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-90a0f4aa-abba-46b0-954d-52468591df11 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3.5fae3bfe-33a2-4c19-ad7e-b62233295d40" returned: 0 in 0.729s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:12 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-90a0f4aa-abba-46b0-954d-52468591df11 tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-5fae3bfe-33a2-4c19-ad7e-b62233295d40" released by "_delete_snapshot" :: held 3.593s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:12 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-90a0f4aa-abba-46b0-954d-52468591df11 tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3" released by "delete_snapshot" :: held 3.618s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:12 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-90a0f4aa-abba-46b0-954d-52468591df11 tempest-ProjectMemberTests-73797185 None] Created reservations ['9e397819-47e9-4bff-8ac2-3859964cc4f7', 'e649451b-c372-4292-930e-03870f5f65c8', 'ae82fc89-2389-426a-941b-1f29d697fe7b', '89776206-ebed-4891-934b-5506d2e03a1a'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:58:12 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-90a0f4aa-abba-46b0-954d-52468591df11 tempest-ProjectMemberTests-73797185 None] Delete snapshot completed successfully. Jul 08 01:58:12 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-90a0f4aa-abba-46b0-954d-52468591df11 tempest-ProjectMemberTests-73797185 None] Lock "cinder-5fae3bfe-33a2-4c19-ad7e-b62233295d40-delete_snapshot" released by "delete_snapshot" :: held 3.784s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:12 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-837a8f03-0bf1-4e0c-8323-9c96db94fd0c tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:13 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-837a8f03-0bf1-4e0c-8323-9c96db94fd0c tempest-ProjectMemberTests-73797185 None] Lock "cinder-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:13 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-837a8f03-0bf1-4e0c-8323-9c96db94fd0c tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-quobyte-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:13 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-837a8f03-0bf1-4e0c-8323-9c96db94fd0c tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3" acquired by "delete_volume" :: waited 0.024s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:13 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[8789ab80-d05e-449f-8052-1f94a776b930]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:58:13 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-837a8f03-0bf1-4e0c-8323-9c96db94fd0c tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:13 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3 Jul 08 01:58:13 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:14 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-837a8f03-0bf1-4e0c-8323-9c96db94fd0c tempest-ProjectMemberTests-73797185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3" returned: 0 in 0.892s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-837a8f03-0bf1-4e0c-8323-9c96db94fd0c tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:14 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3 Jul 08 01:58:14 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:14 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:14 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-837a8f03-0bf1-4e0c-8323-9c96db94fd0c tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3" returned: 0 in 0.755s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:14 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-837a8f03-0bf1-4e0c-8323-9c96db94fd0c tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3" released by "delete_volume" :: held 1.752s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:14 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-837a8f03-0bf1-4e0c-8323-9c96db94fd0c tempest-ProjectMemberTests-73797185 None] Created reservations ['b09fa880-333b-4c63-8fe7-61cb8a7612f3', '427e7217-6022-4d07-8489-fe9d69563e3b', '56e665dc-172e-4ef3-8d08-bbbd92311a5a', '9b512218-e42d-40b3-bac4-2fd9df0c7518'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:58:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-837a8f03-0bf1-4e0c-8323-9c96db94fd0c tempest-ProjectMemberTests-73797185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-837a8f03-0bf1-4e0c-8323-9c96db94fd0c tempest-ProjectMemberTests-73797185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:15 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-837a8f03-0bf1-4e0c-8323-9c96db94fd0c tempest-ProjectMemberTests-73797185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:58:15 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-837a8f03-0bf1-4e0c-8323-9c96db94fd0c tempest-ProjectMemberTests-73797185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:58:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-837a8f03-0bf1-4e0c-8323-9c96db94fd0c tempest-ProjectMemberTests-73797185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-837a8f03-0bf1-4e0c-8323-9c96db94fd0c tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:15 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:58:15 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:15 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-837a8f03-0bf1-4e0c-8323-9c96db94fd0c tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.762s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:15 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-837a8f03-0bf1-4e0c-8323-9c96db94fd0c tempest-ProjectMemberTests-73797185 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:58:15 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-837a8f03-0bf1-4e0c-8323-9c96db94fd0c tempest-ProjectMemberTests-73797185 None] Deleted volume successfully. Jul 08 01:58:15 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-837a8f03-0bf1-4e0c-8323-9c96db94fd0c tempest-ProjectMemberTests-73797185 None] Lock "cinder-3240186d-4b7a-4a26-bb1f-b26e8e4a27b3-delete_volume" released by "delete_volume" :: held 2.822s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:15 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd440c1a-f83d-45f2-a570-d76efaf1c3ac tempest-ProjectMemberTests-73797185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:58:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cd440c1a-f83d-45f2-a570-d76efaf1c3ac tempest-ProjectMemberTests-73797185 None] Flow 'volume_create_manager' (008afa7a-f9eb-4d13-a210-260745f1577d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:58:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cd440c1a-f83d-45f2-a570-d76efaf1c3ac tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2d23427-71b5-404e-a813-b90669c337f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cd440c1a-f83d-45f2-a570-d76efaf1c3ac tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2d23427-71b5-404e-a813-b90669c337f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-344960422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71eb7a63-27ef-4d97-97b9-fc3df9be4b8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410ede866c9145df8444c3a398ace8b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:58:16Z,use_quota=True,user_id='5f5ae65b4a584ede952a5bfc00c9a49d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cd440c1a-f83d-45f2-a570-d76efaf1c3ac tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a824cda3-b4d3-4ba0-a52a-eaca4035002d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cd440c1a-f83d-45f2-a570-d76efaf1c3ac tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a824cda3-b4d3-4ba0-a52a-eaca4035002d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cd440c1a-f83d-45f2-a570-d76efaf1c3ac tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aa30a2a-3a74-4f9d-80cd-b22f5967af92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cd440c1a-f83d-45f2-a570-d76efaf1c3ac tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aa30a2a-3a74-4f9d-80cd-b22f5967af92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71eb7a63-27ef-4d97-97b9-fc3df9be4b8b', 'volume_name': 'volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cd440c1a-f83d-45f2-a570-d76efaf1c3ac tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85cc041f-ab37-49e5-bc4e-fba5fc3fa632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cd440c1a-f83d-45f2-a570-d76efaf1c3ac tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85cc041f-ab37-49e5-bc4e-fba5fc3fa632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:15 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cd440c1a-f83d-45f2-a570-d76efaf1c3ac tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2421cca4-4313-4354-93eb-fb518f91683b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:15 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-cd440c1a-f83d-45f2-a570-d76efaf1c3ac tempest-ProjectMemberTests-73797185 None] Volume 71eb7a63-27ef-4d97-97b9-fc3df9be4b8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b', 'volume_size': 1} Jul 08 01:58:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-cd440c1a-f83d-45f2-a570-d76efaf1c3ac tempest-ProjectMemberTests-73797185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-cd440c1a-f83d-45f2-a570-d76efaf1c3ac tempest-ProjectMemberTests-73797185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:15 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-cd440c1a-f83d-45f2-a570-d76efaf1c3ac tempest-ProjectMemberTests-73797185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-344960422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71eb7a63-27ef-4d97-97b9-fc3df9be4b8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410ede866c9145df8444c3a398ace8b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:58:16Z,use_quota=True,user_id='5f5ae65b4a584ede952a5bfc00c9a49d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:58:15 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-cd440c1a-f83d-45f2-a570-d76efaf1c3ac tempest-ProjectMemberTests-73797185 None] Creating volume 71eb7a63-27ef-4d97-97b9-fc3df9be4b8b {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:58:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-cd440c1a-f83d-45f2-a570-d76efaf1c3ac tempest-ProjectMemberTests-73797185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-cd440c1a-f83d-45f2-a570-d76efaf1c3ac tempest-ProjectMemberTests-73797185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:15 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-cd440c1a-f83d-45f2-a570-d76efaf1c3ac tempest-ProjectMemberTests-73797185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:58:15 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-cd440c1a-f83d-45f2-a570-d76efaf1c3ac tempest-ProjectMemberTests-73797185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:58:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-cd440c1a-f83d-45f2-a570-d76efaf1c3ac tempest-ProjectMemberTests-73797185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:15 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-cd440c1a-f83d-45f2-a570-d76efaf1c3ac tempest-ProjectMemberTests-73797185 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:58:15 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-cd440c1a-f83d-45f2-a570-d76efaf1c3ac tempest-ProjectMemberTests-73797185 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:58:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cd440c1a-f83d-45f2-a570-d76efaf1c3ac tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:16 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b 1073741824 Jul 08 01:58:16 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:16 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cd440c1a-f83d-45f2-a570-d76efaf1c3ac tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b 1073741824" returned: 0 in 0.947s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cd440c1a-f83d-45f2-a570-d76efaf1c3ac tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:17 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b Jul 08 01:58:17 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:17 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-cd440c1a-f83d-45f2-a570-d76efaf1c3ac tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b" returned: 0 in 0.777s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:17 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-cd440c1a-f83d-45f2-a570-d76efaf1c3ac tempest-ProjectMemberTests-73797185 None] <== create_volume: return (1791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:58:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-cd440c1a-f83d-45f2-a570-d76efaf1c3ac tempest-ProjectMemberTests-73797185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:17 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cd440c1a-f83d-45f2-a570-d76efaf1c3ac tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2421cca4-4313-4354-93eb-fb518f91683b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:17 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cd440c1a-f83d-45f2-a570-d76efaf1c3ac tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e8b09b1-9cf7-4cfd-9982-a1e047dab250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:17 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-cd440c1a-f83d-45f2-a570-d76efaf1c3ac tempest-ProjectMemberTests-73797185 None] Volume volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b (71eb7a63-27ef-4d97-97b9-fc3df9be4b8b): created successfully Jul 08 01:58:17 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cd440c1a-f83d-45f2-a570-d76efaf1c3ac tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e8b09b1-9cf7-4cfd-9982-a1e047dab250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:17 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-cd440c1a-f83d-45f2-a570-d76efaf1c3ac tempest-ProjectMemberTests-73797185 None] Flow 'volume_create_manager' (008afa7a-f9eb-4d13-a210-260745f1577d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:58:17 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-cd440c1a-f83d-45f2-a570-d76efaf1c3ac tempest-ProjectMemberTests-73797185 None] Created volume successfully. Jul 08 01:58:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2bb217dd-c2c5-48bf-8b0a-504117af966b tempest-ProjectMemberTests-73797185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2bb217dd-c2c5-48bf-8b0a-504117af966b tempest-ProjectMemberTests-73797185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:19 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-2bb217dd-c2c5-48bf-8b0a-504117af966b tempest-ProjectMemberTests-73797185 None] Creating offline snapshot cb82bc86-1330-4ba8-a531-d6e68880c217 of volume 71eb7a63-27ef-4d97-97b9-fc3df9be4b8b {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:58:19 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3dcf893-efe3-4b15-8507-0174ec722ac1]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:58:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2bb217dd-c2c5-48bf-8b0a-504117af966b tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:19 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b Jul 08 01:58:19 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:20 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2bb217dd-c2c5-48bf-8b0a-504117af966b tempest-ProjectMemberTests-73797185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b" returned: 0 in 0.976s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2bb217dd-c2c5-48bf-8b0a-504117af966b tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b.cb82bc86-1330-4ba8-a531-d6e68880c217 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:20 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b.cb82bc86-1330-4ba8-a531-d6e68880c217 1G Jul 08 01:58:20 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:21 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2bb217dd-c2c5-48bf-8b0a-504117af966b tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b.cb82bc86-1330-4ba8-a531-d6e68880c217 1G" returned: 0 in 0.878s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2bb217dd-c2c5-48bf-8b0a-504117af966b tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b.cb82bc86-1330-4ba8-a531-d6e68880c217 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:21 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b.cb82bc86-1330-4ba8-a531-d6e68880c217 Jul 08 01:58:21 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:21 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2bb217dd-c2c5-48bf-8b0a-504117af966b tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b.cb82bc86-1330-4ba8-a531-d6e68880c217" returned: 0 in 0.783s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:21 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-2bb217dd-c2c5-48bf-8b0a-504117af966b tempest-ProjectMemberTests-73797185 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b.cb82bc86-1330-4ba8-a531-d6e68880c217 is being set with open permissions: ugo+rw Jul 08 01:58:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2bb217dd-c2c5-48bf-8b0a-504117af966b tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b.cb82bc86-1330-4ba8-a531-d6e68880c217 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:21 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b.cb82bc86-1330-4ba8-a531-d6e68880c217 Jul 08 01:58:21 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:22 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2bb217dd-c2c5-48bf-8b0a-504117af966b tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b.cb82bc86-1330-4ba8-a531-d6e68880c217" returned: 0 in 0.721s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:22 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=111,cinder:UPDATE=159,cinder:INSERT=37,cinder:DELETE=10 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:58:22 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=116,cinder:UPDATE=140,cinder:DELETE=14,cinder:INSERT=44 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:58:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2bb217dd-c2c5-48bf-8b0a-504117af966b tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:22 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b.info Jul 08 01:58:22 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:23 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2bb217dd-c2c5-48bf-8b0a-504117af966b tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b.info" returned: 0 in 0.761s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:23 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-2bb217dd-c2c5-48bf-8b0a-504117af966b tempest-ProjectMemberTests-73797185 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b.info is being set with open permissions: ugo+rw Jul 08 01:58:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2bb217dd-c2c5-48bf-8b0a-504117af966b tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:23 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b.info Jul 08 01:58:23 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:24 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2bb217dd-c2c5-48bf-8b0a-504117af966b tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b.info" returned: 0 in 0.674s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-2bb217dd-c2c5-48bf-8b0a-504117af966b tempest-ProjectMemberTests-73797185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.904s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:24 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-2bb217dd-c2c5-48bf-8b0a-504117af966b tempest-ProjectMemberTests-73797185 None] Create snapshot completed successfully Jul 08 01:58:24 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2498e19e-690c-4b10-a59a-f005734c44d8 tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-cb82bc86-1330-4ba8-a531-d6e68880c217-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:24 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2498e19e-690c-4b10-a59a-f005734c44d8 tempest-ProjectMemberTests-73797185 None] Lock "cinder-cb82bc86-1330-4ba8-a531-d6e68880c217-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:24 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2498e19e-690c-4b10-a59a-f005734c44d8 tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-quobyte-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:24 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2498e19e-690c-4b10-a59a-f005734c44d8 tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:24 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2498e19e-690c-4b10-a59a-f005734c44d8 tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-quobyte-cb82bc86-1330-4ba8-a531-d6e68880c217" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:24 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2498e19e-690c-4b10-a59a-f005734c44d8 tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-cb82bc86-1330-4ba8-a531-d6e68880c217" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:24 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-2498e19e-690c-4b10-a59a-f005734c44d8 tempest-ProjectMemberTests-73797185 None] Deleting offline snapshot cb82bc86-1330-4ba8-a531-d6e68880c217 of volume 71eb7a63-27ef-4d97-97b9-fc3df9be4b8b {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:58:24 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-2498e19e-690c-4b10-a59a-f005734c44d8 tempest-ProjectMemberTests-73797185 None] snapshot_file for this snap is: volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b.cb82bc86-1330-4ba8-a531-d6e68880c217 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:58:24 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdaf3b88-261c-4a41-983d-77b7867da4cd]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:58:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2498e19e-690c-4b10-a59a-f005734c44d8 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b.cb82bc86-1330-4ba8-a531-d6e68880c217 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:24 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b.cb82bc86-1330-4ba8-a531-d6e68880c217 Jul 08 01:58:24 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:25 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2498e19e-690c-4b10-a59a-f005734c44d8 tempest-ProjectMemberTests-73797185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b.cb82bc86-1330-4ba8-a531-d6e68880c217" returned: 0 in 0.877s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:25 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-2498e19e-690c-4b10-a59a-f005734c44d8 tempest-ProjectMemberTests-73797185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:58:25 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b762d31-8c41-458e-9923-87f4843fa76e]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:58:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2498e19e-690c-4b10-a59a-f005734c44d8 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:25 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b Jul 08 01:58:25 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:26 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2498e19e-690c-4b10-a59a-f005734c44d8 tempest-ProjectMemberTests-73797185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b" returned: 0 in 0.863s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2498e19e-690c-4b10-a59a-f005734c44d8 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b.cb82bc86-1330-4ba8-a531-d6e68880c217 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:26 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b.cb82bc86-1330-4ba8-a531-d6e68880c217 Jul 08 01:58:26 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:27 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2498e19e-690c-4b10-a59a-f005734c44d8 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b.cb82bc86-1330-4ba8-a531-d6e68880c217" returned: 0 in 0.910s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2498e19e-690c-4b10-a59a-f005734c44d8 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b.cb82bc86-1330-4ba8-a531-d6e68880c217 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:27 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b.cb82bc86-1330-4ba8-a531-d6e68880c217 Jul 08 01:58:27 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:28 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2498e19e-690c-4b10-a59a-f005734c44d8 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b.cb82bc86-1330-4ba8-a531-d6e68880c217" returned: 0 in 0.842s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:28 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2498e19e-690c-4b10-a59a-f005734c44d8 tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-cb82bc86-1330-4ba8-a531-d6e68880c217" released by "_delete_snapshot" :: held 3.614s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:28 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2498e19e-690c-4b10-a59a-f005734c44d8 tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b" released by "delete_snapshot" :: held 3.650s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:28 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-2498e19e-690c-4b10-a59a-f005734c44d8 tempest-ProjectMemberTests-73797185 None] Created reservations ['1dfd7da7-31e1-4dda-a76f-ccc39b242b64', '2a67383c-9835-4986-afc5-ac78c88f8d7c', 'a602e351-8bbb-43d2-926f-a7f9e7335327', '649ce4db-736c-49ea-b220-d1712b5e65f0'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:58:28 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-2498e19e-690c-4b10-a59a-f005734c44d8 tempest-ProjectMemberTests-73797185 None] Delete snapshot completed successfully. Jul 08 01:58:28 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2498e19e-690c-4b10-a59a-f005734c44d8 tempest-ProjectMemberTests-73797185 None] Lock "cinder-cb82bc86-1330-4ba8-a531-d6e68880c217-delete_snapshot" released by "delete_snapshot" :: held 3.851s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:28 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6c5ddacf-1711-4ac9-a301-a397ab5f2561 tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:28 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6c5ddacf-1711-4ac9-a301-a397ab5f2561 tempest-ProjectMemberTests-73797185 None] Lock "cinder-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:28 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6c5ddacf-1711-4ac9-a301-a397ab5f2561 tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-quobyte-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:28 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6c5ddacf-1711-4ac9-a301-a397ab5f2561 tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b" acquired by "delete_volume" :: waited 0.019s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:29 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[d664f1c0-23df-4e54-a242-4b28ee877e83]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:58:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6c5ddacf-1711-4ac9-a301-a397ab5f2561 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:29 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b Jul 08 01:58:29 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:29 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6c5ddacf-1711-4ac9-a301-a397ab5f2561 tempest-ProjectMemberTests-73797185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b" returned: 0 in 0.956s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6c5ddacf-1711-4ac9-a301-a397ab5f2561 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:30 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b Jul 08 01:58:30 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:30 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6c5ddacf-1711-4ac9-a301-a397ab5f2561 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b" returned: 0 in 0.741s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:30 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6c5ddacf-1711-4ac9-a301-a397ab5f2561 tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b" released by "delete_volume" :: held 1.777s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:30 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-6c5ddacf-1711-4ac9-a301-a397ab5f2561 tempest-ProjectMemberTests-73797185 None] Created reservations ['d58db80a-386a-49b0-ad9d-c5b83c960776', 'dd715f64-60b9-4c20-86f8-c10728941205', 'baaeef88-84d7-4c69-9c44-6080c0997de5', '4eddf5ec-3989-4357-a5ed-2f8c48ff9e2f'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:58:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6c5ddacf-1711-4ac9-a301-a397ab5f2561 tempest-ProjectMemberTests-73797185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6c5ddacf-1711-4ac9-a301-a397ab5f2561 tempest-ProjectMemberTests-73797185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:30 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-6c5ddacf-1711-4ac9-a301-a397ab5f2561 tempest-ProjectMemberTests-73797185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:58:30 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-6c5ddacf-1711-4ac9-a301-a397ab5f2561 tempest-ProjectMemberTests-73797185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:58:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-6c5ddacf-1711-4ac9-a301-a397ab5f2561 tempest-ProjectMemberTests-73797185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6c5ddacf-1711-4ac9-a301-a397ab5f2561 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:30 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:58:30 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:31 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ca82f3f-e7a2-47ba-9d97-c247715a96be tempest-ProjectMemberTests-73797185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:58:31 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1ca82f3f-e7a2-47ba-9d97-c247715a96be tempest-ProjectMemberTests-73797185 None] Flow 'volume_create_manager' (a045bbe8-273d-4a99-81e8-49e7c4b901b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:58:31 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1ca82f3f-e7a2-47ba-9d97-c247715a96be tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afa6e41b-eb30-4f67-aeab-3f9faba8ec5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:31 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1ca82f3f-e7a2-47ba-9d97-c247715a96be tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afa6e41b-eb30-4f67-aeab-3f9faba8ec5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1482110270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64202599-c345-4d4f-a5f3-7827c0cc6e2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410ede866c9145df8444c3a398ace8b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:58:32Z,use_quota=True,user_id='5f5ae65b4a584ede952a5bfc00c9a49d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:31 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1ca82f3f-e7a2-47ba-9d97-c247715a96be tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17f960c0-9e39-4b87-8eea-55d1246a5d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:31 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1ca82f3f-e7a2-47ba-9d97-c247715a96be tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17f960c0-9e39-4b87-8eea-55d1246a5d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:31 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1ca82f3f-e7a2-47ba-9d97-c247715a96be tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd68b7e5-8368-4659-aa2e-ec0a01d69ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:31 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1ca82f3f-e7a2-47ba-9d97-c247715a96be tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd68b7e5-8368-4659-aa2e-ec0a01d69ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64202599-c345-4d4f-a5f3-7827c0cc6e2c', 'volume_name': 'volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:31 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:31 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1ca82f3f-e7a2-47ba-9d97-c247715a96be tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95e89f2a-1767-413c-9fea-c80909790e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:31 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1ca82f3f-e7a2-47ba-9d97-c247715a96be tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95e89f2a-1767-413c-9fea-c80909790e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:31 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1ca82f3f-e7a2-47ba-9d97-c247715a96be tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00e1755e-26ab-4952-8439-43a6f4de056e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:31 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-1ca82f3f-e7a2-47ba-9d97-c247715a96be tempest-ProjectMemberTests-73797185 None] Volume 64202599-c345-4d4f-a5f3-7827c0cc6e2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c', 'volume_size': 1} Jul 08 01:58:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-1ca82f3f-e7a2-47ba-9d97-c247715a96be tempest-ProjectMemberTests-73797185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-1ca82f3f-e7a2-47ba-9d97-c247715a96be tempest-ProjectMemberTests-73797185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:31 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-1ca82f3f-e7a2-47ba-9d97-c247715a96be tempest-ProjectMemberTests-73797185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1482110270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64202599-c345-4d4f-a5f3-7827c0cc6e2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410ede866c9145df8444c3a398ace8b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:58:32Z,use_quota=True,user_id='5f5ae65b4a584ede952a5bfc00c9a49d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:58:31 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-1ca82f3f-e7a2-47ba-9d97-c247715a96be tempest-ProjectMemberTests-73797185 None] Creating volume 64202599-c345-4d4f-a5f3-7827c0cc6e2c {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:58:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-1ca82f3f-e7a2-47ba-9d97-c247715a96be tempest-ProjectMemberTests-73797185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-1ca82f3f-e7a2-47ba-9d97-c247715a96be tempest-ProjectMemberTests-73797185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:31 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-1ca82f3f-e7a2-47ba-9d97-c247715a96be tempest-ProjectMemberTests-73797185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:58:31 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-1ca82f3f-e7a2-47ba-9d97-c247715a96be tempest-ProjectMemberTests-73797185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:58:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-1ca82f3f-e7a2-47ba-9d97-c247715a96be tempest-ProjectMemberTests-73797185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:31 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-1ca82f3f-e7a2-47ba-9d97-c247715a96be tempest-ProjectMemberTests-73797185 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:58:31 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-1ca82f3f-e7a2-47ba-9d97-c247715a96be tempest-ProjectMemberTests-73797185 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:58:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1ca82f3f-e7a2-47ba-9d97-c247715a96be tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-6c5ddacf-1711-4ac9-a301-a397ab5f2561 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.908s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:31 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-6c5ddacf-1711-4ac9-a301-a397ab5f2561 tempest-ProjectMemberTests-73797185 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:58:31 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-6c5ddacf-1711-4ac9-a301-a397ab5f2561 tempest-ProjectMemberTests-73797185 None] Deleted volume successfully. Jul 08 01:58:31 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c 1073741824 Jul 08 01:58:31 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:31 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-6c5ddacf-1711-4ac9-a301-a397ab5f2561 tempest-ProjectMemberTests-73797185 None] Lock "cinder-71eb7a63-27ef-4d97-97b9-fc3df9be4b8b-delete_volume" released by "delete_volume" :: held 2.981s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:32 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1ca82f3f-e7a2-47ba-9d97-c247715a96be tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c 1073741824" returned: 0 in 1.006s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:32 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1ca82f3f-e7a2-47ba-9d97-c247715a96be tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:32 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c Jul 08 01:58:32 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:33 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1ca82f3f-e7a2-47ba-9d97-c247715a96be tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c" returned: 0 in 0.801s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:33 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-1ca82f3f-e7a2-47ba-9d97-c247715a96be tempest-ProjectMemberTests-73797185 None] <== create_volume: return (1861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:58:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-1ca82f3f-e7a2-47ba-9d97-c247715a96be tempest-ProjectMemberTests-73797185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.864s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:33 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1ca82f3f-e7a2-47ba-9d97-c247715a96be tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00e1755e-26ab-4952-8439-43a6f4de056e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:33 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1ca82f3f-e7a2-47ba-9d97-c247715a96be tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8be85dc2-f5d5-4c44-a39a-37125e7432ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:33 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-1ca82f3f-e7a2-47ba-9d97-c247715a96be tempest-ProjectMemberTests-73797185 None] Volume volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c (64202599-c345-4d4f-a5f3-7827c0cc6e2c): created successfully Jul 08 01:58:33 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1ca82f3f-e7a2-47ba-9d97-c247715a96be tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8be85dc2-f5d5-4c44-a39a-37125e7432ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:33 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-1ca82f3f-e7a2-47ba-9d97-c247715a96be tempest-ProjectMemberTests-73797185 None] Flow 'volume_create_manager' (a045bbe8-273d-4a99-81e8-49e7c4b901b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:58:33 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-1ca82f3f-e7a2-47ba-9d97-c247715a96be tempest-ProjectMemberTests-73797185 None] Created volume successfully. Jul 08 01:58:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-1b0129ed-794c-4620-acd8-2bf796734f65 tempest-ProjectMemberTests-73797185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-1b0129ed-794c-4620-acd8-2bf796734f65 tempest-ProjectMemberTests-73797185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:35 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-1b0129ed-794c-4620-acd8-2bf796734f65 tempest-ProjectMemberTests-73797185 None] Creating offline snapshot 2ec2c547-62b3-4b4a-aaae-0bd57d8c9117 of volume 64202599-c345-4d4f-a5f3-7827c0cc6e2c {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:58:35 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51724ac-ec58-4a4d-8a99-dd40217c904e]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:58:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1b0129ed-794c-4620-acd8-2bf796734f65 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:35 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c Jul 08 01:58:35 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:35 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1b0129ed-794c-4620-acd8-2bf796734f65 tempest-ProjectMemberTests-73797185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c" returned: 0 in 0.870s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1b0129ed-794c-4620-acd8-2bf796734f65 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c.2ec2c547-62b3-4b4a-aaae-0bd57d8c9117 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:36 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c.2ec2c547-62b3-4b4a-aaae-0bd57d8c9117 1G Jul 08 01:58:36 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:36 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1b0129ed-794c-4620-acd8-2bf796734f65 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c.2ec2c547-62b3-4b4a-aaae-0bd57d8c9117 1G" returned: 0 in 0.939s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1b0129ed-794c-4620-acd8-2bf796734f65 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c.2ec2c547-62b3-4b4a-aaae-0bd57d8c9117 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:36 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c.2ec2c547-62b3-4b4a-aaae-0bd57d8c9117 Jul 08 01:58:36 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:37 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1b0129ed-794c-4620-acd8-2bf796734f65 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c.2ec2c547-62b3-4b4a-aaae-0bd57d8c9117" returned: 0 in 0.738s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:37 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-1b0129ed-794c-4620-acd8-2bf796734f65 tempest-ProjectMemberTests-73797185 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c.2ec2c547-62b3-4b4a-aaae-0bd57d8c9117 is being set with open permissions: ugo+rw Jul 08 01:58:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1b0129ed-794c-4620-acd8-2bf796734f65 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c.2ec2c547-62b3-4b4a-aaae-0bd57d8c9117 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:37 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c.2ec2c547-62b3-4b4a-aaae-0bd57d8c9117 Jul 08 01:58:37 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:38 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1b0129ed-794c-4620-acd8-2bf796734f65 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c.2ec2c547-62b3-4b4a-aaae-0bd57d8c9117" returned: 0 in 0.755s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1b0129ed-794c-4620-acd8-2bf796734f65 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:38 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c.info Jul 08 01:58:38 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:39 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1b0129ed-794c-4620-acd8-2bf796734f65 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c.info" returned: 0 in 0.751s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:39 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-1b0129ed-794c-4620-acd8-2bf796734f65 tempest-ProjectMemberTests-73797185 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c.info is being set with open permissions: ugo+rw Jul 08 01:58:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1b0129ed-794c-4620-acd8-2bf796734f65 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:39 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c.info Jul 08 01:58:39 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:39 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1b0129ed-794c-4620-acd8-2bf796734f65 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c.info" returned: 0 in 0.687s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-1b0129ed-794c-4620-acd8-2bf796734f65 tempest-ProjectMemberTests-73797185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.834s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:39 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-1b0129ed-794c-4620-acd8-2bf796734f65 tempest-ProjectMemberTests-73797185 None] Create snapshot completed successfully Jul 08 01:58:40 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d3003049-eed8-4978-a05e-93c7e20f179c tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-2ec2c547-62b3-4b4a-aaae-0bd57d8c9117-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:40 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d3003049-eed8-4978-a05e-93c7e20f179c tempest-ProjectMemberTests-73797185 None] Lock "cinder-2ec2c547-62b3-4b4a-aaae-0bd57d8c9117-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:40 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d3003049-eed8-4978-a05e-93c7e20f179c tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-quobyte-64202599-c345-4d4f-a5f3-7827c0cc6e2c" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:40 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d3003049-eed8-4978-a05e-93c7e20f179c tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-64202599-c345-4d4f-a5f3-7827c0cc6e2c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:40 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d3003049-eed8-4978-a05e-93c7e20f179c tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-quobyte-2ec2c547-62b3-4b4a-aaae-0bd57d8c9117" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:40 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d3003049-eed8-4978-a05e-93c7e20f179c tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-2ec2c547-62b3-4b4a-aaae-0bd57d8c9117" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:40 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-d3003049-eed8-4978-a05e-93c7e20f179c tempest-ProjectMemberTests-73797185 None] Deleting offline snapshot 2ec2c547-62b3-4b4a-aaae-0bd57d8c9117 of volume 64202599-c345-4d4f-a5f3-7827c0cc6e2c {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:58:40 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-d3003049-eed8-4978-a05e-93c7e20f179c tempest-ProjectMemberTests-73797185 None] snapshot_file for this snap is: volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c.2ec2c547-62b3-4b4a-aaae-0bd57d8c9117 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:58:40 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c9b5c2-cefa-4ab1-99c5-56f56f612964]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:58:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d3003049-eed8-4978-a05e-93c7e20f179c tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c.2ec2c547-62b3-4b4a-aaae-0bd57d8c9117 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:40 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c.2ec2c547-62b3-4b4a-aaae-0bd57d8c9117 Jul 08 01:58:40 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:41 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d3003049-eed8-4978-a05e-93c7e20f179c tempest-ProjectMemberTests-73797185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c.2ec2c547-62b3-4b4a-aaae-0bd57d8c9117" returned: 0 in 0.864s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:41 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-d3003049-eed8-4978-a05e-93c7e20f179c tempest-ProjectMemberTests-73797185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:58:41 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2109185-db02-4fb1-a221-48ec26d90e75]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:58:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d3003049-eed8-4978-a05e-93c7e20f179c tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:41 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c Jul 08 01:58:41 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:42 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d3003049-eed8-4978-a05e-93c7e20f179c tempest-ProjectMemberTests-73797185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c" returned: 0 in 0.909s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d3003049-eed8-4978-a05e-93c7e20f179c tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c.2ec2c547-62b3-4b4a-aaae-0bd57d8c9117 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:42 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c.2ec2c547-62b3-4b4a-aaae-0bd57d8c9117 Jul 08 01:58:42 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:43 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d3003049-eed8-4978-a05e-93c7e20f179c tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c.2ec2c547-62b3-4b4a-aaae-0bd57d8c9117" returned: 0 in 0.916s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:43 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d3003049-eed8-4978-a05e-93c7e20f179c tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c.2ec2c547-62b3-4b4a-aaae-0bd57d8c9117 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:43 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c.2ec2c547-62b3-4b4a-aaae-0bd57d8c9117 Jul 08 01:58:43 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:44 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-d3003049-eed8-4978-a05e-93c7e20f179c tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c.2ec2c547-62b3-4b4a-aaae-0bd57d8c9117" returned: 0 in 0.817s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:44 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d3003049-eed8-4978-a05e-93c7e20f179c tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-2ec2c547-62b3-4b4a-aaae-0bd57d8c9117" released by "_delete_snapshot" :: held 3.630s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:44 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d3003049-eed8-4978-a05e-93c7e20f179c tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-64202599-c345-4d4f-a5f3-7827c0cc6e2c" released by "delete_snapshot" :: held 3.657s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:44 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-d3003049-eed8-4978-a05e-93c7e20f179c tempest-ProjectMemberTests-73797185 None] Created reservations ['da5e2597-d073-4678-878c-b4c569f9592b', '75a9e3c4-f672-4bf0-9a5e-843fe1f58825', '766931f4-35f1-4f5f-949a-c91fab615243', '1d97b63b-fc67-4d9f-9cc4-a6c8748e0504'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:58:44 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-d3003049-eed8-4978-a05e-93c7e20f179c tempest-ProjectMemberTests-73797185 None] Delete snapshot completed successfully. Jul 08 01:58:44 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-d3003049-eed8-4978-a05e-93c7e20f179c tempest-ProjectMemberTests-73797185 None] Lock "cinder-2ec2c547-62b3-4b4a-aaae-0bd57d8c9117-delete_snapshot" released by "delete_snapshot" :: held 3.846s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:44 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1336603e-d81f-4f1d-8ae2-6b06c550c44a tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-64202599-c345-4d4f-a5f3-7827c0cc6e2c-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:44 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1336603e-d81f-4f1d-8ae2-6b06c550c44a tempest-ProjectMemberTests-73797185 None] Lock "cinder-64202599-c345-4d4f-a5f3-7827c0cc6e2c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:44 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1336603e-d81f-4f1d-8ae2-6b06c550c44a tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-quobyte-64202599-c345-4d4f-a5f3-7827c0cc6e2c" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:44 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1336603e-d81f-4f1d-8ae2-6b06c550c44a tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-64202599-c345-4d4f-a5f3-7827c0cc6e2c" acquired by "delete_volume" :: waited 0.018s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:44 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a053bc5-c9d8-4306-8203-b3ede8333df8]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:58:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1336603e-d81f-4f1d-8ae2-6b06c550c44a tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:44 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c Jul 08 01:58:44 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:45 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1336603e-d81f-4f1d-8ae2-6b06c550c44a tempest-ProjectMemberTests-73797185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c" returned: 0 in 0.972s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1336603e-d81f-4f1d-8ae2-6b06c550c44a tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:45 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c Jul 08 01:58:45 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:46 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1336603e-d81f-4f1d-8ae2-6b06c550c44a tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-64202599-c345-4d4f-a5f3-7827c0cc6e2c" returned: 0 in 0.811s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:46 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1336603e-d81f-4f1d-8ae2-6b06c550c44a tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-64202599-c345-4d4f-a5f3-7827c0cc6e2c" released by "delete_volume" :: held 1.871s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:46 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-1336603e-d81f-4f1d-8ae2-6b06c550c44a tempest-ProjectMemberTests-73797185 None] Created reservations ['c47cbde4-c019-43dc-a2bb-fbf7e7d58265', '07321498-80fe-4d38-a5a2-91a84b6b2063', 'fc125f19-6cc9-46ee-bdca-d933d7963291', '7bce9d7f-42ab-4e90-ab94-bf263822f48d'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:58:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-1336603e-d81f-4f1d-8ae2-6b06c550c44a tempest-ProjectMemberTests-73797185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-1336603e-d81f-4f1d-8ae2-6b06c550c44a tempest-ProjectMemberTests-73797185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:46 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-1336603e-d81f-4f1d-8ae2-6b06c550c44a tempest-ProjectMemberTests-73797185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:58:46 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-1336603e-d81f-4f1d-8ae2-6b06c550c44a tempest-ProjectMemberTests-73797185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:58:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-1336603e-d81f-4f1d-8ae2-6b06c550c44a tempest-ProjectMemberTests-73797185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1336603e-d81f-4f1d-8ae2-6b06c550c44a tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:46 devstack sudo[106121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:58:46 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:47 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2976f5f-7c69-484d-b3c1-d57754088df1 tempest-ProjectMemberTests-73797185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:58:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a2976f5f-7c69-484d-b3c1-d57754088df1 tempest-ProjectMemberTests-73797185 None] Flow 'volume_create_manager' (5beb8e9c-9be2-4a32-a819-568cef941828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:58:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a2976f5f-7c69-484d-b3c1-d57754088df1 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd69599e-dc40-4599-9b8d-6757469ce1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a2976f5f-7c69-484d-b3c1-d57754088df1 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd69599e-dc40-4599-9b8d-6757469ce1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1461532884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b910eb6-4f6b-422d-8370-db99f91cd84e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410ede866c9145df8444c3a398ace8b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:58:48Z,use_quota=True,user_id='5f5ae65b4a584ede952a5bfc00c9a49d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a2976f5f-7c69-484d-b3c1-d57754088df1 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd5b9aed-5d8e-4556-98db-0c5e8a2a15fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a2976f5f-7c69-484d-b3c1-d57754088df1 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd5b9aed-5d8e-4556-98db-0c5e8a2a15fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a2976f5f-7c69-484d-b3c1-d57754088df1 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d8211e9-4c75-44bf-b987-94ad51c4c693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a2976f5f-7c69-484d-b3c1-d57754088df1 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d8211e9-4c75-44bf-b987-94ad51c4c693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b910eb6-4f6b-422d-8370-db99f91cd84e', 'volume_name': 'volume-1b910eb6-4f6b-422d-8370-db99f91cd84e', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a2976f5f-7c69-484d-b3c1-d57754088df1 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faf3f43f-6bab-4051-9d12-bd78cd1cb1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a2976f5f-7c69-484d-b3c1-d57754088df1 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faf3f43f-6bab-4051-9d12-bd78cd1cb1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:47 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a2976f5f-7c69-484d-b3c1-d57754088df1 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1942ed06-6b7b-4981-a7fd-3c35c41d4565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:47 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-a2976f5f-7c69-484d-b3c1-d57754088df1 tempest-ProjectMemberTests-73797185 None] Volume 1b910eb6-4f6b-422d-8370-db99f91cd84e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b910eb6-4f6b-422d-8370-db99f91cd84e', 'volume_size': 1} Jul 08 01:58:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a2976f5f-7c69-484d-b3c1-d57754088df1 tempest-ProjectMemberTests-73797185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a2976f5f-7c69-484d-b3c1-d57754088df1 tempest-ProjectMemberTests-73797185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:47 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a2976f5f-7c69-484d-b3c1-d57754088df1 tempest-ProjectMemberTests-73797185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1461532884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b910eb6-4f6b-422d-8370-db99f91cd84e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410ede866c9145df8444c3a398ace8b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:58:48Z,use_quota=True,user_id='5f5ae65b4a584ede952a5bfc00c9a49d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:58:47 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-a2976f5f-7c69-484d-b3c1-d57754088df1 tempest-ProjectMemberTests-73797185 None] Creating volume 1b910eb6-4f6b-422d-8370-db99f91cd84e {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:58:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a2976f5f-7c69-484d-b3c1-d57754088df1 tempest-ProjectMemberTests-73797185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a2976f5f-7c69-484d-b3c1-d57754088df1 tempest-ProjectMemberTests-73797185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:47 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a2976f5f-7c69-484d-b3c1-d57754088df1 tempest-ProjectMemberTests-73797185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:58:47 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a2976f5f-7c69-484d-b3c1-d57754088df1 tempest-ProjectMemberTests-73797185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:58:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a2976f5f-7c69-484d-b3c1-d57754088df1 tempest-ProjectMemberTests-73797185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:47 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a2976f5f-7c69-484d-b3c1-d57754088df1 tempest-ProjectMemberTests-73797185 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:58:47 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-a2976f5f-7c69-484d-b3c1-d57754088df1 tempest-ProjectMemberTests-73797185 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:58:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a2976f5f-7c69-484d-b3c1-d57754088df1 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:47 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e 1073741824 Jul 08 01:58:47 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:47 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:47 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-1336603e-d81f-4f1d-8ae2-6b06c550c44a tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 1.030s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:47 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-1336603e-d81f-4f1d-8ae2-6b06c550c44a tempest-ProjectMemberTests-73797185 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:58:47 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-1336603e-d81f-4f1d-8ae2-6b06c550c44a tempest-ProjectMemberTests-73797185 None] Deleted volume successfully. Jul 08 01:58:48 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-1336603e-d81f-4f1d-8ae2-6b06c550c44a tempest-ProjectMemberTests-73797185 None] Lock "cinder-64202599-c345-4d4f-a5f3-7827c0cc6e2c-delete_volume" released by "delete_volume" :: held 3.293s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:48 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a2976f5f-7c69-484d-b3c1-d57754088df1 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e 1073741824" returned: 0 in 1.082s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:48 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a2976f5f-7c69-484d-b3c1-d57754088df1 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:48 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e Jul 08 01:58:48 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:49 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-a2976f5f-7c69-484d-b3c1-d57754088df1 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e" returned: 0 in 0.710s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:49 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-a2976f5f-7c69-484d-b3c1-d57754088df1 tempest-ProjectMemberTests-73797185 None] <== create_volume: return (1858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:58:49 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-a2976f5f-7c69-484d-b3c1-d57754088df1 tempest-ProjectMemberTests-73797185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.863s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a2976f5f-7c69-484d-b3c1-d57754088df1 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1942ed06-6b7b-4981-a7fd-3c35c41d4565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b910eb6-4f6b-422d-8370-db99f91cd84e', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a2976f5f-7c69-484d-b3c1-d57754088df1 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bdca3fb-f414-42df-b83c-508df24914c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:49 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-a2976f5f-7c69-484d-b3c1-d57754088df1 tempest-ProjectMemberTests-73797185 None] Volume volume-1b910eb6-4f6b-422d-8370-db99f91cd84e (1b910eb6-4f6b-422d-8370-db99f91cd84e): created successfully Jul 08 01:58:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a2976f5f-7c69-484d-b3c1-d57754088df1 tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bdca3fb-f414-42df-b83c-508df24914c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:49 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-a2976f5f-7c69-484d-b3c1-d57754088df1 tempest-ProjectMemberTests-73797185 None] Flow 'volume_create_manager' (5beb8e9c-9be2-4a32-a819-568cef941828) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:58:49 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-a2976f5f-7c69-484d-b3c1-d57754088df1 tempest-ProjectMemberTests-73797185 None] Created volume successfully. Jul 08 01:58:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-aa38732b-df8e-4723-b6d3-8b5cb55aa50f tempest-ProjectMemberTests-73797185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-aa38732b-df8e-4723-b6d3-8b5cb55aa50f tempest-ProjectMemberTests-73797185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:51 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-aa38732b-df8e-4723-b6d3-8b5cb55aa50f tempest-ProjectMemberTests-73797185 None] Creating offline snapshot 3e1b9eb3-6a42-438a-bf5c-b533a8e17c3b of volume 1b910eb6-4f6b-422d-8370-db99f91cd84e {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:58:51 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e75838-120a-4dec-b88c-c5162729630c]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:58:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-aa38732b-df8e-4723-b6d3-8b5cb55aa50f tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:51 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e Jul 08 01:58:51 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:51 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-aa38732b-df8e-4723-b6d3-8b5cb55aa50f tempest-ProjectMemberTests-73797185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e" returned: 0 in 0.811s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:51 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-aa38732b-df8e-4723-b6d3-8b5cb55aa50f tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e.3e1b9eb3-6a42-438a-bf5c-b533a8e17c3b 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:51 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e.3e1b9eb3-6a42-438a-bf5c-b533a8e17c3b 1G Jul 08 01:58:51 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:52 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-aa38732b-df8e-4723-b6d3-8b5cb55aa50f tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e.3e1b9eb3-6a42-438a-bf5c-b533a8e17c3b 1G" returned: 0 in 0.964s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:52 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-aa38732b-df8e-4723-b6d3-8b5cb55aa50f tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b910eb6-4f6b-422d-8370-db99f91cd84e -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e.3e1b9eb3-6a42-438a-bf5c-b533a8e17c3b {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:52 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b910eb6-4f6b-422d-8370-db99f91cd84e -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e.3e1b9eb3-6a42-438a-bf5c-b533a8e17c3b Jul 08 01:58:52 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:53 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-aa38732b-df8e-4723-b6d3-8b5cb55aa50f tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b910eb6-4f6b-422d-8370-db99f91cd84e -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e.3e1b9eb3-6a42-438a-bf5c-b533a8e17c3b" returned: 0 in 0.899s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:53 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-aa38732b-df8e-4723-b6d3-8b5cb55aa50f tempest-ProjectMemberTests-73797185 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e.3e1b9eb3-6a42-438a-bf5c-b533a8e17c3b is being set with open permissions: ugo+rw Jul 08 01:58:53 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-aa38732b-df8e-4723-b6d3-8b5cb55aa50f tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e.3e1b9eb3-6a42-438a-bf5c-b533a8e17c3b {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:53 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e.3e1b9eb3-6a42-438a-bf5c-b533a8e17c3b Jul 08 01:58:53 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:54 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-aa38732b-df8e-4723-b6d3-8b5cb55aa50f tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e.3e1b9eb3-6a42-438a-bf5c-b533a8e17c3b" returned: 0 in 0.758s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:54 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-aa38732b-df8e-4723-b6d3-8b5cb55aa50f tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:54 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e.info Jul 08 01:58:54 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:55 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:58:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:58:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:58:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:55 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:58:55 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:55 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-aa38732b-df8e-4723-b6d3-8b5cb55aa50f tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e.info" returned: 0 in 0.739s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:55 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-aa38732b-df8e-4723-b6d3-8b5cb55aa50f tempest-ProjectMemberTests-73797185 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e.info is being set with open permissions: ugo+rw Jul 08 01:58:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-aa38732b-df8e-4723-b6d3-8b5cb55aa50f tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:55 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e.info Jul 08 01:58:55 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:56 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.877s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:56 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:58:56 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager._thread_info {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:58:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread count: 29 {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:58:56 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread info: [<_MainThread(MainThread, started 127058402500736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:58:56 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-aa38732b-df8e-4723-b6d3-8b5cb55aa50f tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e.info" returned: 0 in 0.816s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-aa38732b-df8e-4723-b6d3-8b5cb55aa50f tempest-ProjectMemberTests-73797185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.095s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:56 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-aa38732b-df8e-4723-b6d3-8b5cb55aa50f tempest-ProjectMemberTests-73797185 None] Create snapshot completed successfully Jul 08 01:58:56 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2a74e688-c4b1-4c75-9daa-f7b058c45f06 tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-3e1b9eb3-6a42-438a-bf5c-b533a8e17c3b-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:56 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2a74e688-c4b1-4c75-9daa-f7b058c45f06 tempest-ProjectMemberTests-73797185 None] Lock "cinder-3e1b9eb3-6a42-438a-bf5c-b533a8e17c3b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:56 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2a74e688-c4b1-4c75-9daa-f7b058c45f06 tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-quobyte-1b910eb6-4f6b-422d-8370-db99f91cd84e" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:56 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2a74e688-c4b1-4c75-9daa-f7b058c45f06 tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-1b910eb6-4f6b-422d-8370-db99f91cd84e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:56 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2a74e688-c4b1-4c75-9daa-f7b058c45f06 tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-quobyte-3e1b9eb3-6a42-438a-bf5c-b533a8e17c3b" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:56 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2a74e688-c4b1-4c75-9daa-f7b058c45f06 tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-3e1b9eb3-6a42-438a-bf5c-b533a8e17c3b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:56 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-2a74e688-c4b1-4c75-9daa-f7b058c45f06 tempest-ProjectMemberTests-73797185 None] Deleting offline snapshot 3e1b9eb3-6a42-438a-bf5c-b533a8e17c3b of volume 1b910eb6-4f6b-422d-8370-db99f91cd84e {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:58:56 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-2a74e688-c4b1-4c75-9daa-f7b058c45f06 tempest-ProjectMemberTests-73797185 None] snapshot_file for this snap is: volume-1b910eb6-4f6b-422d-8370-db99f91cd84e.3e1b9eb3-6a42-438a-bf5c-b533a8e17c3b {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:58:56 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a3e2f4-6cfd-4469-a2a0-ff3a4e4db5bf]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:58:56 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2a74e688-c4b1-4c75-9daa-f7b058c45f06 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e.3e1b9eb3-6a42-438a-bf5c-b533a8e17c3b {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:56 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e.3e1b9eb3-6a42-438a-bf5c-b533a8e17c3b Jul 08 01:58:56 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:57 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2a74e688-c4b1-4c75-9daa-f7b058c45f06 tempest-ProjectMemberTests-73797185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e.3e1b9eb3-6a42-438a-bf5c-b533a8e17c3b" returned: 0 in 0.822s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:57 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-2a74e688-c4b1-4c75-9daa-f7b058c45f06 tempest-ProjectMemberTests-73797185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b910eb6-4f6b-422d-8370-db99f91cd84e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:58:57 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6572397-503c-4772-a56b-f483974545aa]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:58:57 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2a74e688-c4b1-4c75-9daa-f7b058c45f06 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:57 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e Jul 08 01:58:57 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:58 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2a74e688-c4b1-4c75-9daa-f7b058c45f06 tempest-ProjectMemberTests-73797185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e" returned: 0 in 0.890s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:58 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2a74e688-c4b1-4c75-9daa-f7b058c45f06 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e.3e1b9eb3-6a42-438a-bf5c-b533a8e17c3b {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:58 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e.3e1b9eb3-6a42-438a-bf5c-b533a8e17c3b Jul 08 01:58:58 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:59 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2a74e688-c4b1-4c75-9daa-f7b058c45f06 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e.3e1b9eb3-6a42-438a-bf5c-b533a8e17c3b" returned: 0 in 1.007s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2a74e688-c4b1-4c75-9daa-f7b058c45f06 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e.3e1b9eb3-6a42-438a-bf5c-b533a8e17c3b {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:59 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e.3e1b9eb3-6a42-438a-bf5c-b533a8e17c3b Jul 08 01:58:59 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:59 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:59 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2a74e688-c4b1-4c75-9daa-f7b058c45f06 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e.3e1b9eb3-6a42-438a-bf5c-b533a8e17c3b" returned: 0 in 0.700s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:59 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2a74e688-c4b1-4c75-9daa-f7b058c45f06 tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-3e1b9eb3-6a42-438a-bf5c-b533a8e17c3b" released by "_delete_snapshot" :: held 3.544s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:59 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2a74e688-c4b1-4c75-9daa-f7b058c45f06 tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-1b910eb6-4f6b-422d-8370-db99f91cd84e" released by "delete_snapshot" :: held 3.574s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:59:00 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-2a74e688-c4b1-4c75-9daa-f7b058c45f06 tempest-ProjectMemberTests-73797185 None] Created reservations ['a2c7069a-9252-40bf-927e-897e4dd4bbe2', '271e19f5-290c-4bfc-9706-a94e1b31dbd7', 'a529ee7a-9874-4e71-99b0-62dfe21c31ff', 'b3054a29-53a4-4c30-b5b6-be7dc21eee19'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:59:00 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-2a74e688-c4b1-4c75-9daa-f7b058c45f06 tempest-ProjectMemberTests-73797185 None] Delete snapshot completed successfully. Jul 08 01:59:00 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2a74e688-c4b1-4c75-9daa-f7b058c45f06 tempest-ProjectMemberTests-73797185 None] Lock "cinder-3e1b9eb3-6a42-438a-bf5c-b533a8e17c3b-delete_snapshot" released by "delete_snapshot" :: held 3.776s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:59:00 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee7142ff-a065-4e1f-96e7-08764ce56b7e tempest-SnapshotDependencyTests-448149245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:59:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ee7142ff-a065-4e1f-96e7-08764ce56b7e tempest-SnapshotDependencyTests-448149245 None] Flow 'volume_create_manager' (6f792d18-1085-457c-bdbf-ed7a87b05a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:59:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ee7142ff-a065-4e1f-96e7-08764ce56b7e tempest-SnapshotDependencyTests-448149245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05c37853-66fa-4fc2-8205-4ca53d9d2446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ee7142ff-a065-4e1f-96e7-08764ce56b7e tempest-SnapshotDependencyTests-448149245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05c37853-66fa-4fc2-8205-4ca53d9d2446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-89051733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdc81293-7647-4236-8240-7b9d25557788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c77414f543d14e6d9e16f57e5c02da14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:59:00Z,use_quota=True,user_id='3dc9219317d742dd8a79e656482a8f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ee7142ff-a065-4e1f-96e7-08764ce56b7e tempest-SnapshotDependencyTests-448149245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2d5a9d3-d607-4191-8407-f5aadc38b913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ee7142ff-a065-4e1f-96e7-08764ce56b7e tempest-SnapshotDependencyTests-448149245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2d5a9d3-d607-4191-8407-f5aadc38b913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ee7142ff-a065-4e1f-96e7-08764ce56b7e tempest-SnapshotDependencyTests-448149245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f726d7c0-57ff-4d4a-9b2d-9a126b0f4e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ee7142ff-a065-4e1f-96e7-08764ce56b7e tempest-SnapshotDependencyTests-448149245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f726d7c0-57ff-4d4a-9b2d-9a126b0f4e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdc81293-7647-4236-8240-7b9d25557788', 'volume_name': 'volume-bdc81293-7647-4236-8240-7b9d25557788', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ee7142ff-a065-4e1f-96e7-08764ce56b7e tempest-SnapshotDependencyTests-448149245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cb07845-8a32-484d-a3b7-646da70b2e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ee7142ff-a065-4e1f-96e7-08764ce56b7e tempest-SnapshotDependencyTests-448149245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cb07845-8a32-484d-a3b7-646da70b2e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:00 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ee7142ff-a065-4e1f-96e7-08764ce56b7e tempest-SnapshotDependencyTests-448149245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50ef1578-d24b-4609-90a1-fe5a750419fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:00 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-ee7142ff-a065-4e1f-96e7-08764ce56b7e tempest-SnapshotDependencyTests-448149245 None] Volume bdc81293-7647-4236-8240-7b9d25557788: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdc81293-7647-4236-8240-7b9d25557788', 'volume_size': 1} Jul 08 01:59:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ee7142ff-a065-4e1f-96e7-08764ce56b7e tempest-SnapshotDependencyTests-448149245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:59:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ee7142ff-a065-4e1f-96e7-08764ce56b7e tempest-SnapshotDependencyTests-448149245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:59:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-ee7142ff-a065-4e1f-96e7-08764ce56b7e tempest-SnapshotDependencyTests-448149245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-89051733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdc81293-7647-4236-8240-7b9d25557788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c77414f543d14e6d9e16f57e5c02da14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:59:00Z,use_quota=True,user_id='3dc9219317d742dd8a79e656482a8f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:59:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-ee7142ff-a065-4e1f-96e7-08764ce56b7e tempest-SnapshotDependencyTests-448149245 None] Creating volume bdc81293-7647-4236-8240-7b9d25557788 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:59:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ee7142ff-a065-4e1f-96e7-08764ce56b7e tempest-SnapshotDependencyTests-448149245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:59:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ee7142ff-a065-4e1f-96e7-08764ce56b7e tempest-SnapshotDependencyTests-448149245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:59:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-ee7142ff-a065-4e1f-96e7-08764ce56b7e tempest-SnapshotDependencyTests-448149245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:59:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-ee7142ff-a065-4e1f-96e7-08764ce56b7e tempest-SnapshotDependencyTests-448149245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:59:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ee7142ff-a065-4e1f-96e7-08764ce56b7e tempest-SnapshotDependencyTests-448149245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:59:00 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-ee7142ff-a065-4e1f-96e7-08764ce56b7e tempest-SnapshotDependencyTests-448149245 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:59:00 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-ee7142ff-a065-4e1f-96e7-08764ce56b7e tempest-SnapshotDependencyTests-448149245 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:59:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ee7142ff-a065-4e1f-96e7-08764ce56b7e tempest-SnapshotDependencyTests-448149245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:00 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788 1073741824 Jul 08 01:59:00 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:00 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c983e9e3-e7cf-4775-b7fd-9bb2158bd698 tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-1b910eb6-4f6b-422d-8370-db99f91cd84e-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:59:00 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c983e9e3-e7cf-4775-b7fd-9bb2158bd698 tempest-ProjectMemberTests-73797185 None] Lock "cinder-1b910eb6-4f6b-422d-8370-db99f91cd84e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:59:00 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c983e9e3-e7cf-4775-b7fd-9bb2158bd698 tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-quobyte-1b910eb6-4f6b-422d-8370-db99f91cd84e" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:59:00 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c983e9e3-e7cf-4775-b7fd-9bb2158bd698 tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-1b910eb6-4f6b-422d-8370-db99f91cd84e" acquired by "delete_volume" :: waited 0.022s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:59:00 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[29691ea0-0bd3-48eb-8c5c-7d9331ac0be6]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:59:00 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c983e9e3-e7cf-4775-b7fd-9bb2158bd698 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:00 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e Jul 08 01:59:00 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:01 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ee7142ff-a065-4e1f-96e7-08764ce56b7e tempest-SnapshotDependencyTests-448149245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788 1073741824" returned: 0 in 1.041s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ee7142ff-a065-4e1f-96e7-08764ce56b7e tempest-SnapshotDependencyTests-448149245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:01 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788 Jul 08 01:59:01 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:01 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c983e9e3-e7cf-4775-b7fd-9bb2158bd698 tempest-ProjectMemberTests-73797185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e" returned: 0 in 0.896s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:01 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c983e9e3-e7cf-4775-b7fd-9bb2158bd698 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:01 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e Jul 08 01:59:01 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:02 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ee7142ff-a065-4e1f-96e7-08764ce56b7e tempest-SnapshotDependencyTests-448149245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788" returned: 0 in 0.711s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:02 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-ee7142ff-a065-4e1f-96e7-08764ce56b7e tempest-SnapshotDependencyTests-448149245 None] <== create_volume: return (1810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:59:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ee7142ff-a065-4e1f-96e7-08764ce56b7e tempest-SnapshotDependencyTests-448149245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.812s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:59:02 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ee7142ff-a065-4e1f-96e7-08764ce56b7e tempest-SnapshotDependencyTests-448149245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50ef1578-d24b-4609-90a1-fe5a750419fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdc81293-7647-4236-8240-7b9d25557788', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:02 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ee7142ff-a065-4e1f-96e7-08764ce56b7e tempest-SnapshotDependencyTests-448149245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45b46614-d7dc-4717-aa0c-04dfe2730634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:02 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-ee7142ff-a065-4e1f-96e7-08764ce56b7e tempest-SnapshotDependencyTests-448149245 None] Volume volume-bdc81293-7647-4236-8240-7b9d25557788 (bdc81293-7647-4236-8240-7b9d25557788): created successfully Jul 08 01:59:02 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ee7142ff-a065-4e1f-96e7-08764ce56b7e tempest-SnapshotDependencyTests-448149245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45b46614-d7dc-4717-aa0c-04dfe2730634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:02 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-ee7142ff-a065-4e1f-96e7-08764ce56b7e tempest-SnapshotDependencyTests-448149245 None] Flow 'volume_create_manager' (6f792d18-1085-457c-bdbf-ed7a87b05a38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:59:02 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-ee7142ff-a065-4e1f-96e7-08764ce56b7e tempest-SnapshotDependencyTests-448149245 None] Created volume successfully. Jul 08 01:59:02 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c983e9e3-e7cf-4775-b7fd-9bb2158bd698 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-1b910eb6-4f6b-422d-8370-db99f91cd84e" returned: 0 in 0.758s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:02 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c983e9e3-e7cf-4775-b7fd-9bb2158bd698 tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-1b910eb6-4f6b-422d-8370-db99f91cd84e" released by "delete_volume" :: held 1.723s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:59:02 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-c983e9e3-e7cf-4775-b7fd-9bb2158bd698 tempest-ProjectMemberTests-73797185 None] Created reservations ['701da154-3933-485c-9946-7947971ef58c', '1a698c3c-ef51-468d-98db-417651437528', 'ad4ce7b9-f1af-405d-8456-63f777f834fe', '855442e8-d559-4bac-be0b-0efc506f2e20'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:59:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c983e9e3-e7cf-4775-b7fd-9bb2158bd698 tempest-ProjectMemberTests-73797185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:59:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c983e9e3-e7cf-4775-b7fd-9bb2158bd698 tempest-ProjectMemberTests-73797185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:59:02 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c983e9e3-e7cf-4775-b7fd-9bb2158bd698 tempest-ProjectMemberTests-73797185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:59:02 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c983e9e3-e7cf-4775-b7fd-9bb2158bd698 tempest-ProjectMemberTests-73797185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:59:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c983e9e3-e7cf-4775-b7fd-9bb2158bd698 tempest-ProjectMemberTests-73797185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:59:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c983e9e3-e7cf-4775-b7fd-9bb2158bd698 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:02 devstack sudo[106204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:59:02 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e811ca9c-90a7-4859-a389-f38d94bc88a1 tempest-SnapshotDependencyTests-448149245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:59:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e811ca9c-90a7-4859-a389-f38d94bc88a1 tempest-SnapshotDependencyTests-448149245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:59:02 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-e811ca9c-90a7-4859-a389-f38d94bc88a1 tempest-SnapshotDependencyTests-448149245 None] Creating offline snapshot 606f485e-f73a-4054-a56a-76e880b6bcb4 of volume bdc81293-7647-4236-8240-7b9d25557788 {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:59:02 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda6c997-6553-4349-8fe7-3bae0ce6d208]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:59:02 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e811ca9c-90a7-4859-a389-f38d94bc88a1 tempest-SnapshotDependencyTests-448149245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:02 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788 Jul 08 01:59:02 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:03 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c983e9e3-e7cf-4775-b7fd-9bb2158bd698 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.826s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:03 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-c983e9e3-e7cf-4775-b7fd-9bb2158bd698 tempest-ProjectMemberTests-73797185 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:59:03 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-c983e9e3-e7cf-4775-b7fd-9bb2158bd698 tempest-ProjectMemberTests-73797185 None] Deleted volume successfully. Jul 08 01:59:03 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-40f33775-9089-4add-8a12-3bf127e1f15a tempest-ProjectMemberTests-73797185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:59:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-40f33775-9089-4add-8a12-3bf127e1f15a tempest-ProjectMemberTests-73797185 None] Flow 'volume_create_manager' (4a2a587d-8d81-4a48-92c2-fc57ff196c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:59:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-40f33775-9089-4add-8a12-3bf127e1f15a tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87fefed5-da87-41ee-91e5-c1518afe18ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:03 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c983e9e3-e7cf-4775-b7fd-9bb2158bd698 tempest-ProjectMemberTests-73797185 None] Lock "cinder-1b910eb6-4f6b-422d-8370-db99f91cd84e-delete_volume" released by "delete_volume" :: held 2.850s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:59:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-40f33775-9089-4add-8a12-3bf127e1f15a tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87fefed5-da87-41ee-91e5-c1518afe18ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-12059141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90dc8ac5-bf53-49e3-b5b7-f4499c96b41e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410ede866c9145df8444c3a398ace8b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:59:03Z,use_quota=True,user_id='5f5ae65b4a584ede952a5bfc00c9a49d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-40f33775-9089-4add-8a12-3bf127e1f15a tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ea68413-8d5a-4a0b-883b-11820739c812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-40f33775-9089-4add-8a12-3bf127e1f15a tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ea68413-8d5a-4a0b-883b-11820739c812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-40f33775-9089-4add-8a12-3bf127e1f15a tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8241d78-47d1-481c-b4b6-ac85e7477498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-40f33775-9089-4add-8a12-3bf127e1f15a tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8241d78-47d1-481c-b4b6-ac85e7477498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90dc8ac5-bf53-49e3-b5b7-f4499c96b41e', 'volume_name': 'volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-40f33775-9089-4add-8a12-3bf127e1f15a tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f728b8-4459-4b99-ba3d-c896264d6edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-40f33775-9089-4add-8a12-3bf127e1f15a tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f728b8-4459-4b99-ba3d-c896264d6edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:03 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-40f33775-9089-4add-8a12-3bf127e1f15a tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d530994-c93a-4d98-acd1-43980146e4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:03 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-40f33775-9089-4add-8a12-3bf127e1f15a tempest-ProjectMemberTests-73797185 None] Volume 90dc8ac5-bf53-49e3-b5b7-f4499c96b41e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e', 'volume_size': 1} Jul 08 01:59:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-40f33775-9089-4add-8a12-3bf127e1f15a tempest-ProjectMemberTests-73797185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:59:03 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e811ca9c-90a7-4859-a389-f38d94bc88a1 tempest-SnapshotDependencyTests-448149245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788" returned: 0 in 0.889s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:03 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e811ca9c-90a7-4859-a389-f38d94bc88a1 tempest-SnapshotDependencyTests-448149245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788.606f485e-f73a-4054-a56a-76e880b6bcb4 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:03 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788.606f485e-f73a-4054-a56a-76e880b6bcb4 1G Jul 08 01:59:03 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:04 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e811ca9c-90a7-4859-a389-f38d94bc88a1 tempest-SnapshotDependencyTests-448149245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788.606f485e-f73a-4054-a56a-76e880b6bcb4 1G" returned: 0 in 0.904s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:04 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e811ca9c-90a7-4859-a389-f38d94bc88a1 tempest-SnapshotDependencyTests-448149245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdc81293-7647-4236-8240-7b9d25557788 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788.606f485e-f73a-4054-a56a-76e880b6bcb4 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:04 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdc81293-7647-4236-8240-7b9d25557788 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788.606f485e-f73a-4054-a56a-76e880b6bcb4 Jul 08 01:59:04 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:05 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e811ca9c-90a7-4859-a389-f38d94bc88a1 tempest-SnapshotDependencyTests-448149245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdc81293-7647-4236-8240-7b9d25557788 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788.606f485e-f73a-4054-a56a-76e880b6bcb4" returned: 0 in 0.747s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:05 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-e811ca9c-90a7-4859-a389-f38d94bc88a1 tempest-SnapshotDependencyTests-448149245 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788.606f485e-f73a-4054-a56a-76e880b6bcb4 is being set with open permissions: ugo+rw Jul 08 01:59:05 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e811ca9c-90a7-4859-a389-f38d94bc88a1 tempest-SnapshotDependencyTests-448149245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788.606f485e-f73a-4054-a56a-76e880b6bcb4 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:05 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788.606f485e-f73a-4054-a56a-76e880b6bcb4 Jul 08 01:59:05 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:06 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e811ca9c-90a7-4859-a389-f38d94bc88a1 tempest-SnapshotDependencyTests-448149245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788.606f485e-f73a-4054-a56a-76e880b6bcb4" returned: 0 in 0.707s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e811ca9c-90a7-4859-a389-f38d94bc88a1 tempest-SnapshotDependencyTests-448149245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:06 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788.info Jul 08 01:59:06 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:06 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e811ca9c-90a7-4859-a389-f38d94bc88a1 tempest-SnapshotDependencyTests-448149245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788.info" returned: 0 in 0.737s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:06 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-e811ca9c-90a7-4859-a389-f38d94bc88a1 tempest-SnapshotDependencyTests-448149245 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788.info is being set with open permissions: ugo+rw Jul 08 01:59:06 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e811ca9c-90a7-4859-a389-f38d94bc88a1 tempest-SnapshotDependencyTests-448149245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:06 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788.info Jul 08 01:59:06 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:07 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-e811ca9c-90a7-4859-a389-f38d94bc88a1 tempest-SnapshotDependencyTests-448149245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788.info" returned: 0 in 0.705s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-e811ca9c-90a7-4859-a389-f38d94bc88a1 tempest-SnapshotDependencyTests-448149245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.802s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:59:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-40f33775-9089-4add-8a12-3bf127e1f15a tempest-ProjectMemberTests-73797185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.059s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:59:07 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-40f33775-9089-4add-8a12-3bf127e1f15a tempest-ProjectMemberTests-73797185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-12059141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90dc8ac5-bf53-49e3-b5b7-f4499c96b41e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410ede866c9145df8444c3a398ace8b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:59:03Z,use_quota=True,user_id='5f5ae65b4a584ede952a5bfc00c9a49d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:59:07 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-40f33775-9089-4add-8a12-3bf127e1f15a tempest-ProjectMemberTests-73797185 None] Creating volume 90dc8ac5-bf53-49e3-b5b7-f4499c96b41e {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:59:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-40f33775-9089-4add-8a12-3bf127e1f15a tempest-ProjectMemberTests-73797185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:59:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-40f33775-9089-4add-8a12-3bf127e1f15a tempest-ProjectMemberTests-73797185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:59:07 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-40f33775-9089-4add-8a12-3bf127e1f15a tempest-ProjectMemberTests-73797185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:59:07 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-40f33775-9089-4add-8a12-3bf127e1f15a tempest-ProjectMemberTests-73797185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:59:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-40f33775-9089-4add-8a12-3bf127e1f15a tempest-ProjectMemberTests-73797185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:59:07 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-40f33775-9089-4add-8a12-3bf127e1f15a tempest-ProjectMemberTests-73797185 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:59:07 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-40f33775-9089-4add-8a12-3bf127e1f15a tempest-ProjectMemberTests-73797185 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:59:07 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-40f33775-9089-4add-8a12-3bf127e1f15a tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:07 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e 1073741824 Jul 08 01:59:07 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:07 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-e811ca9c-90a7-4859-a389-f38d94bc88a1 tempest-SnapshotDependencyTests-448149245 None] Create snapshot completed successfully Jul 08 01:59:08 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-40f33775-9089-4add-8a12-3bf127e1f15a tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e 1073741824" returned: 0 in 0.977s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-40f33775-9089-4add-8a12-3bf127e1f15a tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:08 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e Jul 08 01:59:08 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:08 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:59:08 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Flow 'volume_create_manager' (e426edb4-2640-4d2b-9670-e7fbd25d2a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:59:08 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b0504c-dcb0-4436-bfa2-8f4cd1521131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:08 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b0504c-dcb0-4436-bfa2-8f4cd1521131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b78b025e-87d5-423b-accc-98f71b1c4cee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c77414f543d14e6d9e16f57e5c02da14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=606f485e-f73a-4054-a56a-76e880b6bcb4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:59:09Z,use_quota=True,user_id='3dc9219317d742dd8a79e656482a8f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:08 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed03a8a5-193a-4b03-94cf-41314fbd5c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:08 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed03a8a5-193a-4b03-94cf-41314fbd5c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:08 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b97070eb-4106-44cd-b604-fabfe9b4a385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:08 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b97070eb-4106-44cd-b604-fabfe9b4a385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b78b025e-87d5-423b-accc-98f71b1c4cee', 'volume_name': 'volume-b78b025e-87d5-423b-accc-98f71b1c4cee', 'volume_size': 1, 'snapshot_id': '606f485e-f73a-4054-a56a-76e880b6bcb4'}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:08 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d51bea0-113e-4adb-88ac-4787efb2f9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:08 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d51bea0-113e-4adb-88ac-4787efb2f9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:08 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (329d0ce1-757b-4f56-ba53-df7a2c708d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:08 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Volume b78b025e-87d5-423b-accc-98f71b1c4cee: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b78b025e-87d5-423b-accc-98f71b1c4cee', 'volume_size': 1, 'snapshot_id': '606f485e-f73a-4054-a56a-76e880b6bcb4'} Jul 08 01:59:08 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:59:09 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-40f33775-9089-4add-8a12-3bf127e1f15a tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e" returned: 0 in 0.682s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:09 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-40f33775-9089-4add-8a12-3bf127e1f15a tempest-ProjectMemberTests-73797185 None] <== create_volume: return (1713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:59:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-40f33775-9089-4add-8a12-3bf127e1f15a tempest-ProjectMemberTests-73797185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.717s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:59:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.496s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:59:09 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Acquiring lock "cinder-quobyte-606f485e-f73a-4054-a56a-76e880b6bcb4-b78b025e-87d5-423b-accc-98f71b1c4cee" by "_create_volume_from_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:59:09 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-40f33775-9089-4add-8a12-3bf127e1f15a tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d530994-c93a-4d98-acd1-43980146e4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:09 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-40f33775-9089-4add-8a12-3bf127e1f15a tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cb58037-aeda-46d0-8c53-842f1de5221c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:09 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Lock "cinder-quobyte-606f485e-f73a-4054-a56a-76e880b6bcb4-b78b025e-87d5-423b-accc-98f71b1c4cee" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:59:09 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Creating volume b78b025e-87d5-423b-accc-98f71b1c4cee from snapshot 606f485e-f73a-4054-a56a-76e880b6bcb4 {{(pid=87284) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 01:59:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:59:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:59:09 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:59:09 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:59:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:59:09 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:59:09 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Acquiring lock "cinder-quobyte-b78b025e-87d5-423b-accc-98f71b1c4cee" by "_copy_volume_from_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:59:09 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-40f33775-9089-4add-8a12-3bf127e1f15a tempest-ProjectMemberTests-73797185 None] Volume volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e (90dc8ac5-bf53-49e3-b5b7-f4499c96b41e): created successfully Jul 08 01:59:09 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-40f33775-9089-4add-8a12-3bf127e1f15a tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cb58037-aeda-46d0-8c53-842f1de5221c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:09 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-40f33775-9089-4add-8a12-3bf127e1f15a tempest-ProjectMemberTests-73797185 None] Flow 'volume_create_manager' (4a2a587d-8d81-4a48-92c2-fc57ff196c38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:59:09 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Lock "cinder-quobyte-b78b025e-87d5-423b-accc-98f71b1c4cee" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:59:09 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] snapshot: 606f485e-f73a-4054-a56a-76e880b6bcb4, volume: b78b025e-87d5-423b-accc-98f71b1c4cee, {{(pid=87284) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:59:09 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-40f33775-9089-4add-8a12-3bf127e1f15a tempest-ProjectMemberTests-73797185 None] Created volume successfully. Jul 08 01:59:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:59:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:59:09 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:59:09 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:59:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:59:09 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb73c1d6-8b66-4483-ba02-89be23b0db5a]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:59:09 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788.606f485e-f73a-4054-a56a-76e880b6bcb4 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:09 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788.606f485e-f73a-4054-a56a-76e880b6bcb4 Jul 08 01:59:09 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-730d708f-9eef-431c-9890-d264e67f99b5 tempest-ProjectMemberTests-73797185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:59:10 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788.606f485e-f73a-4054-a56a-76e880b6bcb4" returned: 0 in 0.842s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:10 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdc81293-7647-4236-8240-7b9d25557788(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:59:10 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788 {{(pid=87284) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:59:10 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Creating direct copy from snapshot {{(pid=87284) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:59:10 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7af90ed-2e99-4bf4-bf70-2d39b1756b10]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:59:10 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:10 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788 Jul 08 01:59:10 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:11 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788" returned: 0 in 0.869s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:11 devstack cinder-volume[87284]: DEBUG cinder.utils [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Path /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b78b025e-87d5-423b-accc-98f71b1c4cee not found in is_blk_device check {{(pid=87284) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:59:11 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b78b025e-87d5-423b-accc-98f71b1c4cee {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:11 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b78b025e-87d5-423b-accc-98f71b1c4cee Jul 08 01:59:11 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:15 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b78b025e-87d5-423b-accc-98f71b1c4cee" returned: 0 in 4.620s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:15 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7ad56c-e2d0-45e2-bf66-c870f28b980f]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:59:15 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:15 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788 Jul 08 01:59:15 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:16 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788" returned: 0 in 0.986s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:16 devstack cinder-volume[87284]: DEBUG cinder.image.image_utils [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Image conversion details: src /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788, size 1024.00 MB, duration 4.62 sec, destination /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b78b025e-87d5-423b-accc-98f71b1c4cee {{(pid=87284) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:59:16 devstack cinder-volume[87284]: INFO cinder.image.image_utils [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Converted 1024.00 MB image at 221.58 MB/s Jul 08 01:59:16 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b78b025e-87d5-423b-accc-98f71b1c4cee is being set with open permissions: ugo+rw Jul 08 01:59:16 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b78b025e-87d5-423b-accc-98f71b1c4cee {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:16 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b78b025e-87d5-423b-accc-98f71b1c4cee Jul 08 01:59:16 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:17 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b78b025e-87d5-423b-accc-98f71b1c4cee" returned: 0 in 0.640s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:17 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Lock "cinder-quobyte-b78b025e-87d5-423b-accc-98f71b1c4cee" released by "_copy_volume_from_snapshot" :: held 8.064s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:59:17 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Lock "cinder-quobyte-606f485e-f73a-4054-a56a-76e880b6bcb4-b78b025e-87d5-423b-accc-98f71b1c4cee" released by "_create_volume_from_snapshot" :: held 8.109s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:59:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.140s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:59:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-730d708f-9eef-431c-9890-d264e67f99b5 tempest-ProjectMemberTests-73797185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.377s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:59:17 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-730d708f-9eef-431c-9890-d264e67f99b5 tempest-ProjectMemberTests-73797185 None] Creating offline snapshot 8e32315c-a2d3-4b63-ad94-c61c04e8b5f4 of volume 90dc8ac5-bf53-49e3-b5b7-f4499c96b41e {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:59:17 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (329d0ce1-757b-4f56-ba53-df7a2c708d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b78b025e-87d5-423b-accc-98f71b1c4cee', 'volume_size': 1, 'snapshot_id': '606f485e-f73a-4054-a56a-76e880b6bcb4'}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:17 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38475c04-fc45-4d92-8e76-f6986dc67347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:17 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2e2cf2-0e9e-407d-abc3-b13dbdada99b]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:59:17 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-730d708f-9eef-431c-9890-d264e67f99b5 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:17 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Volume volume-b78b025e-87d5-423b-accc-98f71b1c4cee (b78b025e-87d5-423b-accc-98f71b1c4cee): created successfully Jul 08 01:59:17 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38475c04-fc45-4d92-8e76-f6986dc67347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:17 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Flow 'volume_create_manager' (e426edb4-2640-4d2b-9670-e7fbd25d2a76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:59:17 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-48d205d9-c694-4d79-9e82-8fa73fb83fc2 tempest-SnapshotDependencyTests-448149245 None] Created volume successfully. Jul 08 01:59:17 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e Jul 08 01:59:17 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:18 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-730d708f-9eef-431c-9890-d264e67f99b5 tempest-ProjectMemberTests-73797185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e" returned: 0 in 0.820s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-730d708f-9eef-431c-9890-d264e67f99b5 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e.8e32315c-a2d3-4b63-ad94-c61c04e8b5f4 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:18 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e.8e32315c-a2d3-4b63-ad94-c61c04e8b5f4 1G Jul 08 01:59:18 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:18 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2d4f2fac-02c3-4cb5-a316-723c8a7cc98b tempest-SnapshotDependencyTests-448149245 None] Acquiring lock "cinder-606f485e-f73a-4054-a56a-76e880b6bcb4-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:59:18 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2d4f2fac-02c3-4cb5-a316-723c8a7cc98b tempest-SnapshotDependencyTests-448149245 None] Lock "cinder-606f485e-f73a-4054-a56a-76e880b6bcb4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:59:18 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2d4f2fac-02c3-4cb5-a316-723c8a7cc98b tempest-SnapshotDependencyTests-448149245 None] Acquiring lock "cinder-quobyte-bdc81293-7647-4236-8240-7b9d25557788" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:59:18 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2d4f2fac-02c3-4cb5-a316-723c8a7cc98b tempest-SnapshotDependencyTests-448149245 None] Lock "cinder-quobyte-bdc81293-7647-4236-8240-7b9d25557788" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:59:18 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2d4f2fac-02c3-4cb5-a316-723c8a7cc98b tempest-SnapshotDependencyTests-448149245 None] Acquiring lock "cinder-quobyte-606f485e-f73a-4054-a56a-76e880b6bcb4" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:59:18 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2d4f2fac-02c3-4cb5-a316-723c8a7cc98b tempest-SnapshotDependencyTests-448149245 None] Lock "cinder-quobyte-606f485e-f73a-4054-a56a-76e880b6bcb4" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:59:18 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-2d4f2fac-02c3-4cb5-a316-723c8a7cc98b tempest-SnapshotDependencyTests-448149245 None] Deleting offline snapshot 606f485e-f73a-4054-a56a-76e880b6bcb4 of volume bdc81293-7647-4236-8240-7b9d25557788 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:59:18 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-2d4f2fac-02c3-4cb5-a316-723c8a7cc98b tempest-SnapshotDependencyTests-448149245 None] snapshot_file for this snap is: volume-bdc81293-7647-4236-8240-7b9d25557788.606f485e-f73a-4054-a56a-76e880b6bcb4 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:59:18 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8c1278-0203-4c53-a3e8-69c25b8ae0eb]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:59:18 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2d4f2fac-02c3-4cb5-a316-723c8a7cc98b tempest-SnapshotDependencyTests-448149245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788.606f485e-f73a-4054-a56a-76e880b6bcb4 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:18 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788.606f485e-f73a-4054-a56a-76e880b6bcb4 Jul 08 01:59:18 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:19 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-730d708f-9eef-431c-9890-d264e67f99b5 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e.8e32315c-a2d3-4b63-ad94-c61c04e8b5f4 1G" returned: 0 in 0.858s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-730d708f-9eef-431c-9890-d264e67f99b5 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e.8e32315c-a2d3-4b63-ad94-c61c04e8b5f4 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:19 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e.8e32315c-a2d3-4b63-ad94-c61c04e8b5f4 Jul 08 01:59:19 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:19 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2d4f2fac-02c3-4cb5-a316-723c8a7cc98b tempest-SnapshotDependencyTests-448149245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788.606f485e-f73a-4054-a56a-76e880b6bcb4" returned: 0 in 0.887s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:19 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-2d4f2fac-02c3-4cb5-a316-723c8a7cc98b tempest-SnapshotDependencyTests-448149245 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdc81293-7647-4236-8240-7b9d25557788(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:59:19 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[541b7da2-5bf4-42e0-833b-37217dda299c]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:59:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2d4f2fac-02c3-4cb5-a316-723c8a7cc98b tempest-SnapshotDependencyTests-448149245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:19 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788 Jul 08 01:59:19 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:19 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-730d708f-9eef-431c-9890-d264e67f99b5 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e.8e32315c-a2d3-4b63-ad94-c61c04e8b5f4" returned: 0 in 0.810s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:19 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-730d708f-9eef-431c-9890-d264e67f99b5 tempest-ProjectMemberTests-73797185 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e.8e32315c-a2d3-4b63-ad94-c61c04e8b5f4 is being set with open permissions: ugo+rw Jul 08 01:59:19 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-730d708f-9eef-431c-9890-d264e67f99b5 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e.8e32315c-a2d3-4b63-ad94-c61c04e8b5f4 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:20 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e.8e32315c-a2d3-4b63-ad94-c61c04e8b5f4 Jul 08 01:59:20 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:20 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2d4f2fac-02c3-4cb5-a316-723c8a7cc98b tempest-SnapshotDependencyTests-448149245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788" returned: 0 in 0.818s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2d4f2fac-02c3-4cb5-a316-723c8a7cc98b tempest-SnapshotDependencyTests-448149245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788.606f485e-f73a-4054-a56a-76e880b6bcb4 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:20 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788.606f485e-f73a-4054-a56a-76e880b6bcb4 Jul 08 01:59:20 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:20 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-730d708f-9eef-431c-9890-d264e67f99b5 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e.8e32315c-a2d3-4b63-ad94-c61c04e8b5f4" returned: 0 in 0.708s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:20 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-730d708f-9eef-431c-9890-d264e67f99b5 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:20 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e.info Jul 08 01:59:20 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:21 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2d4f2fac-02c3-4cb5-a316-723c8a7cc98b tempest-SnapshotDependencyTests-448149245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788.606f485e-f73a-4054-a56a-76e880b6bcb4" returned: 0 in 0.777s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2d4f2fac-02c3-4cb5-a316-723c8a7cc98b tempest-SnapshotDependencyTests-448149245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788.606f485e-f73a-4054-a56a-76e880b6bcb4 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:21 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788.606f485e-f73a-4054-a56a-76e880b6bcb4 Jul 08 01:59:21 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:21 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-730d708f-9eef-431c-9890-d264e67f99b5 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e.info" returned: 0 in 0.753s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:21 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-730d708f-9eef-431c-9890-d264e67f99b5 tempest-ProjectMemberTests-73797185 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e.info is being set with open permissions: ugo+rw Jul 08 01:59:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-730d708f-9eef-431c-9890-d264e67f99b5 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:21 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e.info Jul 08 01:59:21 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:21 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:21 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-2d4f2fac-02c3-4cb5-a316-723c8a7cc98b tempest-SnapshotDependencyTests-448149245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788.606f485e-f73a-4054-a56a-76e880b6bcb4" returned: 0 in 0.682s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:21 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2d4f2fac-02c3-4cb5-a316-723c8a7cc98b tempest-SnapshotDependencyTests-448149245 None] Lock "cinder-quobyte-606f485e-f73a-4054-a56a-76e880b6bcb4" released by "_delete_snapshot" :: held 3.306s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:59:21 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2d4f2fac-02c3-4cb5-a316-723c8a7cc98b tempest-SnapshotDependencyTests-448149245 None] Lock "cinder-quobyte-bdc81293-7647-4236-8240-7b9d25557788" released by "delete_snapshot" :: held 3.337s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:59:21 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-2d4f2fac-02c3-4cb5-a316-723c8a7cc98b tempest-SnapshotDependencyTests-448149245 None] Created reservations ['e667ee36-06b7-4668-89bb-5f1560ae2110', 'c903a405-3812-4c6e-97eb-7f23dc9b2501', '4388db82-5a0a-4824-ab21-3aa8d7442ecf', '3cd4ae02-7be3-40a0-820e-0aedcf7edad2'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:59:21 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-2d4f2fac-02c3-4cb5-a316-723c8a7cc98b tempest-SnapshotDependencyTests-448149245 None] Delete snapshot completed successfully. Jul 08 01:59:21 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-2d4f2fac-02c3-4cb5-a316-723c8a7cc98b tempest-SnapshotDependencyTests-448149245 None] Lock "cinder-606f485e-f73a-4054-a56a-76e880b6bcb4-delete_snapshot" released by "delete_snapshot" :: held 3.490s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:59:22 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-730d708f-9eef-431c-9890-d264e67f99b5 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e.info" returned: 0 in 0.775s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-730d708f-9eef-431c-9890-d264e67f99b5 tempest-ProjectMemberTests-73797185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.836s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:59:22 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-730d708f-9eef-431c-9890-d264e67f99b5 tempest-ProjectMemberTests-73797185 None] Create snapshot completed successfully Jul 08 01:59:22 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c9a3a1fb-329b-43d5-a9f3-d2394a385364 tempest-SnapshotDependencyTests-448149245 None] Acquiring lock "cinder-bdc81293-7647-4236-8240-7b9d25557788-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:59:22 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-00920a69-7e28-45cf-bbea-9a71b77a2d22 tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-8e32315c-a2d3-4b63-ad94-c61c04e8b5f4-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:59:22 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c9a3a1fb-329b-43d5-a9f3-d2394a385364 tempest-SnapshotDependencyTests-448149245 None] Lock "cinder-bdc81293-7647-4236-8240-7b9d25557788-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:59:22 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=59,cinder:UPDATE=72,cinder:INSERT=13,cinder:DELETE=3 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:59:22 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-00920a69-7e28-45cf-bbea-9a71b77a2d22 tempest-ProjectMemberTests-73797185 None] Lock "cinder-8e32315c-a2d3-4b63-ad94-c61c04e8b5f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:59:22 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-00920a69-7e28-45cf-bbea-9a71b77a2d22 tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-quobyte-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:59:22 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=56,cinder:INSERT=24,cinder:DELETE=10,cinder:UPDATE=63 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:59:22 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-00920a69-7e28-45cf-bbea-9a71b77a2d22 tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:59:22 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-00920a69-7e28-45cf-bbea-9a71b77a2d22 tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-quobyte-8e32315c-a2d3-4b63-ad94-c61c04e8b5f4" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:59:22 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-00920a69-7e28-45cf-bbea-9a71b77a2d22 tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-8e32315c-a2d3-4b63-ad94-c61c04e8b5f4" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:59:22 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-00920a69-7e28-45cf-bbea-9a71b77a2d22 tempest-ProjectMemberTests-73797185 None] Deleting offline snapshot 8e32315c-a2d3-4b63-ad94-c61c04e8b5f4 of volume 90dc8ac5-bf53-49e3-b5b7-f4499c96b41e {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:59:22 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-00920a69-7e28-45cf-bbea-9a71b77a2d22 tempest-ProjectMemberTests-73797185 None] snapshot_file for this snap is: volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e.8e32315c-a2d3-4b63-ad94-c61c04e8b5f4 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:59:22 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c9a3a1fb-329b-43d5-a9f3-d2394a385364 tempest-SnapshotDependencyTests-448149245 None] Acquiring lock "cinder-quobyte-bdc81293-7647-4236-8240-7b9d25557788" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:59:22 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73d8424-c82a-43c1-8c59-fe5cbebbd0e7]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:59:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-00920a69-7e28-45cf-bbea-9a71b77a2d22 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e.8e32315c-a2d3-4b63-ad94-c61c04e8b5f4 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:22 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c9a3a1fb-329b-43d5-a9f3-d2394a385364 tempest-SnapshotDependencyTests-448149245 None] Lock "cinder-quobyte-bdc81293-7647-4236-8240-7b9d25557788" acquired by "delete_volume" :: waited 0.029s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:59:22 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3809e7b-f5f5-4fdb-8beb-7b6b0fa778d4]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:59:22 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c9a3a1fb-329b-43d5-a9f3-d2394a385364 tempest-SnapshotDependencyTests-448149245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:22 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e.8e32315c-a2d3-4b63-ad94-c61c04e8b5f4 Jul 08 01:59:22 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:23 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788 Jul 08 01:59:23 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:23 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-00920a69-7e28-45cf-bbea-9a71b77a2d22 tempest-ProjectMemberTests-73797185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e.8e32315c-a2d3-4b63-ad94-c61c04e8b5f4" returned: 0 in 0.815s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:23 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-00920a69-7e28-45cf-bbea-9a71b77a2d22 tempest-ProjectMemberTests-73797185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:59:23 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5eb72e-ea92-4849-8c46-53e5b5b5bf0c]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:59:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-00920a69-7e28-45cf-bbea-9a71b77a2d22 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:23 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c9a3a1fb-329b-43d5-a9f3-d2394a385364 tempest-SnapshotDependencyTests-448149245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788" returned: 0 in 0.876s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:23 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c9a3a1fb-329b-43d5-a9f3-d2394a385364 tempest-SnapshotDependencyTests-448149245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:23 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788 Jul 08 01:59:23 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:23 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e Jul 08 01:59:23 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:24 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c9a3a1fb-329b-43d5-a9f3-d2394a385364 tempest-SnapshotDependencyTests-448149245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-bdc81293-7647-4236-8240-7b9d25557788" returned: 0 in 0.718s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:24 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:24 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c9a3a1fb-329b-43d5-a9f3-d2394a385364 tempest-SnapshotDependencyTests-448149245 None] Lock "cinder-quobyte-bdc81293-7647-4236-8240-7b9d25557788" released by "delete_volume" :: held 1.675s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:59:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-00920a69-7e28-45cf-bbea-9a71b77a2d22 tempest-ProjectMemberTests-73797185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e" returned: 0 in 0.842s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-00920a69-7e28-45cf-bbea-9a71b77a2d22 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e.8e32315c-a2d3-4b63-ad94-c61c04e8b5f4 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:24 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e.8e32315c-a2d3-4b63-ad94-c61c04e8b5f4 Jul 08 01:59:24 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:24 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-c9a3a1fb-329b-43d5-a9f3-d2394a385364 tempest-SnapshotDependencyTests-448149245 None] Created reservations ['2cd4a1d4-2cec-4982-b5ec-1007a340a1af', '422e2548-5dff-4841-953a-cf2bcf044f1b', 'c52176b7-a1df-45c1-bce9-1cbd761713df', '8d28ae3f-54d1-449e-8774-11f2a5f06460'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:59:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c9a3a1fb-329b-43d5-a9f3-d2394a385364 tempest-SnapshotDependencyTests-448149245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:59:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c9a3a1fb-329b-43d5-a9f3-d2394a385364 tempest-SnapshotDependencyTests-448149245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:59:24 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c9a3a1fb-329b-43d5-a9f3-d2394a385364 tempest-SnapshotDependencyTests-448149245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:59:24 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-c9a3a1fb-329b-43d5-a9f3-d2394a385364 tempest-SnapshotDependencyTests-448149245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:59:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-c9a3a1fb-329b-43d5-a9f3-d2394a385364 tempest-SnapshotDependencyTests-448149245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:59:24 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c9a3a1fb-329b-43d5-a9f3-d2394a385364 tempest-SnapshotDependencyTests-448149245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:24 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:59:24 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:25 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-df879f68-1353-4ffb-b044-adf2587001ca tempest-SnapshotDependencyTests-448149245 None] Acquiring lock "cinder-b78b025e-87d5-423b-accc-98f71b1c4cee-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:59:25 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-df879f68-1353-4ffb-b044-adf2587001ca tempest-SnapshotDependencyTests-448149245 None] Lock "cinder-b78b025e-87d5-423b-accc-98f71b1c4cee-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:59:25 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-df879f68-1353-4ffb-b044-adf2587001ca tempest-SnapshotDependencyTests-448149245 None] Acquiring lock "cinder-quobyte-b78b025e-87d5-423b-accc-98f71b1c4cee" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:59:25 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-df879f68-1353-4ffb-b044-adf2587001ca tempest-SnapshotDependencyTests-448149245 None] Lock "cinder-quobyte-b78b025e-87d5-423b-accc-98f71b1c4cee" acquired by "delete_volume" :: waited 0.021s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:59:25 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f5abc6-2af1-4ef9-bfd1-9192890d4779]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:59:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-df879f68-1353-4ffb-b044-adf2587001ca tempest-SnapshotDependencyTests-448149245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b78b025e-87d5-423b-accc-98f71b1c4cee {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:25 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b78b025e-87d5-423b-accc-98f71b1c4cee Jul 08 01:59:25 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:25 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-00920a69-7e28-45cf-bbea-9a71b77a2d22 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e.8e32315c-a2d3-4b63-ad94-c61c04e8b5f4" returned: 0 in 0.811s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-00920a69-7e28-45cf-bbea-9a71b77a2d22 tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e.8e32315c-a2d3-4b63-ad94-c61c04e8b5f4 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:25 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e.8e32315c-a2d3-4b63-ad94-c61c04e8b5f4 Jul 08 01:59:25 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:25 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-c9a3a1fb-329b-43d5-a9f3-d2394a385364 tempest-SnapshotDependencyTests-448149245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.820s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:25 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-c9a3a1fb-329b-43d5-a9f3-d2394a385364 tempest-SnapshotDependencyTests-448149245 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:59:25 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-c9a3a1fb-329b-43d5-a9f3-d2394a385364 tempest-SnapshotDependencyTests-448149245 None] Deleted volume successfully. Jul 08 01:59:25 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-c9a3a1fb-329b-43d5-a9f3-d2394a385364 tempest-SnapshotDependencyTests-448149245 None] Lock "cinder-bdc81293-7647-4236-8240-7b9d25557788-delete_volume" released by "delete_volume" :: held 2.819s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:59:25 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-df879f68-1353-4ffb-b044-adf2587001ca tempest-SnapshotDependencyTests-448149245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b78b025e-87d5-423b-accc-98f71b1c4cee" returned: 0 in 0.814s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:25 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-df879f68-1353-4ffb-b044-adf2587001ca tempest-SnapshotDependencyTests-448149245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b78b025e-87d5-423b-accc-98f71b1c4cee {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:25 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b78b025e-87d5-423b-accc-98f71b1c4cee Jul 08 01:59:25 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:26 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-00920a69-7e28-45cf-bbea-9a71b77a2d22 tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e.8e32315c-a2d3-4b63-ad94-c61c04e8b5f4" returned: 0 in 0.742s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:26 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-00920a69-7e28-45cf-bbea-9a71b77a2d22 tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-8e32315c-a2d3-4b63-ad94-c61c04e8b5f4" released by "_delete_snapshot" :: held 3.329s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:59:26 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-00920a69-7e28-45cf-bbea-9a71b77a2d22 tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e" released by "delete_snapshot" :: held 3.364s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:59:26 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-00920a69-7e28-45cf-bbea-9a71b77a2d22 tempest-ProjectMemberTests-73797185 None] Created reservations ['7b8aafb8-a5ee-41c8-9683-c5b64840751a', '3e3f35dc-3107-4ca0-b39b-7d4d96d11374', 'ddeba42b-f3e2-49a1-aeb2-7fd24897f6f3', '70aae192-5481-4e5b-8df6-3ad416d495ee'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:59:26 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-00920a69-7e28-45cf-bbea-9a71b77a2d22 tempest-ProjectMemberTests-73797185 None] Delete snapshot completed successfully. Jul 08 01:59:26 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-00920a69-7e28-45cf-bbea-9a71b77a2d22 tempest-ProjectMemberTests-73797185 None] Lock "cinder-8e32315c-a2d3-4b63-ad94-c61c04e8b5f4-delete_snapshot" released by "delete_snapshot" :: held 3.548s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:59:26 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-df879f68-1353-4ffb-b044-adf2587001ca tempest-SnapshotDependencyTests-448149245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-b78b025e-87d5-423b-accc-98f71b1c4cee" returned: 0 in 0.702s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:26 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-df879f68-1353-4ffb-b044-adf2587001ca tempest-SnapshotDependencyTests-448149245 None] Lock "cinder-quobyte-b78b025e-87d5-423b-accc-98f71b1c4cee" released by "delete_volume" :: held 1.557s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:59:26 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-df879f68-1353-4ffb-b044-adf2587001ca tempest-SnapshotDependencyTests-448149245 None] Created reservations ['f9ab5845-028b-48fa-bc09-8e422a808add', 'e5f35461-b12c-40b5-93c1-a11f5720419a', '4fae962b-ef14-4400-b09f-7a72da2d36f4', 'd473ed02-d90c-451d-8acc-5bf660069449'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:59:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-df879f68-1353-4ffb-b044-adf2587001ca tempest-SnapshotDependencyTests-448149245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:59:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-df879f68-1353-4ffb-b044-adf2587001ca tempest-SnapshotDependencyTests-448149245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:59:26 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-df879f68-1353-4ffb-b044-adf2587001ca tempest-SnapshotDependencyTests-448149245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:59:26 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-df879f68-1353-4ffb-b044-adf2587001ca tempest-SnapshotDependencyTests-448149245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:59:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-df879f68-1353-4ffb-b044-adf2587001ca tempest-SnapshotDependencyTests-448149245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:59:26 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-df879f68-1353-4ffb-b044-adf2587001ca tempest-SnapshotDependencyTests-448149245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:26 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:59:26 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:27 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-22fa1b1d-13c3-4ca7-bdd5-fd3a04b683ef tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:59:27 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-22fa1b1d-13c3-4ca7-bdd5-fd3a04b683ef tempest-ProjectMemberTests-73797185 None] Lock "cinder-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:59:27 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-22fa1b1d-13c3-4ca7-bdd5-fd3a04b683ef tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-quobyte-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:59:27 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-22fa1b1d-13c3-4ca7-bdd5-fd3a04b683ef tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e" acquired by "delete_volume" :: waited 0.016s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:59:27 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba39555-0114-4228-aee7-34ac6d1061be]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:59:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-22fa1b1d-13c3-4ca7-bdd5-fd3a04b683ef tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:27 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e Jul 08 01:59:27 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:27 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:27 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-df879f68-1353-4ffb-b044-adf2587001ca tempest-SnapshotDependencyTests-448149245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.838s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:27 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-df879f68-1353-4ffb-b044-adf2587001ca tempest-SnapshotDependencyTests-448149245 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:59:27 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-df879f68-1353-4ffb-b044-adf2587001ca tempest-SnapshotDependencyTests-448149245 None] Deleted volume successfully. Jul 08 01:59:27 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-df879f68-1353-4ffb-b044-adf2587001ca tempest-SnapshotDependencyTests-448149245 None] Lock "cinder-b78b025e-87d5-423b-accc-98f71b1c4cee-delete_volume" released by "delete_volume" :: held 2.658s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:59:28 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-22fa1b1d-13c3-4ca7-bdd5-fd3a04b683ef tempest-ProjectMemberTests-73797185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e" returned: 0 in 0.967s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-22fa1b1d-13c3-4ca7-bdd5-fd3a04b683ef tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:28 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e Jul 08 01:59:28 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:28 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:28 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-22fa1b1d-13c3-4ca7-bdd5-fd3a04b683ef tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e" returned: 0 in 0.786s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:28 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-22fa1b1d-13c3-4ca7-bdd5-fd3a04b683ef tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e" released by "delete_volume" :: held 1.820s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:59:29 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-22fa1b1d-13c3-4ca7-bdd5-fd3a04b683ef tempest-ProjectMemberTests-73797185 None] Created reservations ['fcb20418-eb3b-4aef-ba1e-c5c0ae3f77fc', '4006ac89-64bc-4f3a-a4ef-1e87118c0ed5', '0dabcb6a-55b9-41bf-9773-7d25f8966627', 'd7e550e5-f2b9-4879-9d70-ca99edf500de'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:59:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-22fa1b1d-13c3-4ca7-bdd5-fd3a04b683ef tempest-ProjectMemberTests-73797185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:59:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-22fa1b1d-13c3-4ca7-bdd5-fd3a04b683ef tempest-ProjectMemberTests-73797185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:59:29 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-22fa1b1d-13c3-4ca7-bdd5-fd3a04b683ef tempest-ProjectMemberTests-73797185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:59:29 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-22fa1b1d-13c3-4ca7-bdd5-fd3a04b683ef tempest-ProjectMemberTests-73797185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:59:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-22fa1b1d-13c3-4ca7-bdd5-fd3a04b683ef tempest-ProjectMemberTests-73797185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:59:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-22fa1b1d-13c3-4ca7-bdd5-fd3a04b683ef tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:29 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:59:29 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:29 devstack cinder-volume[87284]: DEBUG cinder.volume.flows.manager.create_volume [None req-99632fed-bdc9-4a49-a607-f522dcf187fd tempest-ProjectMemberTests-73797185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87284) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:59:29 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:29 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-99632fed-bdc9-4a49-a607-f522dcf187fd tempest-ProjectMemberTests-73797185 None] Flow 'volume_create_manager' (ca7dc341-207f-4ebc-9e0d-4ea5ddafc4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:59:29 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-99632fed-bdc9-4a49-a607-f522dcf187fd tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91075998-311a-4d81-8432-60274018b077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:29 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-22fa1b1d-13c3-4ca7-bdd5-fd3a04b683ef tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.812s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:29 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-22fa1b1d-13c3-4ca7-bdd5-fd3a04b683ef tempest-ProjectMemberTests-73797185 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:59:29 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-99632fed-bdc9-4a49-a607-f522dcf187fd tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91075998-311a-4d81-8432-60274018b077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:59:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-332551753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=023b1271-8d5b-40d8-964d-55329d3f6dc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410ede866c9145df8444c3a398ace8b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:59:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:59:30Z,use_quota=True,user_id='5f5ae65b4a584ede952a5bfc00c9a49d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:29 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-99632fed-bdc9-4a49-a607-f522dcf187fd tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (820faca1-0e61-404e-b1f7-56c3b53bb8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:29 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-99632fed-bdc9-4a49-a607-f522dcf187fd tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (820faca1-0e61-404e-b1f7-56c3b53bb8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:29 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-99632fed-bdc9-4a49-a607-f522dcf187fd tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7606ff84-0e3e-47a5-9568-21dbbf2d8603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:30 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-99632fed-bdc9-4a49-a607-f522dcf187fd tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7606ff84-0e3e-47a5-9568-21dbbf2d8603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '023b1271-8d5b-40d8-964d-55329d3f6dc0', 'volume_name': 'volume-023b1271-8d5b-40d8-964d-55329d3f6dc0', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:30 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-99632fed-bdc9-4a49-a607-f522dcf187fd tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0acf4ef-e396-4ab2-8c78-fb17555006a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:30 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-99632fed-bdc9-4a49-a607-f522dcf187fd tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0acf4ef-e396-4ab2-8c78-fb17555006a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:30 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-99632fed-bdc9-4a49-a607-f522dcf187fd tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c5b7e2-92a2-4524-b811-852aed748935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:30 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-99632fed-bdc9-4a49-a607-f522dcf187fd tempest-ProjectMemberTests-73797185 None] Volume 023b1271-8d5b-40d8-964d-55329d3f6dc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-023b1271-8d5b-40d8-964d-55329d3f6dc0', 'volume_size': 1} Jul 08 01:59:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-99632fed-bdc9-4a49-a607-f522dcf187fd tempest-ProjectMemberTests-73797185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:59:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-99632fed-bdc9-4a49-a607-f522dcf187fd tempest-ProjectMemberTests-73797185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:59:30 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-99632fed-bdc9-4a49-a607-f522dcf187fd tempest-ProjectMemberTests-73797185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:59:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-332551753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=023b1271-8d5b-40d8-964d-55329d3f6dc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410ede866c9145df8444c3a398ace8b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:59:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:59:30Z,use_quota=True,user_id='5f5ae65b4a584ede952a5bfc00c9a49d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b99a91c3-7121-421b-bdc8-15a909abea46),volume_type_id=b99a91c3-7121-421b-bdc8-15a909abea46)}" {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:59:30 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-99632fed-bdc9-4a49-a607-f522dcf187fd tempest-ProjectMemberTests-73797185 None] Creating volume 023b1271-8d5b-40d8-964d-55329d3f6dc0 {{(pid=87284) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:59:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-99632fed-bdc9-4a49-a607-f522dcf187fd tempest-ProjectMemberTests-73797185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:59:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-99632fed-bdc9-4a49-a607-f522dcf187fd tempest-ProjectMemberTests-73797185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:59:30 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-99632fed-bdc9-4a49-a607-f522dcf187fd tempest-ProjectMemberTests-73797185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:59:30 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-99632fed-bdc9-4a49-a607-f522dcf187fd tempest-ProjectMemberTests-73797185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:59:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-99632fed-bdc9-4a49-a607-f522dcf187fd tempest-ProjectMemberTests-73797185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:59:30 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-99632fed-bdc9-4a49-a607-f522dcf187fd tempest-ProjectMemberTests-73797185 None] Selected osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 as target Quobyte volume. {{(pid=87284) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:59:30 devstack cinder-volume[87284]: INFO cinder.volume.drivers.remotefs [None req-99632fed-bdc9-4a49-a607-f522dcf187fd tempest-ProjectMemberTests-73797185 None] casted to osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96 Jul 08 01:59:30 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-99632fed-bdc9-4a49-a607-f522dcf187fd tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0 1073741824 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:30 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-22fa1b1d-13c3-4ca7-bdd5-fd3a04b683ef tempest-ProjectMemberTests-73797185 None] Deleted volume successfully. Jul 08 01:59:30 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0 1073741824 Jul 08 01:59:30 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:30 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-22fa1b1d-13c3-4ca7-bdd5-fd3a04b683ef tempest-ProjectMemberTests-73797185 None] Lock "cinder-90dc8ac5-bf53-49e3-b5b7-f4499c96b41e-delete_volume" released by "delete_volume" :: held 2.991s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:59:31 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-99632fed-bdc9-4a49-a607-f522dcf187fd tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0 1073741824" returned: 0 in 1.065s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-99632fed-bdc9-4a49-a607-f522dcf187fd tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:31 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0 Jul 08 01:59:31 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:31 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-99632fed-bdc9-4a49-a607-f522dcf187fd tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0" returned: 0 in 0.864s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:31 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-99632fed-bdc9-4a49-a607-f522dcf187fd tempest-ProjectMemberTests-73797185 None] <== create_volume: return (1977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'} {{(pid=87284) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:59:31 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-99632fed-bdc9-4a49-a607-f522dcf187fd tempest-ProjectMemberTests-73797185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.979s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:59:32 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-99632fed-bdc9-4a49-a607-f522dcf187fd tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c5b7e2-92a2-4524-b811-852aed748935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-023b1271-8d5b-40d8-964d-55329d3f6dc0', 'volume_size': 1}' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:32 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-99632fed-bdc9-4a49-a607-f522dcf187fd tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8289e1bf-1b51-4eca-9a09-cf3be06361fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:32 devstack cinder-volume[87284]: INFO cinder.volume.flows.manager.create_volume [None req-99632fed-bdc9-4a49-a607-f522dcf187fd tempest-ProjectMemberTests-73797185 None] Volume volume-023b1271-8d5b-40d8-964d-55329d3f6dc0 (023b1271-8d5b-40d8-964d-55329d3f6dc0): created successfully Jul 08 01:59:32 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-99632fed-bdc9-4a49-a607-f522dcf187fd tempest-ProjectMemberTests-73797185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8289e1bf-1b51-4eca-9a09-cf3be06361fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87284) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:32 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-99632fed-bdc9-4a49-a607-f522dcf187fd tempest-ProjectMemberTests-73797185 None] Flow 'volume_create_manager' (ca7dc341-207f-4ebc-9e0d-4ea5ddafc4d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87284) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:59:32 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-99632fed-bdc9-4a49-a607-f522dcf187fd tempest-ProjectMemberTests-73797185 None] Created volume successfully. Jul 08 01:59:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ae7fee8a-b32a-4c41-81c3-c3efddcb5e6a tempest-ProjectMemberTests-73797185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:59:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ae7fee8a-b32a-4c41-81c3-c3efddcb5e6a tempest-ProjectMemberTests-73797185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:59:33 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-ae7fee8a-b32a-4c41-81c3-c3efddcb5e6a tempest-ProjectMemberTests-73797185 None] Creating offline snapshot b4a5b5e3-7c4b-45b9-9a57-0e5339d4cc77 of volume 023b1271-8d5b-40d8-964d-55329d3f6dc0 {{(pid=87284) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:59:33 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de2dcb3-c93f-4fd4-a821-5bde0a9ed5f7]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:59:33 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae7fee8a-b32a-4c41-81c3-c3efddcb5e6a tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:33 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0 Jul 08 01:59:33 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:34 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae7fee8a-b32a-4c41-81c3-c3efddcb5e6a tempest-ProjectMemberTests-73797185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0" returned: 0 in 0.891s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:34 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae7fee8a-b32a-4c41-81c3-c3efddcb5e6a tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0.b4a5b5e3-7c4b-45b9-9a57-0e5339d4cc77 1G {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:34 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0.b4a5b5e3-7c4b-45b9-9a57-0e5339d4cc77 1G Jul 08 01:59:34 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:35 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae7fee8a-b32a-4c41-81c3-c3efddcb5e6a tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0.b4a5b5e3-7c4b-45b9-9a57-0e5339d4cc77 1G" returned: 0 in 1.061s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:35 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae7fee8a-b32a-4c41-81c3-c3efddcb5e6a tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-023b1271-8d5b-40d8-964d-55329d3f6dc0 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0.b4a5b5e3-7c4b-45b9-9a57-0e5339d4cc77 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:35 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-023b1271-8d5b-40d8-964d-55329d3f6dc0 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0.b4a5b5e3-7c4b-45b9-9a57-0e5339d4cc77 Jul 08 01:59:35 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:36 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae7fee8a-b32a-4c41-81c3-c3efddcb5e6a tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-023b1271-8d5b-40d8-964d-55329d3f6dc0 -F qcow2 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0.b4a5b5e3-7c4b-45b9-9a57-0e5339d4cc77" returned: 0 in 0.786s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:36 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-ae7fee8a-b32a-4c41-81c3-c3efddcb5e6a tempest-ProjectMemberTests-73797185 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0.b4a5b5e3-7c4b-45b9-9a57-0e5339d4cc77 is being set with open permissions: ugo+rw Jul 08 01:59:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae7fee8a-b32a-4c41-81c3-c3efddcb5e6a tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0.b4a5b5e3-7c4b-45b9-9a57-0e5339d4cc77 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:36 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0.b4a5b5e3-7c4b-45b9-9a57-0e5339d4cc77 Jul 08 01:59:36 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:36 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae7fee8a-b32a-4c41-81c3-c3efddcb5e6a tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0.b4a5b5e3-7c4b-45b9-9a57-0e5339d4cc77" returned: 0 in 0.800s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:36 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae7fee8a-b32a-4c41-81c3-c3efddcb5e6a tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:36 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0.info Jul 08 01:59:36 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:37 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae7fee8a-b32a-4c41-81c3-c3efddcb5e6a tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0.info" returned: 0 in 0.767s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:37 devstack cinder-volume[87284]: WARNING cinder.volume.drivers.remotefs [None req-ae7fee8a-b32a-4c41-81c3-c3efddcb5e6a tempest-ProjectMemberTests-73797185 None] /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0.info is being set with open permissions: ugo+rw Jul 08 01:59:37 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae7fee8a-b32a-4c41-81c3-c3efddcb5e6a tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0.info {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:37 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0.info Jul 08 01:59:37 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:38 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-ae7fee8a-b32a-4c41-81c3-c3efddcb5e6a tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0.info" returned: 0 in 0.725s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:38 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-ae7fee8a-b32a-4c41-81c3-c3efddcb5e6a tempest-ProjectMemberTests-73797185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.127s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:59:38 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-ae7fee8a-b32a-4c41-81c3-c3efddcb5e6a tempest-ProjectMemberTests-73797185 None] Create snapshot completed successfully Jul 08 01:59:39 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-178ecf3c-719a-4923-a1a0-0b979efc6b6a tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-b4a5b5e3-7c4b-45b9-9a57-0e5339d4cc77-delete_snapshot" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:59:39 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-178ecf3c-719a-4923-a1a0-0b979efc6b6a tempest-ProjectMemberTests-73797185 None] Lock "cinder-b4a5b5e3-7c4b-45b9-9a57-0e5339d4cc77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:59:39 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-178ecf3c-719a-4923-a1a0-0b979efc6b6a tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-quobyte-023b1271-8d5b-40d8-964d-55329d3f6dc0" by "delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:59:39 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-178ecf3c-719a-4923-a1a0-0b979efc6b6a tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-023b1271-8d5b-40d8-964d-55329d3f6dc0" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:59:39 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-178ecf3c-719a-4923-a1a0-0b979efc6b6a tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-quobyte-b4a5b5e3-7c4b-45b9-9a57-0e5339d4cc77" by "_delete_snapshot" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:59:39 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-178ecf3c-719a-4923-a1a0-0b979efc6b6a tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-b4a5b5e3-7c4b-45b9-9a57-0e5339d4cc77" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:59:39 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-178ecf3c-719a-4923-a1a0-0b979efc6b6a tempest-ProjectMemberTests-73797185 None] Deleting offline snapshot b4a5b5e3-7c4b-45b9-9a57-0e5339d4cc77 of volume 023b1271-8d5b-40d8-964d-55329d3f6dc0 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:59:39 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-178ecf3c-719a-4923-a1a0-0b979efc6b6a tempest-ProjectMemberTests-73797185 None] snapshot_file for this snap is: volume-023b1271-8d5b-40d8-964d-55329d3f6dc0.b4a5b5e3-7c4b-45b9-9a57-0e5339d4cc77 {{(pid=87284) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:59:39 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cd488b-6ec5-404f-b39c-d63725b15f51]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:59:39 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-178ecf3c-719a-4923-a1a0-0b979efc6b6a tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0.b4a5b5e3-7c4b-45b9-9a57-0e5339d4cc77 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:39 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0.b4a5b5e3-7c4b-45b9-9a57-0e5339d4cc77 Jul 08 01:59:39 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:40 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-178ecf3c-719a-4923-a1a0-0b979efc6b6a tempest-ProjectMemberTests-73797185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0.b4a5b5e3-7c4b-45b9-9a57-0e5339d4cc77" returned: 0 in 0.783s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:40 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.remotefs [None req-178ecf3c-719a-4923-a1a0-0b979efc6b6a tempest-ProjectMemberTests-73797185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-023b1271-8d5b-40d8-964d-55329d3f6dc0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87284) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:59:40 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2def391-e4ea-4a52-a31c-f74cb7443860]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:59:40 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-178ecf3c-719a-4923-a1a0-0b979efc6b6a tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:40 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0 Jul 08 01:59:40 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:41 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-178ecf3c-719a-4923-a1a0-0b979efc6b6a tempest-ProjectMemberTests-73797185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0" returned: 0 in 0.775s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:41 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-178ecf3c-719a-4923-a1a0-0b979efc6b6a tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0.b4a5b5e3-7c4b-45b9-9a57-0e5339d4cc77 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:41 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0.b4a5b5e3-7c4b-45b9-9a57-0e5339d4cc77 Jul 08 01:59:41 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:42 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-178ecf3c-719a-4923-a1a0-0b979efc6b6a tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0.b4a5b5e3-7c4b-45b9-9a57-0e5339d4cc77" returned: 0 in 0.779s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-178ecf3c-719a-4923-a1a0-0b979efc6b6a tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0.b4a5b5e3-7c4b-45b9-9a57-0e5339d4cc77 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:42 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0.b4a5b5e3-7c4b-45b9-9a57-0e5339d4cc77 Jul 08 01:59:42 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:42 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:42 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-178ecf3c-719a-4923-a1a0-0b979efc6b6a tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0.b4a5b5e3-7c4b-45b9-9a57-0e5339d4cc77" returned: 0 in 0.697s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:42 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-178ecf3c-719a-4923-a1a0-0b979efc6b6a tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-b4a5b5e3-7c4b-45b9-9a57-0e5339d4cc77" released by "_delete_snapshot" :: held 3.132s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:59:42 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-178ecf3c-719a-4923-a1a0-0b979efc6b6a tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-023b1271-8d5b-40d8-964d-55329d3f6dc0" released by "delete_snapshot" :: held 3.159s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:59:42 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-178ecf3c-719a-4923-a1a0-0b979efc6b6a tempest-ProjectMemberTests-73797185 None] Created reservations ['52e4f9f5-8cce-47b0-a33e-a247501dc9bb', '19fd2ad8-15ef-46a6-931e-5cc0bbdfec6b', 'aa2ea918-1837-4eb4-a218-0c301fb3f3fc', '71b77e40-daf9-4dce-9f8e-cbeb50c77e25'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:59:43 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-178ecf3c-719a-4923-a1a0-0b979efc6b6a tempest-ProjectMemberTests-73797185 None] Delete snapshot completed successfully. Jul 08 01:59:43 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-178ecf3c-719a-4923-a1a0-0b979efc6b6a tempest-ProjectMemberTests-73797185 None] Lock "cinder-b4a5b5e3-7c4b-45b9-9a57-0e5339d4cc77-delete_snapshot" released by "delete_snapshot" :: held 3.322s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:59:43 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5697ed74-f58d-4a3f-90e7-743c6b600a4f tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-023b1271-8d5b-40d8-964d-55329d3f6dc0-delete_volume" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:59:43 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5697ed74-f58d-4a3f-90e7-743c6b600a4f tempest-ProjectMemberTests-73797185 None] Lock "cinder-023b1271-8d5b-40d8-964d-55329d3f6dc0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:59:44 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5697ed74-f58d-4a3f-90e7-743c6b600a4f tempest-ProjectMemberTests-73797185 None] Acquiring lock "cinder-quobyte-023b1271-8d5b-40d8-964d-55329d3f6dc0" by "delete_volume" {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:59:44 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5697ed74-f58d-4a3f-90e7-743c6b600a4f tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-023b1271-8d5b-40d8-964d-55329d3f6dc0" acquired by "delete_volume" :: waited 0.022s {{(pid=87284) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:59:44 devstack cinder-volume[87284]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c87f6a-0054-4b05-83ea-4efb14621ec8]: (4, 'qcow2') {{(pid=88341) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:59:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5697ed74-f58d-4a3f-90e7-743c6b600a4f tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:44 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0 Jul 08 01:59:44 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:44 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5697ed74-f58d-4a3f-90e7-743c6b600a4f tempest-ProjectMemberTests-73797185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0" returned: 0 in 0.801s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:44 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5697ed74-f58d-4a3f-90e7-743c6b600a4f tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:44 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0 Jul 08 01:59:44 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:45 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5697ed74-f58d-4a3f-90e7-743c6b600a4f tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25/volume-023b1271-8d5b-40d8-964d-55329d3f6dc0" returned: 0 in 0.694s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:45 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5697ed74-f58d-4a3f-90e7-743c6b600a4f tempest-ProjectMemberTests-73797185 None] Lock "cinder-quobyte-023b1271-8d5b-40d8-964d-55329d3f6dc0" released by "delete_volume" :: held 1.561s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:59:45 devstack cinder-volume[87284]: DEBUG cinder.quota [None req-5697ed74-f58d-4a3f-90e7-743c6b600a4f tempest-ProjectMemberTests-73797185 None] Created reservations ['3b058431-23b2-4060-a21b-20f340998660', 'fa5480cd-a938-4fe8-9641-ccc6e46f0fc4', 'fbd6b3f6-c05d-4b23-8f9c-0e0d26c919ae', '53f09697-c60c-47f8-8e50-dbf47cf18d35'] {{(pid=87284) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:59:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5697ed74-f58d-4a3f-90e7-743c6b600a4f tempest-ProjectMemberTests-73797185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:59:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5697ed74-f58d-4a3f-90e7-743c6b600a4f tempest-ProjectMemberTests-73797185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:59:45 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5697ed74-f58d-4a3f-90e7-743c6b600a4f tempest-ProjectMemberTests-73797185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:59:45 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-5697ed74-f58d-4a3f-90e7-743c6b600a4f tempest-ProjectMemberTests-73797185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:59:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-5697ed74-f58d-4a3f-90e7-743c6b600a4f tempest-ProjectMemberTests-73797185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:59:45 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5697ed74-f58d-4a3f-90e7-743c6b600a4f tempest-ProjectMemberTests-73797185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:45 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:59:45 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:46 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:46 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-5697ed74-f58d-4a3f-90e7-743c6b600a4f tempest-ProjectMemberTests-73797185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.765s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:46 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-5697ed74-f58d-4a3f-90e7-743c6b600a4f tempest-ProjectMemberTests-73797185 None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:59:46 devstack cinder-volume[87284]: INFO cinder.volume.manager [None req-5697ed74-f58d-4a3f-90e7-743c6b600a4f tempest-ProjectMemberTests-73797185 None] Deleted volume successfully. Jul 08 01:59:46 devstack cinder-volume[87284]: DEBUG cinder.coordination [None req-5697ed74-f58d-4a3f-90e7-743c6b600a4f tempest-ProjectMemberTests-73797185 None] Lock "cinder-023b1271-8d5b-40d8-964d-55329d3f6dc0-delete_volume" released by "delete_volume" :: held 2.558s {{(pid=87284) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:59:55 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:59:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:59:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:59:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96': None} {{(pid=87284) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:59:55 devstack cinder-volume[87284]: DEBUG cinder.volume.drivers.quobyte [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ea83dc6-be47-41b7-8e3d-37ad7a875f96'] {{(pid=87284) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:59:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.lockutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87284) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:59:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:55 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25 Jul 08 01:59:55 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:55 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=32,cinder:INSERT=16,cinder:UPDATE=47,cinder:DELETE=4 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:59:55 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:55 devstack cinder-volume[87284]: DEBUG oslo_concurrency.processutils [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6f72dc4140e97a7c92f3823b290ac25" returned: 0 in 0.747s {{(pid=87284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:55 devstack cinder-volume[87284]: DEBUG cinder.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Notifying Schedulers of capabilities ... {{(pid=87284) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:59:55 devstack cinder-volume[87284]: DEBUG oslo_service.periodic_task [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] Running periodic task VolumeManager._thread_info {{(pid=87284) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:59:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread count: 29 {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:59:55 devstack cinder-volume[87284]: DEBUG cinder.volume.manager [None req-b48a5f81-200a-422f-a65b-1fc9d0fb589f None None] thread info: [<_MainThread(MainThread, started 127058402500736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87284) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:59:56 devstack cinder-volume[87284]: DEBUG dbcounter [-] [87284] Writing DB stats cinder:SELECT=34,cinder:INSERT=10,cinder:UPDATE=47,cinder:DELETE=2 {{(pid=87284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}